TY - JOUR AU - Peng, Qiang AB - The high level of compression achieved by high efficiency video coding (HEVC) helps reduce network traffic loads and mitigate data rate requirements. However, HEVC is vulnerable to error-prone channels where transmission errors can result in severe degradation of video quality. In this paper, a saliency-aware encoding scheme is proposed to improve the error robustness of HEVC streaming, by reducing temporal error propagation in case of packet loss. The proposed scheme firstly introduces a saliency detection model in compressed domain, based on two HEVC features derived from the depth splitting of the coding unit and the residual. Incorporated with the saliency map, an improved reference frame selection strategy is then introduced to reduce the inter-prediction mismatch that occurs at the decoder after packet loss. Specifically, the reference frames are dynamically selected based on the saliency-weighted Lagrangian optimisation, which not only reduces the number of prediction units (PUs) that depend on a single reference in saliency regions but also chooses the optimal coding mode for non-saliency regions. Finally, the most salient PUs are required to select the reference block in which most of the pixels are coded with intra-mode, for providing more robust reference to saliency regions. The simulation results show that the proposed reference picture selection scheme outperforms other reference methods with higher error robustness and a smaller loss in coding efficiency. Compared to the HEVC reference software, the proposed scheme is able to improve the quality of recovered video after packet loss, achieving average PSNR gains of up to 1.92 dB. TI - Reference picture selection scheme for robust HEVC video transmission using compressed domain saliency map JF - Journal of Real-Time Image Processing DO - 10.1007/s11554-023-01327-2 DA - 2023-08-01 UR - https://www.deepdyve.com/lp/springer-journals/reference-picture-selection-scheme-for-robust-hevc-video-transmission-5vxM80e01P VL - 20 IS - 4 DP - DeepDyve ER -