Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D video communication

Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D... Three-Dimensional Multi-View Video (3D MVV) contains diverse video streams taken by different cameras around an object. Thence, it is an imperative assignment to fulfill efficient compression to attain future resource bonds whilst preserving a decisive reception MVV quality. The extensive 3D MVV encoding and transmission over mobile or Internet are vulnerable to packet losses on account of the existence of severe channel faults and restricted bandwidth. In this work, we propose a new Encoder-Independent Decoder-Dependent Depth-Assisted Error Concealment (EIDD-DAEC) algorithm. It invests the depth correlations between the temporally, spatially, and inter-view adjoining Macro-Blocks (MBs) to conceal the erroneous streams. At the encoder, the existing inter-view, temporal, and spatial matching are exploited to efficiently compress the 3D MVV streams and to estimate the Disparity Vectors (DVs) and Motion Vectors (MVs). At the decoder, the gathered MVs and DVs from the received coded streams are used to calculate additional depth-assisted MVs and DVs, which are afterwards combined with the collected candidate texture color MVs and DVs groups for concealing the lost MBs of inter- and intra-encoded frames. Finally, the optimum DVs and MVs concealment candidates are selected by the Directional Interpolation Error Concealment Algorithm (DIECA) and Decoder Motion Vector Estimation Algorithm (DMVEA), respectively. Experimental results on several standardized 3D MVV sequences verified the efficacy of the proposed EIDD-DAEC algorithm by achieving ameliorated efficacious objective and subjective results without generating and transporting depth maps at the encoder. The proposed work achieves high 3D MVV quality performance with an improved average Peak Signal-to-Noise Ratio (PSNR) gain by up to 0.95 ~ 2.70 dBs compared to the state-of-the-art error concealment algorithms, which do not employ depth-assisted correlations at different Quantization Parameters (QPs) and Packet Loss Rates (PLRs) of 40%. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Multimedia Tools and Applications Springer Journals

Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D video communication

Download PDF
28 pages

Loading next page...
 
/lp/springer_journal/encoder-independent-decoder-dependent-depth-assisted-error-concealment-0aExabx7hn
Publisher
Springer Journals
Copyright
Copyright © 2017 by Springer Science+Business Media, LLC
Subject
Computer Science; Multimedia Information Systems; Computer Communication Networks; Data Structures, Cryptology and Information Theory; Special Purpose and Application-Based Systems
ISSN
1380-7501
eISSN
1573-7721
DOI
10.1007/s11042-017-4936-y
Publisher site
See Article on Publisher Site

Abstract

Three-Dimensional Multi-View Video (3D MVV) contains diverse video streams taken by different cameras around an object. Thence, it is an imperative assignment to fulfill efficient compression to attain future resource bonds whilst preserving a decisive reception MVV quality. The extensive 3D MVV encoding and transmission over mobile or Internet are vulnerable to packet losses on account of the existence of severe channel faults and restricted bandwidth. In this work, we propose a new Encoder-Independent Decoder-Dependent Depth-Assisted Error Concealment (EIDD-DAEC) algorithm. It invests the depth correlations between the temporally, spatially, and inter-view adjoining Macro-Blocks (MBs) to conceal the erroneous streams. At the encoder, the existing inter-view, temporal, and spatial matching are exploited to efficiently compress the 3D MVV streams and to estimate the Disparity Vectors (DVs) and Motion Vectors (MVs). At the decoder, the gathered MVs and DVs from the received coded streams are used to calculate additional depth-assisted MVs and DVs, which are afterwards combined with the collected candidate texture color MVs and DVs groups for concealing the lost MBs of inter- and intra-encoded frames. Finally, the optimum DVs and MVs concealment candidates are selected by the Directional Interpolation Error Concealment Algorithm (DIECA) and Decoder Motion Vector Estimation Algorithm (DMVEA), respectively. Experimental results on several standardized 3D MVV sequences verified the efficacy of the proposed EIDD-DAEC algorithm by achieving ameliorated efficacious objective and subjective results without generating and transporting depth maps at the encoder. The proposed work achieves high 3D MVV quality performance with an improved average Peak Signal-to-Noise Ratio (PSNR) gain by up to 0.95 ~ 2.70 dBs compared to the state-of-the-art error concealment algorithms, which do not employ depth-assisted correlations at different Quantization Parameters (QPs) and Packet Loss Rates (PLRs) of 40%.

Journal

Multimedia Tools and Applications – Springer Journals

Published: Jul 12, 2017

References

  • Optimizing multiview video plus depth prediction structures for interactive multiview video streaming
    Abreu, A; Frossard, P; Pereira, F
  • Adaptive delivery of immersive 3D multi-view video over the internet
    Cagri, O; Erhan, E; Janko, C; Ahmet, K
  • Frame loss concealment for stereoscopic video plus depth sequences
    Chung, TY; Sanghoon, S; Kim, CS
  • Video inpainting with short-term windows: application to object removal and error concealment
    Ebdelli, M; Le-Meur, O; Guillemot, C
  • Pixel-level matching based multi-hypothesis error concealment modes for wireless 3D H.264/MVC communication
    El-Shafai, W
  • Joint adaptive pre-processing resilience and post-processing concealment schemes for 3D video transmission
    El-Shafai, W
  • Quality of experience for 3D video streaming
    Hewage, CTER; Martini, MG
  • Fast multiview video coding using adaptive prediction structure and hierarchical mode decision
    Huanqiang, Z; Xiaolan, W; Canhui, C; Jing, C; Yan, Z
  • Hybrid temporal error concealment methods for block-based compressed video transmission
    Hwang, M; Ko, S
  • Temporal and inter-view consistent error concealment technique for multiview plus depth video
    Khattak, S; Maugey, T; Hamzaoui, R; Ahmad, S; Frossard, P
  • Motion vector recovery for video error concealment by using iterative dynamic-programming optimization
    Lie, WN; Lee, CM; Yeh, CH; Gao, ZW
  • Optimizing distributed source coding for interactive multiview video streaming over lossy networks
    Liu, Z; Cheung, G; Ji, Y
  • Multiview plus depth video coding with temporal prediction view synthesis
    Purica, A; Mora, E; Pesquet, B; Cagnazzo, M; Ionescu, B
  • An effiicient full frame algorithm for object-based error concealment in 3D depth-based video
    Tai, SC; Wang, CC; Hong, CS; Luo, YC
  • IEEE fourth Int Conf on instrumentation and measurement
    Xiang, X; Cheng, Y
  • Robust multiview three-dimensional video communications based on distributed video coding
    Xiang, W; Gao, P; Peng, Q
  • Efficient frame concealment for depth image-based 3-D video transmission
    Yan, B; Jie, Z
  • Next generation 3D formats with depth map support
    Ying, C; Vetro, A
  • Inter layer FEC aided unequal error protection for multilayer video transmission in mobile TV
    Yongkai, H; El-Hajjar, M; Hanzo, L
  • Depth image-based temporal error concealment for 3-D video transmission
    Yunqiang, L; Jin, W; Huanhuan, Z
  • Frame loss concealment for multiview video transmission over wireless multimedia sensor networks
    Zhou, Y; Xiang, W; Wang, G