Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D video communication

Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D... Three-Dimensional Multi-View Video (3D MVV) contains diverse video streams taken by different cameras around an object. Thence, it is an imperative assignment to fulfill efficient compression to attain future resource bonds whilst preserving a decisive reception MVV quality. The extensive 3D MVV encoding and transmission over mobile or Internet are vulnerable to packet losses on account of the existence of severe channel faults and restricted bandwidth. In this work, we propose a new Encoder-Independent Decoder-Dependent Depth-Assisted Error Concealment (EIDD-DAEC) algorithm. It invests the depth correlations between the temporally, spatially, and inter-view adjoining Macro-Blocks (MBs) to conceal the erroneous streams. At the encoder, the existing inter-view, temporal, and spatial matching are exploited to efficiently compress the 3D MVV streams and to estimate the Disparity Vectors (DVs) and Motion Vectors (MVs). At the decoder, the gathered MVs and DVs from the received coded streams are used to calculate additional depth-assisted MVs and DVs, which are afterwards combined with the collected candidate texture color MVs and DVs groups for concealing the lost MBs of inter- and intra-encoded frames. Finally, the optimum DVs and MVs concealment candidates are selected by the Directional Interpolation Error Concealment Algorithm (DIECA) and Decoder Motion Vector Estimation Algorithm (DMVEA), respectively. Experimental results on several standardized 3D MVV sequences verified the efficacy of the proposed EIDD-DAEC algorithm by achieving ameliorated efficacious objective and subjective results without generating and transporting depth maps at the encoder. The proposed work achieves high 3D MVV quality performance with an improved average Peak Signal-to-Noise Ratio (PSNR) gain by up to 0.95 ~ 2.70 dBs compared to the state-of-the-art error concealment algorithms, which do not employ depth-assisted correlations at different Quantization Parameters (QPs) and Packet Loss Rates (PLRs) of 40%. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Multimedia Tools and Applications Springer Journals

Encoder-independent decoder-dependent depth-assisted error concealment algorithm for wireless 3D video communication

28 pages
Read Article
Loading next page...
 
/lp/springer_journal/encoder-independent-decoder-dependent-depth-assisted-error-concealment-0aExabx7hn
Publisher
Springer US
Copyright
Copyright © 2017 by Springer Science+Business Media, LLC
Subject
Computer Science; Multimedia Information Systems; Computer Communication Networks; Data Structures, Cryptology and Information Theory; Special Purpose and Application-Based Systems
ISSN
1380-7501
eISSN
1573-7721
D.O.I.
10.1007/s11042-017-4936-y
Publisher site
See Article on Publisher Site

Abstract

Three-Dimensional Multi-View Video (3D MVV) contains diverse video streams taken by different cameras around an object. Thence, it is an imperative assignment to fulfill efficient compression to attain future resource bonds whilst preserving a decisive reception MVV quality. The extensive 3D MVV encoding and transmission over mobile or Internet are vulnerable to packet losses on account of the existence of severe channel faults and restricted bandwidth. In this work, we propose a new Encoder-Independent Decoder-Dependent Depth-Assisted Error Concealment (EIDD-DAEC) algorithm. It invests the depth correlations between the temporally, spatially, and inter-view adjoining Macro-Blocks (MBs) to conceal the erroneous streams. At the encoder, the existing inter-view, temporal, and spatial matching are exploited to efficiently compress the 3D MVV streams and to estimate the Disparity Vectors (DVs) and Motion Vectors (MVs). At the decoder, the gathered MVs and DVs from the received coded streams are used to calculate additional depth-assisted MVs and DVs, which are afterwards combined with the collected candidate texture color MVs and DVs groups for concealing the lost MBs of inter- and intra-encoded frames. Finally, the optimum DVs and MVs concealment candidates are selected by the Directional Interpolation Error Concealment Algorithm (DIECA) and Decoder Motion Vector Estimation Algorithm (DMVEA), respectively. Experimental results on several standardized 3D MVV sequences verified the efficacy of the proposed EIDD-DAEC algorithm by achieving ameliorated efficacious objective and subjective results without generating and transporting depth maps at the encoder. The proposed work achieves high 3D MVV quality performance with an improved average Peak Signal-to-Noise Ratio (PSNR) gain by up to 0.95 ~ 2.70 dBs compared to the state-of-the-art error concealment algorithms, which do not employ depth-assisted correlations at different Quantization Parameters (QPs) and Packet Loss Rates (PLRs) of 40%.

Journal

Multimedia Tools and Applications – Springer Journals

Published: Jul 12, 2017

References

  • Optimizing multiview video plus depth prediction structures for interactive multiview video streaming
    Abreu, A; Frossard, P; Pereira, F
  • Adaptive delivery of immersive 3D multi-view video over the internet
    Cagri, O; Erhan, E; Janko, C; Ahmet, K
  • Frame loss concealment for stereoscopic video plus depth sequences
    Chung, TY; Sanghoon, S; Kim, CS
  • Video inpainting with short-term windows: application to object removal and error concealment
    Ebdelli, M; Le-Meur, O; Guillemot, C
  • Pixel-level matching based multi-hypothesis error concealment modes for wireless 3D H.264/MVC communication
    El-Shafai, W
  • Joint adaptive pre-processing resilience and post-processing concealment schemes for 3D video transmission
    El-Shafai, W
  • Quality of experience for 3D video streaming
    Hewage, CTER; Martini, MG
  • Fast multiview video coding using adaptive prediction structure and hierarchical mode decision
    Huanqiang, Z; Xiaolan, W; Canhui, C; Jing, C; Yan, Z
  • Hybrid temporal error concealment methods for block-based compressed video transmission
    Hwang, M; Ko, S
  • Temporal and inter-view consistent error concealment technique for multiview plus depth video
    Khattak, S; Maugey, T; Hamzaoui, R; Ahmad, S; Frossard, P
  • Motion vector recovery for video error concealment by using iterative dynamic-programming optimization
    Lie, WN; Lee, CM; Yeh, CH; Gao, ZW
  • Optimizing distributed source coding for interactive multiview video streaming over lossy networks
    Liu, Z; Cheung, G; Ji, Y
  • Multiview plus depth video coding with temporal prediction view synthesis
    Purica, A; Mora, E; Pesquet, B; Cagnazzo, M; Ionescu, B
  • An effiicient full frame algorithm for object-based error concealment in 3D depth-based video
    Tai, SC; Wang, CC; Hong, CS; Luo, YC
  • IEEE fourth Int Conf on instrumentation and measurement
    Xiang, X; Cheng, Y
  • Robust multiview three-dimensional video communications based on distributed video coding
    Xiang, W; Gao, P; Peng, Q
  • Efficient frame concealment for depth image-based 3-D video transmission
    Yan, B; Jie, Z
  • Next generation 3D formats with depth map support
    Ying, C; Vetro, A
  • Inter layer FEC aided unequal error protection for multilayer video transmission in mobile TV
    Yongkai, H; El-Hajjar, M; Hanzo, L
  • Depth image-based temporal error concealment for 3-D video transmission
    Yunqiang, L; Jin, W; Huanhuan, Z
  • Frame loss concealment for multiview video transmission over wireless multimedia sensor networks
    Zhou, Y; Xiang, W; Wang, G

You’re reading a free preview. Subscribe to read the entire article.

Try 2 weeks free now

DeepDyve is your
personal research library

It’s your single place to instantly
discover and read the research
that matters to you.

Enjoy affordable access to
over 18 million articles from more than
15,000 peer-reviewed journals.

All for just $49/month

Explore the DeepDyve Library

or browse the journals available

Search

Query the DeepDyve database, plus search all of PubMed and Google Scholar seamlessly

Organize

Save any article or search result from DeepDyve, PubMed, and Google Scholar... all in one place.

Access

Get unlimited, online access to over 18 million full-text articles from more than 15,000 scientific journals.

Your journals are on DeepDyve

Read from thousands of the leading scholarly journals from SpringerNature, Elsevier, Wiley-Blackwell, Oxford University Press and more.

All the latest content is available, no embargo periods.

See the journals in your area

DeepDyve

Freelancer

DeepDyve

Pro

Price

FREE

$49/month
$360/year

Save searches from
Google Scholar,
PubMed

Create lists to
organize your research

Export lists, citations

Read DeepDyve articles

Abstract access only

Unlimited access to over
18 million full-text articles

Print

20 pages / month

PDF Discount

20% off

Sign up
for free
Start 14 day
Free Trial