A synthesis-quality-oriented depth refinement scheme for MPEG Free Viewpoint Television (FTV)

Chun Chi Chen*, Yi Wen Chen, Fu Yao Yang, Wen-Hsiao Peng

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations

Abstract

This paper addresses the problem of refining depth information from the received reference and depth images within the MPEG FTV framework. An analytical model is first developed to approximate the per-pixel synthesis distortion (caused by depth-image compression) as a function of depth-error variances, intensity variations, ground-truth depth and virtual camera locations. We then follow the model to detect unreliable depth pixels by inspecting intensity gradients and to refine their values with a candidate-based block disparity search. Additional side information is transmitted to make both operations robust against compression effects. Experimental results show that our scheme offers an average PSNR improvement of 1.2 dB over MPEG FTV and consistently outperforms the state-of-the-art methods. Moreover, it can remove synthesis artifacts to a great extent, producing a result that is very close in appearance to the ground-truth view image.

Original languageEnglish
Title of host publicationISM 2009 - 11th IEEE International Symposium on Multimedia
Pages171-178
Number of pages8
DOIs
StatePublished - 1 Dec 2009
Event11th IEEE International Symposium on Multimedia, ISM 2009 - San Diego, CA, United States
Duration: 14 Dec 200916 Dec 2009

Publication series

NameISM 2009 - 11th IEEE International Symposium on Multimedia

Conference

Conference11th IEEE International Symposium on Multimedia, ISM 2009
CountryUnited States
CitySan Diego, CA
Period14/12/0916/12/09

Fingerprint Dive into the research topics of 'A synthesis-quality-oriented depth refinement scheme for MPEG Free Viewpoint Television (FTV)'. Together they form a unique fingerprint.

Cite this