Depth Map Enhancement on RGB-D Video Captured by Kinect V2

Ke Yu Lin, Hsueh-Ming Hang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

The quality of depth map is one key factor contributing to the quality of 3D video and virtual reality (VR) rendering. In this study, we use RGB-D camera (Microsoft Kinect for Windows v2) to capture the color sequences and depth sequences as our system inputs. The captured depth map contains various noises and artifacts in addition to the occlusion regions. We use the color sequences in both spatial domain and time domain to improve the quality of the depth map. Our main contributions are alignment between color and depth images and reducing artifacts in the reflection regions. Several techniques are adopted, modified, and re-designed such as moving object compensation, unreliable depth pixel detection, and locally adaptive depth pixel refinement algorithm. The experimental results show that the quality of the depth map is significantly improved.

Original languageEnglish
Title of host publication2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1530-1535
Number of pages6
ISBN (Electronic)9789881476852
DOIs
StatePublished - 4 Mar 2019
Event10th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Honolulu, United States
Duration: 12 Nov 201815 Nov 2018

Publication series

Name2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings

Conference

Conference10th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018
CountryUnited States
CityHonolulu
Period12/11/1815/11/18

Keywords

  • Depth map
  • Kinect v2
  • backward warping
  • camera synchronization
  • depth refinement
  • disocclusion filling

Fingerprint Dive into the research topics of 'Depth Map Enhancement on RGB-D Video Captured by Kinect V2'. Together they form a unique fingerprint.

  • Cite this

    Lin, K. Y., & Hang, H-M. (2019). Depth Map Enhancement on RGB-D Video Captured by Kinect V2. In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings (pp. 1530-1535). [8659552] (2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2018 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/APSIPA.2018.8659552