Efficient recognition and 6D pose tracking of markerless objects with RGB-D and motion sensors on mobile devices

Sheng Chu Huang, Wei Lun Huang, Yi Cheng Lu, Ming Han Tsai, I-Chen Lin, Yo Chung Lau, Hsu Hang Liu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a system that can efficiently detect objects and estimate their 6D postures with RGB-D and motion sensor data on a mobile device. We apply a template-based method to detect the pose of an object, in which the matching process is accelerated through dimension reduction of the vectorized template matrix. After getting the initial pose, the proposed system then tracks the detected objects by a modified bidirectional iterative closest point algorithm. Furthermore, our system checks information from the inertial measurement unit on a mobile device to alleviate intensive computation for ease of interactive applications.

Original languageEnglish
Title of host publicationVISIGRAPP 2019 - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
EditorsAndreas Kerren, Christophe Hurter, Jose Braz
PublisherSciTePress
Pages375-382
Number of pages8
ISBN (Electronic)9789897583544
DOIs
StatePublished - 1 Jan 2019
Event14th International Conference on Computer Graphics Theory and Applications, GRAPP 2019 - Part of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2019 - Prague, Czech Republic
Duration: 25 Feb 201927 Feb 2019

Publication series

NameVISIGRAPP 2019 - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
Volume1

Conference

Conference14th International Conference on Computer Graphics Theory and Applications, GRAPP 2019 - Part of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2019
CountryCzech Republic
CityPrague
Period25/02/1927/02/19

Keywords

  • Markerless Tracking
  • Object Recognition
  • Pose Estimation
  • Sensors on Mobile Devices

Fingerprint Dive into the research topics of 'Efficient recognition and 6D pose tracking of markerless objects with RGB-D and motion sensors on mobile devices'. Together they form a unique fingerprint.

  • Cite this

    Huang, S. C., Huang, W. L., Lu, Y. C., Tsai, M. H., Lin, I-C., Lau, Y. C., & Liu, H. H. (2019). Efficient recognition and 6D pose tracking of markerless objects with RGB-D and motion sensors on mobile devices. In A. Kerren, C. Hurter, & J. Braz (Eds.), VISIGRAPP 2019 - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (pp. 375-382). (VISIGRAPP 2019 - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications; Vol. 1). SciTePress. https://doi.org/10.5220/0007692603750382