Tangible and visible 3D object reconstruction in augmented reality

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Many crucial applications in the fields of filmmaking, game design, education, and cultural preservation - among others - involve the modeling, authoring, or editing of 3D objects and scenes. The two major methods of creating 3D models are 1) modeling, using computer software, and 2) reconstruction, generally using high-quality 3D scanners. Scanners of sufficient quality to support the latter method remain unaffordable to the general public. Since the emergence of consumer-grade RGBD cameras, there has been a growing interest in 3D reconstruction systems using depth cameras. However, most such systems are not user-friendly, and require intense efforts and practice if good reconstruction results are to be obtained. In this paper, we propose to increase the accessibility of depth-camera-based 3D reconstruction by assisting its users with augmented reality (AR) technology. Specifically, the proposed approach will allow users to rotate/move a target object freely with their hands and see the object being overlapped with its reconstructing model during the reconstruction process. As well as being more instinctual than conventional reconstruction systems, our proposed system will provide useful hints on complete 3D reconstruction of an object, including the best capturing range; reminder of moving and rotating the object at a steady speed; and which model regions are complex enough to require zooming-in. We evaluated our system via a user study that compared its performance against those of three other stateof- the-art approaches, and found our system outperforms the other approaches. Specifically, the participants rated it highest in usability, understandability, and model satisfaction.

Original languageEnglish
Title of host publicationProceedings - 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages26-36
Number of pages11
ISBN (Electronic)9781728109879
DOIs
StatePublished - Oct 2019
Event18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019 - Beijing, China
Duration: 14 Oct 201918 Oct 2019

Publication series

NameProceedings - 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019

Conference

Conference18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019
CountryChina
CityBeijing
Period14/10/1918/10/19

Fingerprint Dive into the research topics of 'Tangible and visible 3D object reconstruction in augmented reality'. Together they form a unique fingerprint.

  • Cite this

    Wu, Y. C., Chan, L., & Lin, W. C. (2019). Tangible and visible 3D object reconstruction in augmented reality. In Proceedings - 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019 (pp. 26-36). [8943645] (Proceedings - 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMAR.2019.00-30