Augmented reality instruction for object assembly based on markerless tracking

Li Chen Wu, I-Chen Lin, Ming Han Tsai

Research output: Chapter in Book/Report/Conference proceedingConference contribution

12 Scopus citations

Abstract

Conventional object assembly instructions are usually written or illustrated in a paper manual. Users have to associate these static instructions with real objects in 3D space. In this paper, a novel augmented reality system is presented for a user to interact with objects and instructions. While most related methods pasted obvious markers onto objects for tracking and constrained their orientations or shapes, we adopt a markerless strategy for more intuitive interaction. Based on live information from an off-the-shelf RGBD camera, the proposed tracking procedure identifies components in a scene, tracks their 3D positions and orientations, and evaluates whether there are combinations of components. According to the detected events and poses, our indication procedure then dynamically displays indication lines, circular arrows and other hints to guide a user to manipulate the components into correct poses. The experiment shows that the proposed system can robustly track the components and respond intuitive instructions at an interactive rate. Most of users in evaluation are interested and willing to use this novel technique for object assembly.

Original languageEnglish
Title of host publicationProceedings - 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2016
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery, Inc
Pages95-102
Number of pages8
ISBN (Electronic)9781450340434
DOIs
StatePublished - 27 Feb 2016
Event20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2016 - Redmond, United States
Duration: 27 Feb 201628 Feb 2016

Publication series

NameProceedings - 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2016

Conference

Conference20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2016
CountryUnited States
CityRedmond
Period27/02/1628/02/16

Keywords

  • Assembly instruction
  • Augmented reality
  • Object tracking

Fingerprint Dive into the research topics of 'Augmented reality instruction for object assembly based on markerless tracking'. Together they form a unique fingerprint.

  • Cite this

    Wu, L. C., Lin, I-C., & Tsai, M. H. (2016). Augmented reality instruction for object assembly based on markerless tracking. In S. N. Spencer (Ed.), Proceedings - 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2016 (pp. 95-102). (Proceedings - 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, I3D 2016). Association for Computing Machinery, Inc. https://doi.org/10.1145/2856400.2856416