O-Displaying: An Orientation-Based Augmented Reality Display on a Smart Glass with a User Tracking from a Depth Camera

Yi Shan Lan, Kai Lung Hua, Shih Wei Sun, Wen-Huang Cheng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations


Augmented reality (AR) contents are widely viewed from mobile devices, e.g. smart phones, tablets, and smart glasses [Olsson and Salo 2011]. To properly display AR contents on a screen, color cameras are widely used to detect markers, feature points, and registered images [Krevelen 2007], and the corresponding 2D/3D visual contents are rendered with proper size and location on the screen/displaying device. However, when the lighting condition is unstable, the flicking effects of the rendered visual contents could degrade the user experience. In a dark environment, it is challenging to display AR contents based on color cameras for marker/feature point detection. Even RGB-D cameras [A. Canessa and Solari 2014] are used for object detection to display the AR contents, the object without salient representation in the depth map are still challenging to be detected. In addition, the motion blur situation also makes the AR content displaying challenging. To solve the above-mentioned issues, in this paper, we propose an orientation-based AR display scheme using the orientation sensors, i.e. gyro sensor, accelerometer, and magnetometer (compass sensor) of a smart glass, according to the user tracking results from a depth camera to properly display the AR contents on a smart glass. In the experimental results, the proposed prototype can properly display AR contents in bright environment and in extremely dark environment.

Original languageEnglish
Title of host publicationSIGGRAPH Asia 2017 Posters, SA 2017
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450354059
StatePublished - 27 Nov 2017
EventSIGGRAPH Asia 2017 Posters, SA 2017 - Bangkok, Thailand
Duration: 27 Nov 201730 Nov 2017

Publication series

NameSIGGRAPH Asia 2017 Posters, SA 2017


ConferenceSIGGRAPH Asia 2017 Posters, SA 2017


  • Augmented Reality
  • Depth Camera
  • Orientation Sensor
  • Smart Glass
  • Tracking

Fingerprint Dive into the research topics of 'O-Displaying: An Orientation-Based Augmented Reality Display on a Smart Glass with a User Tracking from a Depth Camera'. Together they form a unique fingerprint.

Cite this