FaceWidgets: Exploring tangible interaction on face with head-mounted displays

Wen Jie Tseng, Li Yang Wang, Liwei Chan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

We present FaceWidgets, a device integrated with the backside of a head-mounted display (HMD) that enables tangible interactions using physical controls. To allow for near range-to-eye interactions, our first study suggested displaying the virtual widgets at 20 cm from the eye positions, which is 9 cm from the HMD backside. We propose two novel interactions, widget canvas and palm-facing gesture, that can help users avoid double vision and allow them to access the interface as needed. Our second study showed that displaying a hand reference improved performance of face widgets interactions. We developed two applications of FaceWidgets, a fixed-layout 360 video player and a contextual input for smart home control. Finally, we compared four hand visualizations against the two applications in an exploratory study. Participants considered the transparent hand as the most suitable and responded positively to our system.

Original languageEnglish
Title of host publicationUIST 2019 - Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages417-427
Number of pages11
ISBN (Electronic)9781450368162
DOIs
StatePublished - 17 Oct 2019
Event32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019 - New Orleans, United States
Duration: 20 Oct 201923 Oct 2019

Publication series

NameUIST 2019 - Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology

Conference

Conference32nd Annual ACM Symposium on User Interface Software and Technology, UIST 2019
CountryUnited States
CityNew Orleans
Period20/10/1923/10/19

Keywords

  • Back-of-device interaction
  • Direct manipulation
  • Head-mounted display
  • Mobile VR
  • Virtual reality

Fingerprint Dive into the research topics of 'FaceWidgets: Exploring tangible interaction on face with head-mounted displays'. Together they form a unique fingerprint.

Cite this