RetroShape: Leveraging rear-surface shape displays for 2.5D interaction on smartwatches

XDa-Yuan Huang, Ruizhen Guo, Jun Gong, Jingxian Wang, John Graham, De Nian Yang, Xing Dong Yang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

The small screen size of a smartwatch limits user experience when watching or interacting with media. We propose a supplementary tactile feedback system to enhance the user experience with a method unique to the smartwatch form factor. Our system has a deformable surface on the back of the watch face, allowing the visual scene on screen to extend into 2.5D physical space. This allows the user to watch and feel virtual objects, such as experiencing a ball bouncing against the wrist. We devised two controlled experiments to analyze the influence of tactile display resolution on the illusion of virtual object presence. Our first study revealed that on average, a taxel can render virtual objects between 70% and 138% of its own size without shattering the illusion. From the second study, we found visual and haptic feedback can be separated by 4.5mm to 16.2mm for the tested taxels. Based on the results, we developed a prototype (called RetroShape) with 4×4 10mm taxels using micro servo motors, and demonstrated its unique capability through a set of tactile-enhanced games and videos. A preliminary user evaluation showed that participants welcome RetroShape as a useful addition to existing smartwatch output.

Original languageEnglish
Title of host publicationUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages539-551
Number of pages13
ISBN (Electronic)9781450349819
DOIs
StatePublished - 20 Oct 2017
Event30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada
Duration: 22 Oct 201725 Oct 2017

Publication series

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
CountryCanada
CityQuebec City
Period22/10/1725/10/17

Keywords

  • Mobile haptics
  • Shape-changing display
  • Smartwatch
  • Taxel

Fingerprint Dive into the research topics of 'RetroShape: Leveraging rear-surface shape displays for 2.5D interaction on smartwatches'. Together they form a unique fingerprint.

  • Cite this

    Huang, XD-Y., Guo, R., Gong, J., Wang, J., Graham, J., Yang, D. N., & Yang, X. D. (2017). RetroShape: Leveraging rear-surface shape displays for 2.5D interaction on smartwatches. In UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (pp. 539-551). (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery, Inc. https://doi.org/10.1145/3126594.3126610