Outside-in: Visualizing out-of-sight regions-of-interest in a 360 video using spatial picture-in-picture previews

Yung Ta Lin, Yi Chi Liao, Shan Yuan Teng, Yi Ju Chung, Liwei Chan, Bing Yu Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Scopus citations

Abstract

360-degree video contains a full field of environmental content. However, browsing these videos, either on screens or through head-mounted displays (HMDs), users consume only a subset of the full field of view per a natural viewing experience. This causes a search problem when a region-of-interest (ROI) in a video is outside of the current field of view (FOV) on the screen, or users may search for non-existing ROIs. We propose Outside-In, a visualization technique which reintroduces off-screen regions-of-interest (ROIs) into the main screen as spatial picture-in-picture (PIP) previews. The geometry of the preview windows further encodes a ROI's relative location vis-a-vis the main screen view, allowing for effective navigation. In an 18-participant study, we compare Outside-In with traditional arrow-based guidance within three types of 360-degree video. Results show that Outside-In outperforms in regard to understanding spatial relationship, the storyline of the content and overall preference. Two applications are demonstrated for use with Outside-In in 360-degree video navigation with touchscreens, and live telepresence.

Original languageEnglish
Title of host publicationUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages255-265
Number of pages11
ISBN (Electronic)9781450349819
DOIs
StatePublished - 20 Oct 2017
Event30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada
Duration: 22 Oct 201725 Oct 2017

Publication series

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
CountryCanada
CityQuebec City
Period22/10/1725/10/17

Keywords

  • 360 video
  • Off-screen targets
  • Picture-in-picture
  • Telepresence

Fingerprint Dive into the research topics of 'Outside-in: Visualizing out-of-sight regions-of-interest in a 360 video using spatial picture-in-picture previews'. Together they form a unique fingerprint.

  • Cite this

    Lin, Y. T., Liao, Y. C., Teng, S. Y., Chung, Y. J., Chan, L., & Chen, B. Y. (2017). Outside-in: Visualizing out-of-sight regions-of-interest in a 360 video using spatial picture-in-picture previews. In UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (pp. 255-265). (UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology). Association for Computing Machinery, Inc. https://doi.org/10.1145/3126594.3126656