360° video viewing dataset in head-mounted virtual reality

Wen Chih Lo, Ching Ling Fan, Jean Lee, Chun-Ying Huang, Kuan Ta Chen, Cheng Hsin Hsu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

68 Scopus citations

Abstract

360° videos and Head-Mounted Displays (HMDs) are ge.ing increasingly popular. However, streaming 360° videos to HMDs is challenging. This is because only video content in viewers' Fieldof- Views (FoVs) is rendered, and thus sending complete 360° videos wastes resources, including network bandwidth, storage space, and processing power. Optimizing the 360° video streaming to HMDs is, however, highly data and viewer dependent, and thus dictates real datasets. However, to our best knowledge, such datasets are not available in the literature. In this paper,we present our datasets of both content data (such as image saliency maps and motion maps derived from 360° videos) and sensor data (such as viewer head positions and orientations derived from HMD sensors). We put extra e.orts to align the content and sensor data using the timestamps in the raw log files. The resulting datasets can be used by researchers, engineers, and hobbyists to either optimize existing 360° video streaming applications (like rate-distortion optimization) and novel applications (like crowd-driven camera movements). We believe that our dataset will stimulate more research activities along this exciting new research direction.

Original languageEnglish
Title of host publicationProceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017
PublisherAssociation for Computing Machinery, Inc
Pages211-216
Number of pages6
ISBN (Electronic)9781450334891
DOIs
StatePublished - 20 Jun 2017
Event8th ACM Multimedia Systems Conference, MMSys 2017 - Taipei, Taiwan
Duration: 20 Jun 201723 Jun 2017

Publication series

NameProceedings of the 8th ACM Multimedia Systems Conference, MMSys 2017

Conference

Conference8th ACM Multimedia Systems Conference, MMSys 2017
CountryTaiwan
CityTaipei
Period20/06/1723/06/17

Keywords

  • 360° dataset
  • 360° video
  • HMD
  • Head tracking dataset
  • Virtual reality

Fingerprint Dive into the research topics of '360° video viewing dataset in head-mounted virtual reality'. Together they form a unique fingerprint.

Cite this