A Comprehensive Multisensor Dataset Employing RGBD Camera, Inertial Sensor and Web Camera

Sabrina I. Soraya, Shao Ping Chuang, Yu-Chee Tseng, Tsi-Ui Ik, Yu-Tai Ching

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Over the decades, fitness activities and extreme endurance events are expanding throughout the world. The number of available public skeletal repositories and recognition/evaluation benchmarks has grown rapidly since Microsoft manufactured a motion sensing device called Kinect. Kinect RGBD data has become a very useful representation of an indoor scene for solving activity/fitness recognition problems. The other alternative sensor which has been utilized widely in this area is the wearable inertial measurement unit (IMU) sensor. With numerous advance sensors with mass adoption, this technology represents a possible approach to surpass current activity recognition and evaluation research solutions. Nevertheless, there is a limited number of publicly available datasets where depth camera, inertial sensor, and RGB image data are captured at the same time. In this paper, we introduce NCTU-MFD (National Chiao Tung University Multisensor Fitness Dataset), a comprehensive, diverse multisensor dataset collected using Kinect RGBD sensor, wearable inertial sensors, and web cameras. The dataset contains 47131 RGB images, 47131 depth images, and 100 csv files including 47131 skeletal data (from 25 joints) collected from Kinect sensor. In addition, our dataset also contains acceleration and gyroscope data from IMU sensors, and 94262 RGB images (47131 images from each web camera). To demonstrate the possible use of our dataset, we conduct an experiment on evaluation of depth maps.

Original languageEnglish
Title of host publication2019 20th Asia-Pacific Network Operations and Management Symposium
Subtitle of host publicationManagement in a Cyber-Physical World, APNOMS 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9784885523205
DOIs
StatePublished - Sep 2019
Event20th Asia-Pacific Network Operations and Management Symposium, APNOMS 2019 - Matsue, Japan
Duration: 18 Sep 201920 Sep 2019

Publication series

Name2019 20th Asia-Pacific Network Operations and Management Symposium: Management in a Cyber-Physical World, APNOMS 2019

Conference

Conference20th Asia-Pacific Network Operations and Management Symposium, APNOMS 2019
CountryJapan
CityMatsue
Period18/09/1920/09/19

Keywords

  • dataset
  • fitness
  • Kinect
  • Wearable sensors
  • web camera

Fingerprint Dive into the research topics of 'A Comprehensive Multisensor Dataset Employing RGBD Camera, Inertial Sensor and Web Camera'. Together they form a unique fingerprint.

Cite this