Eye on You: Fusing Gesture Data from Depth Camera and Inertial Sensors for Person Identification

Wei Chun Chang, Cheng Wei Wu, Richard Yi Chia Tsai, Ching-Ju Lin, Yu-Chee Tseng

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Person identification (PID) is a key issue in many IoT applications. It has long been studied and achieved by technologies such as RFID and face/fingerprint/iris recognition. These approaches, however, have their limitations due to environmental constraints (such as lighting and obstacles) or require close contact to specific devices. Therefore, their recognition rates highly depend on use scenarios. To enable reliable and remote PID, in this work, we present EOY (Eye On You)1, a data fusion approach that combines two kinds of sensors, a 3D depth camera and wearable sensors embedded with inertial measurement unit (IMU). Since these two kinds of data share common features, we are able to fuse them to conduct PID. Further, the result can be transferred to a mobile platform (such as robot) since we have less constraints on devices. To realize EOY, we develop fusion algorithms to address practical challenges, such as asynchronous timing and coordinate calibration. The experimental evaluation shows that EOY can achieve the recognition rate of 95% and is very robust even in crowded areas.

Original languageEnglish
Title of host publication2018 IEEE International Conference on Robotics and Automation, ICRA 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2021-2026
Number of pages6
ISBN (Electronic)9781538630815
DOIs
StatePublished - 10 Sep 2018
Event2018 IEEE International Conference on Robotics and Automation, ICRA 2018 - Brisbane, Australia
Duration: 21 May 201825 May 2018

Publication series

NameProceedings - IEEE International Conference on Robotics and Automation
ISSN (Print)1050-4729

Conference

Conference2018 IEEE International Conference on Robotics and Automation, ICRA 2018
CountryAustralia
CityBrisbane
Period21/05/1825/05/18

Fingerprint Dive into the research topics of 'Eye on You: Fusing Gesture Data from Depth Camera and Inertial Sensors for Person Identification'. Together they form a unique fingerprint.

  • Cite this

    Chang, W. C., Wu, C. W., Tsai, R. Y. C., Lin, C-J., & Tseng, Y-C. (2018). Eye on You: Fusing Gesture Data from Depth Camera and Inertial Sensors for Person Identification. In 2018 IEEE International Conference on Robotics and Automation, ICRA 2018 (pp. 2021-2026). [8462924] (Proceedings - IEEE International Conference on Robotics and Automation). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICRA.2018.8462924