Data-fusion design for a robotic human body pose recognition system

Yu Hung Lai*, Kai-Tai Song

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Real-time body pose information is very useful for many human-robot interaction applications. However, due to the motion of both human and the robot, robust body pose recognition poses a challenge in such a system design. This paper aims to locate a human body initially in the acquired image plane and then classify six body poses through image recognition. Color-space techniques and the method of connected component are used to detect ellipse shape and the shape patterns are used to locate human body in the video stream. Furthermore, a neutral network has been designed to fuse data from image recognition and inertial sensors to improve the recognition rate under various environmental variations. Experimental results show that the average recognition rate of six body poses is 93.5%, an improvement from 79.23% and 90.67% of using only image recognition and inertial sensor respectively.

Original languageEnglish
Title of host publication2010 8th IEEE International Conference on Control and Automation, ICCA 2010
Pages892-897
Number of pages6
DOIs
StatePublished - 19 Oct 2010
Event2010 8th IEEE International Conference on Control and Automation, ICCA 2010 - Xiamen, China
Duration: 9 Jun 201011 Jun 2010

Publication series

Name2010 8th IEEE International Conference on Control and Automation, ICCA 2010

Conference

Conference2010 8th IEEE International Conference on Control and Automation, ICCA 2010
CountryChina
CityXiamen
Period9/06/1011/06/10

Keywords

  • Body pose recognition
  • Image recognition
  • Neural network
  • Sensor data fusion

Fingerprint Dive into the research topics of 'Data-fusion design for a robotic human body pose recognition system'. Together they form a unique fingerprint.

Cite this