Face recognition and tracking for human-robot interaction

Kai-Tai Song*, Wen Jun Chen

*Corresponding author for this work

Research output: Contribution to journalConference articlepeer-review

23 Scopus citations


This paper presents a design and experimental study of human-robot interaction via face recognition and image tracking. A new architecture is proposed for fast face recognition of family members. In the proposed system, each family member has his/her own RBF neural networks. Each neural network is only responsible for recognizing its trained member. Consequently, the database is small and the processing time required for face recognition is minimized. A recognition rate of 94% has been achieved, an improvement relative to conventional approaches. In order to detect and track a person, we also developed an algorithm for detecting multiple faces in a scene based on division of skin and hair color regions. The face recognition and image tracking system has been integrated to an experimental mobile robot. Practical experiments reveal that the robot demonstrates real-time face recognition and tracking performance.

Original languageEnglish
Pages (from-to)2877-2882
Number of pages6
JournalConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
StatePublished - 1 Dec 2004
Event2004 IEEE International Conference on Systems, Man and Cybernetics, SMC 2004 - The Hague, Netherlands
Duration: 10 Oct 200413 Oct 2004


  • Face recognition
  • Home robots
  • RBF neural networks
  • Visual tracking

Fingerprint Dive into the research topics of 'Face recognition and tracking for human-robot interaction'. Together they form a unique fingerprint.

Cite this