Real-time fingerspelling recognition system design based on RGB-D image information

Kuan Yu Chou, Hui Chi Chuang, Meng Tzu Chiu, Yon-Ping Chen

研究成果: Conference contribution同行評審

3 引文 斯高帕斯(Scopus)

摘要

This paper provides a fingerspelling recognition system with high accuracy rate based on RGB-D image. The system are separated into three parts, including hand region detection, hand feature extraction, and fingerspelling recognition. For the hand regions detection, the regions of hand and face are first obtained by skin color detection and connect component labeling (CCL), and then the hand, the region-of-interest (ROI), is determined by the feature point extraction based on distance transform. Followed is the hand feature extraction which consists of the hand structure and the hand texture. From the feature points of ROI, the locations of palm and fingertips, palm direction, and finger vectors are formed as the hand structure. In addition to the hand structure, this paper adopts the LBP operator to generate the hand texture to deal with the fingerspelling not recognizable by the hand structure. Finally, the extracted hand features are sent into the fingerspelling recognition system, which is built with several different neural network classifiers. The experimental results show that this system is an effective real-time recognition system whose accuracy is higher than 80% for most of the fingerspelling in American Sign Language (ASL).

原文English
主出版物標題CACS 2014 - 2014 International Automatic Control Conference, Conference Digest
發行者Institute of Electrical and Electronics Engineers Inc.
頁面75-80
頁數6
ISBN(電子)9781479945849
DOIs
出版狀態Published - 28 四月 2014
事件2014 International Automatic Control Conference, CACS 2014 - Kaohsiung, Taiwan
持續時間: 26 十一月 201428 十一月 2014

出版系列

名字CACS 2014 - 2014 International Automatic Control Conference, Conference Digest

Conference

Conference2014 International Automatic Control Conference, CACS 2014
國家Taiwan
城市Kaohsiung
期間26/11/1428/11/14

指紋 深入研究「Real-time fingerspelling recognition system design based on RGB-D image information」主題。共同形成了獨特的指紋。

引用此