A two-dimensional editing system based on hand gestures and real object manipulation using RGB-D sensor

Hsin Kai Chen, Sai-Keung Wong*, Po Han Huang, Yu An Chang

*Corresponding author for this work

研究成果: Conference contribution同行評審

1 引文 斯高帕斯(Scopus)

摘要

This paper presents a two-dimensional editing system which compromises the advantages of using hand gestures and real blocks to manipulate virtual objects. The system uses a RGB-D sensor to capture the color and depth images of the hands and real blocks. The raw images of the hands and blocks are segmented. Then we employ a contour based algorithm to perform hand gesture and shape recognition. The contours are extracted and reduced for eliminating the redundant points. After that a set of feature points are collected and they can be used for recognizing the hand gesture and the shapes of the real blocks. The users have two ways to interact with the virtual objects: 1) manipulating the real blocks to control them; and 2) using hand gestures as editing operations to edit them. Experimental results indicate that our system achieves high recognition rate. Our system supports the basic editing operations to the virtual objects, such as 'move', 'scale', 'rotate', and 'copy'. We also conducted a user study which reveals that our system is intuitive and entertaining.

原文English
主出版物標題Proceedings - VRCAI 2016
主出版物子標題15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry
編輯Stephen N. Spencer
發行者Association for Computing Machinery, Inc
頁面119-128
頁數10
ISBN(電子)9781450346924
DOIs
出版狀態Published - 3 十二月 2016
事件15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016 - Zhuhai, China
持續時間: 3 十二月 20164 十二月 2016

出版系列

名字Proceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry
1

Conference

Conference15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016
國家China
城市Zhuhai
期間3/12/164/12/16

指紋 深入研究「A two-dimensional editing system based on hand gestures and real object manipulation using RGB-D sensor」主題。共同形成了獨特的指紋。

引用此