Handhold object detection and event analysis using visual interaction clues

Jun-Wei Hsieh*, Chia Lung Lin, Jiun Chen Cheng, Pin Wu, Duan Yu Chen

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

This paper addresses the multiplicity problem of video events by dividing an event context to its intra-path context and inter-path context. Then, the novel event analysis method is applied for analyzing various interaction events (e.g. smoking, eating, and phoning) happening between hands and faces. This problem is very challenging since there is no prior knowledge (like shape, color, size, and texture) about the hand-hold objects. To address this problem, a novel ratio histogram is first proposed for finding important color bins for locating desired objects through a re-projection technique. Then, a code book method is then used for object tracking and feature extraction. Then, each action is defined as a temporally ordered set of repetitive symbols. In real cases, an event will have various representations under different lighting and weather conditions. To reflect the multiplicity of an event, we divide an event to two parts, i.e., the intra-path context and inter-path context. The first one models the dynamic properties of an event within a path and the second one is to measure the multiplicity of an event between paths. The intra-path context uses Markov chains to capture the repetitions of action primitives. The multiplicity of an event is modeled into the inter-path context using a weighted edit distance. A Bayesian inference scheme is then used to find the best set of event parameters directly from videos and classify events to different clusters. Experimental results show this scheme is effective to detect and analyze different daily events (e.g. smoking, eating, and phoning) even though variant colors and sizes on objects and dressing appearances are handled.

Original languageEnglish
Title of host publicationProceedings
Subtitle of host publicationDMS 2011 - 17th International Conference on Distributed Multimedia Systems
PublisherKnowledge Systems Institute Graduate School
Pages48-53
Number of pages6
ISBN (Electronic)1891706306
StatePublished - 1 Jan 2011
Event17th International Conference on Distributed Multimedia Systems, DMS 2011 - Florence, Italy
Duration: 18 Aug 201120 Aug 2011

Publication series

NameProceedings: DMS 2011 - 17th International Conference on Distributed Multimedia Systems

Conference

Conference17th International Conference on Distributed Multimedia Systems, DMS 2011
CountryItaly
CityFlorence
Period18/08/1120/08/11

Fingerprint Dive into the research topics of 'Handhold object detection and event analysis using visual interaction clues'. Together they form a unique fingerprint.

Cite this