Using nonverbal information for conversation partners inference by wearable devices

Deeporn Mungtavesinsuk, Yan Ann Chen*, Cheng Wei Wu, Ensa Bajo, Hsin Wei Kao, Yu-Chee Tseng

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

In this paper, we propose a framework called conversational partner inference using nonverbal information (abbreviated as CFN). We use the wrist-based wearable device that has an accelerometer sensor to detect the user’s hand movement. Besides, we propose three different methods, named leading CFN, trainling CFN and leading-trailing CFN, to integrate the detected movement behaviors with the sound data sensed by microphones to effectively infer conservational partners. In experiments, we collect real data to evaluate the proposed framework. The experimental results show that the accuracy of leading CFN is better than trailing CFN and leading-trailing CFN. Moreover, our approach shows higher accuracy than the state-of-the-art approach for conversational partner inference.

Original languageEnglish
Title of host publicationIoT as a Service - Third International Conference, IoTaaS 2017, Proceedings
EditorsYi-Bing Lin, Ilsun You, Der-Jiunn Deng, Chun-Cheng Lin
PublisherSpringer Verlag
Pages187-193
Number of pages7
ISBN (Print)9783030004095
DOIs
StatePublished - 1 Jan 2018
Event3rd International Conference on IoT as a Service, IoTaaS 2017 - Taichun, Taiwan
Duration: 20 Sep 201722 Sep 2017

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Volume246
ISSN (Print)1867-8211

Conference

Conference3rd International Conference on IoT as a Service, IoTaaS 2017
CountryTaiwan
CityTaichun
Period20/09/1722/09/17

Keywords

  • Conversational partner inference
  • Nonverbal information
  • Social interaction analysis
  • Wearable devices

Fingerprint Dive into the research topics of 'Using nonverbal information for conversation partners inference by wearable devices'. Together they form a unique fingerprint.

  • Cite this

    Mungtavesinsuk, D., Chen, Y. A., Wu, C. W., Bajo, E., Kao, H. W., & Tseng, Y-C. (2018). Using nonverbal information for conversation partners inference by wearable devices. In Y-B. Lin, I. You, D-J. Deng, & C-C. Lin (Eds.), IoT as a Service - Third International Conference, IoTaaS 2017, Proceedings (pp. 187-193). (Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST; Vol. 246). Springer Verlag. https://doi.org/10.1007/978-3-030-00410-1_22