A field study comparing approaches to collecting annotated activity data in real-world settings

Yung-Ju Chang, Gaurav Paruthi, Mark W. Newman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

Collecting ground-Truth annotations for contextual data is vital to context-Aware system development. However, current research lacks a systematic analysis of different approaches to collecting such data. We present a field experiment comparing three approaches: Participatory, Context-Triggered In Situ, and Context-Triggered Post Hoc, which involved users in recording and annotating activity data in real-world settings. We compared the quantity and quality of collected data using each approach, as well as the participant experience. We found Context-Triggered approaches produced more recordings, whereas the Participatory approach produced a greater amount of data with higher completeness and precision. Moreover, while participants appreciated automated recording and reminders for convenience, they highly valued having control over what and when to record and annotate. We conclude that user burden and user control are key aspects to consider when collecting and annotating contextual data with participants, and suggest features for a future tool focused on these two aspects.

Original languageEnglish
Title of host publicationUbiComp 2015 - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing
PublisherAssociation for Computing Machinery, Inc
Pages671-682
Number of pages12
ISBN (Electronic)9781450335744
DOIs
StatePublished - 7 Sep 2015
Event3rd ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2015 - Osaka, Japan
Duration: 7 Sep 201511 Sep 2015

Publication series

NameUbiComp 2015 - Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Conference

Conference3rd ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2015
CountryJapan
CityOsaka
Period7/09/1511/09/15

Keywords

  • Activity data collection
  • Annotation
  • Field experiment
  • Ground truth
  • Label
  • Transportation
  • Wearable camera

Fingerprint Dive into the research topics of 'A field study comparing approaches to collecting annotated activity data in real-world settings'. Together they form a unique fingerprint.

Cite this