Mobile learning system with context-aware interactions and point-of-interest understanding

Oscal Tzyh Chiang Chen, Sung Nien Yu, Ching-Chun Huang, Huang Chen Lee, Yu Ling Hsueh, Jerry Chih-Yuan Sun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To explore museums and art galleries, visitors usually follow the routes and regulations that may limit learning interest and efficiency. How to improve and assess the learning effectneeds to be well addressed. Accordingly, we have developed a mobile learning system which can effectively offer visitors with attention tracking, interest cultivation, and immersive engagement. This work adopts the commercially-available smart glass accompanied with an additional camera, a Photoplethysmography (PPG) sensor module, and a smart phone or tablet to fulfill the integrated computations from multiple sensors. Based on these devices, the proposed system includes (1) computation of visual focal points, (2) attention estimation via heart rate variability, (3) indoor positioning, (4) derivation of user preferences and behaviors, and (5) intimate interactions of mobile learning. The experimental results reveal that the proposed mobile learning system can effectively increase user's interest, personality, and learning effect via contextaware interactions and point-of-interest understanding.

Original languageEnglish
Title of host publication2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538641958
DOIs
StatePublished - 28 Nov 2018
Event2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018 - San Diego, United States
Duration: 23 Jul 201827 Jul 2018

Publication series

Name2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018

Conference

Conference2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018
CountryUnited States
CitySan Diego
Period23/07/1827/07/18

Keywords

  • attention estimation
  • learning effect
  • localization
  • mobile learning
  • smart glasses
  • user preference
  • visual focal point

Fingerprint Dive into the research topics of 'Mobile learning system with context-aware interactions and point-of-interest understanding'. Together they form a unique fingerprint.

  • Cite this

    Chen, O. T. C., Yu, S. N., Huang, C-C., Lee, H. C., Hsueh, Y. L., & Sun, J. C-Y. (2018). Mobile learning system with context-aware interactions and point-of-interest understanding. In 2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018 [8551571] (2018 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICMEW.2018.8551571