Smart beholder: An open-source smart lens for mobile photography

Chun-Ying Huang, Chih Fan Hsu, Tsung Han Tsai, Ching Ling Fan, Cheng Hsin Hsu, Kuan Ta Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

Smart lenses are detachable lenses connected to mobile devices via wireless networks, which are not constrained by the small form factor of mobile devices, and have potential to deliver better photo (video) quality. However, the viewfinder previews of smart lenses on mobile devices are difficult to optimize, due to the strict resource constraints on smart lenses and fluctuating wireless network conditions. In this paper, we design, implement, and evaluate an opensource smart lens, called Smart Beholder. It achieves three design goals: (i) cost effectiveness, (ii) low interaction latency, and (iii) high preview quality by: (i) selecting an embedded system board that is just powerful enough, (ii) minimizing per-component latency, and (iii) dynamically adapting the video coding parameters to maximizing Quality of Experience (QoE), respectively. Several optimization techniques, such as anti-drifting mechanism for video frames and QoE-driven resolution/frame rate adaptation algorithm, are proposed in this paper. Our measurement study shows that Smart Beholder outperforms Altek Cubic and Sony QX100 in terms of lower bitrate, lower latency, slightly higher frame rate, and better preview quality. We also demonstrate that Smart Beholder adapts to network dynamics. Smart Beholder has been made public at http://www.smartbeholder.org as an experimental platform for researchers and developers to optimize smart lenses and other embedded real-Time video streaming systems.

Original languageEnglish
Title of host publicationMM 2015 - Proceedings of the 2015 ACM Multimedia Conference
PublisherAssociation for Computing Machinery, Inc
Pages351-360
Number of pages10
ISBN (Electronic)9781450334594
DOIs
StatePublished - 13 Oct 2015
Event23rd ACM International Conference on Multimedia, MM 2015 - Brisbane, Australia
Duration: 26 Oct 201530 Oct 2015

Publication series

NameMM 2015 - Proceedings of the 2015 ACM Multimedia Conference

Conference

Conference23rd ACM International Conference on Multimedia, MM 2015
CountryAustralia
CityBrisbane
Period26/10/1530/10/15

Keywords

  • Cameras
  • Measurements
  • Mobile devices
  • Optimization
  • QoE
  • Smartphones
  • Streaming
  • Wireless networks

Fingerprint Dive into the research topics of 'Smart beholder: An open-source smart lens for mobile photography'. Together they form a unique fingerprint.

Cite this