Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction

Edward Jangwon Lee, Sangeon Yong, Soonbeom Choi, Liwei Chan, Roshan Peiris, Juhan Nam*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The musical possibilities of force sensors on touchscreen devices are explored, using Apple’s 3D Touch. Three functions are selected to be controlled by force: (a) excitation, (b) modification (aftertouch), and (c) mode change. Excitation starts a note, modification alters a playing note, and mode change controls binary on/off sound parameters. Four instruments are designed using different combinations of force-sound mapping strategies. ForceKlick is a single button instrument that plays consecutive notes within one touch by altering touch force, by detecting force down-peaks. The iPhone 6s/7 Ocarina features force-sensitive fingerholes that heightens octaves upon high force. Force Trombone continuously controls gain by force. Force Synth is a trigger pad array featuring all functions in one button: start note by touch, control vibrato with force, and toggle octaves upon abrupt burst of force. A simple user test suggests that adding force features to well-known instruments are more friendly and usable.

Original languageEnglish
Title of host publicationMusic Technology with Swing - 13th International Symposium, CMMR 2017, Revised Selected Papers
EditorsMatthew E.P. Davies, Mitsuko Aramaki, Richard Kronland-Martinet, Sølvi Ystad
PublisherSpringer Verlag
Pages574-585
Number of pages12
ISBN (Print)9783030016913
DOIs
StatePublished - 1 Jan 2018
Event13th international Symposium on Computer Music Multidisciplinary Research, CMMR 2017 - Matosinhos, Portugal
Duration: 25 Sep 201728 Sep 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11265 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference13th international Symposium on Computer Music Multidisciplinary Research, CMMR 2017
CountryPortugal
CityMatosinhos
Period25/09/1728/09/17

Keywords

  • 3D touch
  • Force touch
  • Mobile music
  • Relative force
  • Touch gestures

Fingerprint Dive into the research topics of 'Use the Force: Incorporating Touch Force Sensors into Mobile Music Interaction'. Together they form a unique fingerprint.

Cite this