By the same authors

Expressy: Using a Wrist-worn Inertial Measurement Unit to Add Expressiveness to Touch-based Interactions

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Full text download(s)


Published copy (DOI)


  • Gerard Wilkinson
  • Ahmed Kharrufa
  • Jonathan David Hook
  • Bradley Pursgrove
  • Gavin Wood
  • Hendrik Haeuser
  • Nils Hammerla
  • Steve Hodges
  • Patrick Olivier


Publication details

Title of host publicationCHI 2016 - Proceedings, 34th Annual CHI Conference on Human Factors in Computing Systems
DatePublished - 7 May 2016
Number of pages13
PublisherAssociation for Computing Machinery (ACM)
Original languageEnglish
ISBN (Electronic)9781450333627
ISBN (Print)978-1-4503-33627


Expressiveness, which we define as the extent to which rich and complex intent can be conveyed through action, is a vital aspect of many human interactions. For instance, paint on canvas is said to be an expressive medium, because it affords the artist the ability to convey multifaceted emotional intent through intricate manipulations of a brush. To date, touch devices have failed to offer users a level of expressiveness in their interactions that rivals that experienced by the painter and those completing other skilled physical tasks. We investigate how data about hand movement – provided by a motion sensor, similar to those found in many smart watches or fitness trackers – can be used to expand the expressiveness of touch interactions. We begin by introducing a conceptual model that formalizes a design space of possible expressive touch interactions. We then describe and evaluate Expressy, an approach that uses a wrist-worn inertial measurement unit to detect and classify qualities of touch interaction that extend beyond those offered by today’s typical sensing hardware. We conclude by describing a number of sample applications, which demonstrate the enhanced, expressive interaction capabilities made possible by Expressy.

Bibliographical note

© 2016, The Authors. This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. Further copying may not be permitted; contact the publisher for details.

    Research areas

  • Expressive interaction, Expressiveness, Inertial measurement unit, Intentionality, Smart watch, Touch interaction


Discover related content

Find related publications, people, projects, datasets and more using interactive charts.

View graph of relations