GestureDrawer: One-handed interaction technique for spatial user-defined imaginary interfaces

Teo Babic, Harald Reiterer, Michael Haller

Research output: Chapter in Book/Report/Conference proceedingsConference contributionpeer-review

5 Citations (Scopus)

Abstract

Existing empty-handed mid-air interaction techniques for system control are typically limited to a confined gesture set or point-and-select on graphical user interfaces. In this paper, we introduce GestureDrawer, a one-handed interaction with a 3D imaginary interface. Our approach allows users to self-define an imaginary interface, acquire visuospatial memory of the position of its controls in empty space and enables them to select or manipulate those controls by moving their hand in all three dimensions. We evaluate our approach with three user studies and demonstrate that users can indeed position imaginary controls in 3D empty space and select them with an accuracy of 93% without receiving any feedback and without fixed landmarks (e.g. second hand). Further, we show that imaginary interaction is generally faster than mid-air interaction with graphical user interfaces, and that users can retrieve the position of their imaginary controls even after a proprioception disturbance. We condense our findings into several design recommendations and present automotive applications.

Original languageEnglish
Title of host publicationSUI 2017 - Proceedings of the 2017 Symposium on Spatial User Interaction
PublisherAssociation for Computing Machinery, Inc
Pages128-137
Number of pages10
ISBN (Electronic)9781450354868
DOIs
Publication statusPublished - 16 Oct 2017
Event5th ACM Symposium on Spatial User Interaction, SUI 2017 - Brighton, United Kingdom
Duration: 16 Oct 201717 Oct 2017

Publication series

NameSUI 2017 - Proceedings of the 2017 Symposium on Spatial User Interaction

Conference

Conference5th ACM Symposium on Spatial User Interaction, SUI 2017
CountryUnited Kingdom
CityBrighton
Period16.10.201717.10.2017

Keywords

  • Imaginary interfaces
  • Interaction technique: gestures
  • Screen-less
  • Spatial user interfaces
  • Ubiquitous computing

Fingerprint Dive into the research topics of 'GestureDrawer: One-handed interaction technique for spatial user-defined imaginary interfaces'. Together they form a unique fingerprint.

Cite this