SmartSleeve: Realtime sensing of surface and deformation gestures on flexible, interactive textiles, using a hybrid gesture detection pipeline

Patrick Parzer, Adwait Sharma, Anita Vogl, Jürgen Steimle, Alex Olwal, Michael Haller

Research output: Chapter in Book/Report/Conference proceedingsConference contributionpeer-review

46 Citations (Scopus)

Abstract

Over the last decades, there have been numerous efforts in wearable computing research to enable interactive textiles. Most work focus, however, on integrating sensors for planar touch gestures, and thus do not fully take advantage of the flexible, deformable and tangible material properties of textile. In this work, we introduce SmartSleeve, a deformable textile sensor, which can sense both surface and deformation gestures in real-time. It expands the gesture vocabulary with a range of expressive interaction techniques, and we explore new opportunities using advanced deformation gestures, such as, Twirl, Twist, Fold, Push and Stretch. We describe our sensor design, hardware implementation and its novel non-rigid connector architecture. We provide a detailed description of our hybrid gesture detection pipeline that uses learning-based algorithms and heuristics to enable real-time gesture detection and tracking. Its modular architecture allows us to derive new gestures through the combination with continuous properties like pressure, location, and direction. Finally, we report on the promising results from our evaluations which demonstrate real-time classification.

Original languageEnglish
Title of host publicationUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
Pages565-577
Number of pages13
ISBN (Electronic)9781450349819
DOIs
Publication statusPublished - 20 Oct 2017
Event30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Canada
Duration: 22 Oct 201725 Oct 2017

Publication series

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
CountryCanada
CityQuebec City
Period22.10.201725.10.2017

Keywords

  • Deformation gestures
  • Smart textile
  • Surface gestures

Fingerprint Dive into the research topics of 'SmartSleeve: Realtime sensing of surface and deformation gestures on flexible, interactive textiles, using a hybrid gesture detection pipeline'. Together they form a unique fingerprint.

Cite this