SmartSleeve: Realtime sensing of surface and deformation gestures on flexible, interactive textiles, using a hybrid gesture detection pipeline

Patrick Parzer, Adwait Sharma, Anita Vogl, Jürgen Steimle, Alex Olwal, Michael Haller

Publikation: Beitrag in Buch/Bericht/TagungsbandKonferenzbeitragBegutachtung

53 Zitate (Scopus)

Abstract

Over the last decades, there have been numerous efforts in wearable computing research to enable interactive textiles. Most work focus, however, on integrating sensors for planar touch gestures, and thus do not fully take advantage of the flexible, deformable and tangible material properties of textile. In this work, we introduce SmartSleeve, a deformable textile sensor, which can sense both surface and deformation gestures in real-time. It expands the gesture vocabulary with a range of expressive interaction techniques, and we explore new opportunities using advanced deformation gestures, such as, Twirl, Twist, Fold, Push and Stretch. We describe our sensor design, hardware implementation and its novel non-rigid connector architecture. We provide a detailed description of our hybrid gesture detection pipeline that uses learning-based algorithms and heuristics to enable real-time gesture detection and tracking. Its modular architecture allows us to derive new gestures through the combination with continuous properties like pressure, location, and direction. Finally, we report on the promising results from our evaluations which demonstrate real-time classification.

OriginalspracheEnglisch
TitelUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology
Herausgeber (Verlag)Association for Computing Machinery, Inc
Seiten565-577
Seitenumfang13
ISBN (elektronisch)9781450349819
DOIs
PublikationsstatusVeröffentlicht - 20 Okt 2017
Veranstaltung30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017 - Quebec City, Kanada
Dauer: 22 Okt 201725 Okt 2017

Publikationsreihe

NameUIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Konferenz

Konferenz30th Annual ACM Symposium on User Interface Software and Technology, UIST 2017
LandKanada
OrtQuebec City
Zeitraum22.10.201725.10.2017

Fingerprint Untersuchen Sie die Forschungsthemen von „SmartSleeve: Realtime sensing of surface and deformation gestures on flexible, interactive textiles, using a hybrid gesture detection pipeline“. Zusammen bilden sie einen einzigartigen Fingerprint.

Zitieren