ControlAR: Smartphone as a controller for an augmented reality application

Abstract

The growing popularity of augmented reality (AR) created a need for new input methods that will enhance user interaction in AR environments. This thesis assesses how augmented reality applications can make use of smartphones as controllers and how these devices compare to more common motion-based controllers in efficiency and ease of use. The research question that is pinpointed is the following: How efficient and userfriendly can smartphones function as controllers for augmented reality applications? To answer this question, the study first sets a theoretical foundation on transitional interfaces, investigating the role of various input devices in bridging the gap between digital
and physical experiences in AR. A basic software prototype was developed that included an application interfacing with the Magic Leap One headset as a viewer and an iOS based application which was the smartphone controller. The smartphone application featured a virtual trackpad for pointer manipulation and a text input interface, with data transmission handled via Bluetooth Low Energy (BLE). The evaluation employed both quantitative and qualitative methods for assessing the performance of the controllers. Quantitative metrics encompassed completion time, error rate, and movement time, whereas qualitative feedback was obtained through the System Usability Scale (SUS) and participant interviews. The findings showed that the smartphone-based controller demonstrated significant efficiency in text input tasks, benefiting on user familiarity with smartphone keyboards. However, it encountered challenges with pointer control, as ergonomic limitations resulted in lower user satisfaction compared to the motion-based Magic Leap One controller. The results indicate that although smartphones provide a versatile and recognizable input mechanism for specific AR tasks, their effectiveness as universal controllers is restricted by limitations in comfort and feedback. The potential results of this research indicate a need for improvements in smartphone input design, including the integration of haptic feedback and customizable pointer speed settings. This research provides empirical evidence to the domain of AR interaction design, presenting insights that could guide the development of future AR controllers.

Date of Award	2024
Original language	English (American)
Supervisor	Andreas Ernst Riegler (Supervisor)