Interaction Techniques for User Interface Layouts in Virtually Extended Screen-Aligned Displays

Abstract

Immersive systems have the potential to make everyday tasks more efficient compared to traditional desktop environments. The immersive VESAD environment offers a virtual extension for physical displays. Previous work has shown that working on larger displays reduces task completion time for cognitively difficult tasks, supports sense-making, enhances spatial memory and raises user statisfaction levels. Immersive systems also offer innovative ways of visualising three-dimensional data and new ways of interacting with user interfaces. In order to better understand how users prefer to interact with immersive systems, this thesis proposes a concept for an immersive system that can be used for a variety of tasks usually done on a desktop environment. This concept includes four interaction techniques that can be used to create user interface layouts. These were selected from established operating systems or previous work. The concept has then been implemented as a prototype for evaluation. The concept was evaluated using an explorative approach. Two user studies were conducted. The first user study (N=8) was designed to collect qualitative feedback on current UI layout preferences in traditional desktop systems, key characteristics of layout techniques and the suitability of the layout techniques selected for the proposed concept. The second user study (N=36) was designed to collect quantitative data which is used to evaluate the findings of the qualitative user study. The user study revealed multiple themes on the question of the current UI management on desktop devices. Users appear to organise their windows around one central task. Another theme showed that display space is a limited good and that there can never be enough of it. Display space also appears to be dynamic, changing not only from user to user but also from location to location. Two major themes could be identified when investigating the key characteristics for layout techniques. The first one involves longer lasting complex tasks that have the user invest time in creating a specific layout before the task begins. This layout then helps the user complete a complex task more efficiently. The other theme includes scenarios in which a short task emerges or an interruptive window pops up. In these cases, the users want to just finish the task quickly or move the window out of sight. Along these defined tasks, the users also shared their opinions on the suitability of the selected layout techniques. While Drag & Drop and Shift Snapping appear to be suited for quickly solved interrupting tasks, the Grid Selection and Layout Suggestion techniques seem to be more suited to create a complex layout for layout-heavy and longer lasting tasks.

Date of Award	2025
Original language	English
Supervisor	Christoph Anthes (Supervisor)