IEEE VIS 2024 Content: Revealing Interaction Dynamics: Multi-Level Visual Exploration of User Strategies with an Interactive Digital Environment

Revealing Interaction Dynamics: Multi-Level Visual Exploration of User Strategies with an Interactive Digital Environment

Peilin Yu - Linköping University, Norrköping, Sweden

Aida Nordman - Linköping University, Norrköping, Sweden

Marta M. Koc-Januchta - Linköping University, Norrköping, Sweden

Konrad J Schönborn - Linköping University, Norrköping, Sweden. Linköping University, Norrköping, Sweden

Lonni Besançon - Linköping University, Norrköping, Sweden

Katerina Vrotsou - Linköping University, Norrköping, Sweden

Screen-reader Accessible PDF
Download preprint PDF
Download camera-ready PDF
Download Supplemental Material

Room: Bayshore VI

2024-10-16T14:15:00Z GMT-0600 Change your timezone on the schedule page
2024-10-16T14:15:00Z
Exemplar figure, described by caption below
The main components of VISID comprise an Individual View (upper) and a Comparison View (lower). The Individual View can be alternated to visualize: (a) a participant's attribute change and interaction event sequences, or (b) their interface event sequences representing the concurrently opened infopanels and their lifetime duration. The Comparison View consists of three parts. From left to right, it visualizes interaction sequences ranked by the similarity score to a baseline participant in descending order. The similarity score bars and delta values (middle) depict the similarity/dissimilarity with respect to the baseline participant. The Cluster View (right) shows potential clusters of similar participants.
Fast forward
Keywords

Visual analytics, Visualization systems and tools, Interaction logs, Visualization techniques, Visual learning

Abstract

We present a visual analytics approach for multi-level visual exploration of users' interaction strategies in an interactive digital environment. The use of interactive touchscreen exhibits in informal learning environments, such as museums and science centers, often incorporate frameworks that classify learning processes, such as Bloom’s taxonomy, to achieve better user engagement and knowledge transfer. To analyze user behavior within these digital environments, interaction logs are recorded to capture diverse exploration strategies. However, analysis of such logs is challenging, especially in terms of coupling interactions and cognitive learning processes, and existing work within learning and educational contexts remains limited. To address these gaps, we develop a visual analytics approach for analyzing interaction logs that supports exploration at the individual user level and multi-user comparison. The approach utilizes algorithmic methods to identify similarities in users' interactions and reveal their exploration strategies. We motivate and illustrate our approach through an application scenario, using event sequences derived from interaction log data in an experimental study conducted with science center visitors from diverse backgrounds and demographics. The study involves 14 users completing tasks of increasing complexity, designed to stimulate different levels of cognitive learning processes. We implement our approach in an interactive visual analytics prototype system, named VISID, and together with domain experts, discover a set of task-solving exploration strategies, such as "cascading" and "nested-loop", which reflect different levels of learning processes from Bloom's taxonomy. Finally, we discuss the generalizability and scalability of the presented system and the need for further research with data acquired in the wild.