IEEE VIS 2024 Content: VisTellAR: Embedding Data Visualization to Short-form Videos Using Mobile Augmented Reality

VisTellAR: Embedding Data Visualization to Short-form Videos Using Mobile Augmented Reality

Wai Tong -

Kento Shigyo -

Lin-Ping Yuan -

Mingming Fan -

Ting-Chuen Pong -

Huamin Qu -

Meng Xia -

Download preprint PDF
DOI: 10.1109/TVCG.2024.3372104

Room: Bayshore V

2024-10-17T16:24:00ZGMT-0600Change your timezone on the schedule page
2024-10-17T16:24:00Z
Exemplar figure, described by caption below
This figure illustrates an authoring process. (a-b) VisTellAR detects planes and objects for users to anchor visualizations in reality. Users can edit the data, mark, axis, and behavior. (c-d) During video-taking, users can voice over, perform hand gestures, and see a countdown that notifies them when the visualization will be shown. (e-f) After taking the video, a timeline is shown to indicate when visualizations take place in the video. Users can reconfigure visualizations if needed.
Fast forward
Full Video
Keywords

Personal data, augmented reality, data visualization, storytelling, short-form video

Abstract

With the rise of short-form video platforms and the increasing availability of data, we see the potential for people to share short-form videos embedded with data in situ (e.g., daily steps when running) to increase the credibility and expressiveness of their stories. However, creating and sharing such videos in situ is challenging since it involves multiple steps and skills (e.g., data visualization creation and video editing), especially for amateurs. By conducting a formative study (N=10) using three design probes, we collected the motivations and design requirements. We then built VisTellAR, a mobile AR authoring tool, to help amateur video creators embed data visualizations in short-form videos in situ. A two-day user study shows that participants (N=12) successfully created various videos with data visualizations in situ and they confirmed the ease of use and learning. AR pre-stage authoring was useful to assist people in setting up data visualizations in reality with more designs in camera movements and interaction with gestures and physical objects to storytelling.