Collaboratively Eliciting Gestures for Geospatial Data Exploration on an MSE with Tangibles and Styluses

Abstract

Large tabletop displays and multi-surface environments offer potential for enhancing visual data exploration and collaborative work with geospatial datasets. These systems typically rely on multi-touch interactions, which can pose challenges when the multi-touch sensors misrepresent transitory movements as control inputs, leading to interruptions. Active tangibles and styluses offer an alternative to multi-touch interactions in MSEs, and have shown the potential to facilitate sense-making around large datasets. However, further research is needed to better understand how these modalities can be effectively leveraged for interacting with geospatial data visualizations. To address this, a gesture elicitation study was conducted in which users suggested interactions for 16 geospatial data visualization tasks, presented as a realistic collaborative workflow co-designed with geography and migration researchers. The study produced a taxonomy of user-defined gestures using tangibles and styluses for engaging with geospatial data, along with a thematic analysis of users' experiences with visualization tasks and interaction techniques.