arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2611.01198

Projecting the Public: Reflections and Recommendations for Empirical Visualization Studies of General Audiences

Mandi Cai·Jack McNiel·Erik C. Nisbet·Matthew Kay
View original source ↗Read source document ↗Export metadata ↓

Abstract

Calls for shifting visualization research to general audiences outside of professional contexts have been put forward since the early 2000s, but expanding outwards means contending with a diversity in visualization's communicative purpose beyond transmitting insights from data. After our own experiences studying public-facing visualizations, we sought a set of considerations to help early-career visualization researchers reason through designing empirical visualization studies for the general public that confronts the various ways visualizations are interpreted. We examined literature on guiding paradigms of research, reviewed 73 visualization papers that specify a focus on audiences broader than domain experts, and conducted 15 semi-structured interviews with authors of such papers, to derive the following: (1) a conceptualization of any experiment as 3 elements-casting audience, constructing experimental setting, and projecting audience impressions and interactions into measurable constructs (2) an account of interviewees' aspirations for each element of study design, versus the real challenges that occurred. We detail their approaches to navigate the gaps between aspirations and reality when working with general audiences and summarize them as actionable recommendations. The conceptual framework is intended to help junior researchers scope and outline experimental designs of visualizations "for the masses", while the recommendations provide concrete guidance for putting those designs into practice. The 73 papers are filterable and visualized on our study website, and our code to sample the papers is on GitHub.

Explore related subjects

cs.HC

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mandi Cai, Jack McNiel, Erik C. Nisbet, Matthew Kay. 2026-10-31. Projecting the Public: Reflections and Recommendations for Empirical Visualization Studies of General Audiences. https://arxiv.org/abs/2611.01198

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Stayin' Aligned Over Time: Towards Longitudinal Human-LLM Alignment via Contextual Reflection and Privacy-Preserving Behavioral Data

Current human-AI alignment and evaluation methods for large language models (LLMs) often rely on preference signals collected immediately after an interaction. This practice implicitly treats preference as static, even though many LLM-mediated decisions unfold over time and may be re-evaluated differently after real-world consequences and observed outcomes. Therefore, we argue for a methodological shift from single-moment preference elicitation to longitudinal, context-situated alignment measurement. We present a methodological framework for collecting temporally grounded alignment signals by combining (1) in-situ preference capture, (2) context-triggered follow-up preference reflection, and (3) privacy-preserving behavioral traces that help interpret preference change. As an instantiation of this methodology, we introduce BITE, a browser-based system that detects consequential LLM interactions, prompts reflection across later decision points, and supports progressive, user-controlled consent for sharing behavioral data. Through a two week longitudinal deployment study with 8 participants, our approach surfaced differences between immediate and later user preferences in accuracy, relevance and other dimensions of the LLM output. Our findings highlight the limitations of single-moment preference datasets and underscore the importance of longitudinal methods for alignment evaluation in everyday use.

cs.HC↗
arXiv2026

Personalized to Persuade: The Effects of Contextualization and Warmth on Trust and Reliance in Conversational AI

Contextualization is a form of personalization in which the message is framed in a context meaningful to the recipient, using their interests and background. Personalization is a known persuasive strategy of artificial intelligence (AI) systems in politics and marketing. However, the persuasive effect of contextualization in everyday tasks, where users often lack prior knowledge, remains unclear. We ran a $2\times2$ between-subjects experiment ($N = 407$) in a fictional scenario where participants had no prior opinions or knowledge. We examined how contextualization, combined with conversational warmth, shapes the persuasive power of an AI assistant arguing against expert recommendations and users' reliance on it. Our findings show that the neutral, non-contextualized assistant was the most persuasive. Contextualization and warmth each reduced persuasiveness on their own, but their interaction increased it. Reliance was present in all conditions, and neither cue changed it detectably. Trust predicted persuasion and reliance, yet neither contextualization nor warmth had an indirect effect through trust. Participants with higher self-reported AI literacy relied more on the assistant without trusting it more. Our study extends AI personalization research from political opinions to everyday decisions made without prior knowledge. The results suggest that users are more likely to be persuaded by, and defer to, an AI assistant than an expert, even without personalization. AI persuasion experiments should therefore include untailored assistants and measure decisions; the cues that changed persuasion did not detectably change reliance.

cs.HC↗
arXiv2026

An Open Book, On Whose Terms? Power Dynamics in Sensor-Derived, LLM-Generated Summaries Sharing Between Older Adults and Remote Families

As older adults (OAs) increasingly favor aging in place, remote family members (RFMs) need meaningful awareness of their loved ones without intrusive monitoring. Large language models can provide rich interpretations of non-intrusive sensing data, yet recent work has largely emphasized technical accuracy over how families use or benefit from this information. We conducted formative interviews with 12 RFMs and 2 OAs, followed by a three-month deployment case study with one OA-RFM dyad. Our system provided daily AI-generated summaries of multimodal sensing data, which we iteratively refined with both parties using a research-through-design approach. Although the summaries integrated well into the dyad's daily routine, sustaining over 90% engagement, their lived experience revealed evolving tensions around agency, reassurance, privacy, trust, and communication, shaped by sensor limitations and existing communication misalignments. Our findings inform the design of future AI-mediated sharing systems that account for real-world sensing constraints and complex family care dynamics.

cs.HC↗