arXiv subjects

Niharika Mathur

Publications and source records attributed to Niharika Mathur.

8 recordsLinked to original sources

arXiv2026

Measuring "Success" In the Transition from Pre- to Post-LLM Conversational Agents through the Lens of Interaction & Explanations for Older Adults

Conversational agents (CAs) for older adults have moved through at least two distinct eras, split by the emergence of large language models (LLMs) at the end of 2022. The first era was defined by commercial smart speakers such as the original Google Home and Amazon Alexa, built on rigid, rule-based dialogue. Interactions were single-turn, user-initiated and "successful" if and only if a command matched one of a finite set of pre-templated intents. The current era is marked by LLM-powered systems capable of open-ended, multi-turn conversation, with capacity for personalization and foundations for more proactive interaction. This shift has not only transformed what CAs can do for users, but also changed what researchers can measure when it comes to understanding "success" of user interactions with CAs. In this case study, we reflect on over 8 years of research spanning more than 100 participants across multiple field sites to trace how our own working definitions of "success" have evolved. We reflect on two completed bodies of work with pre-LLM CAs and an in-progress study with a post-LLM CA. We discuss how our definition and measurement of success have evolved during this transition and also ask open questions to the community about how to optimally measure "success" in the post-LLM CA era. This research is deeply applied and subject to the messiness of real-world deployments. Our intended contributions are deliberately practical, a combination of methodological considerations and reflection questions to support researchers engaging with this new wave of technologies.

cs.HC↗

arXiv2026

Tell Me Why, When, and How: Effects of Personality, Evidence, and Context on Older Adults' Perceptions of Conversational AI Explanations

Large Language Model-based voice assistants (LLM-VAs) have shown potential to support older adults aging in place through proactive reminders, health information, and everyday assistance. As LLM-VAs become more conversational, designing explanations of their behavior requires understanding what information they communicate and how they deliver it. While prior work has studied older adults' explainability requirements, relatively little is known about their perceptions of explanations when an LLM-VA's conversational personality varies. To address this gap, we conducted a mixed-design study with 140 older adults, examining two dimensions of explanation design: evidential grounding (source of information) and the VA's conversational personality (agreeableness and extraversion), across two contexts of use. Our results show that both dimensions influenced older adults' perceptions in distinct but interdependent ways, challenging one-size-fits-all explanation strategies. We conclude with practical design implications for coordinating explanation content, conversational delivery, and context in future LLM-VAs supporting aging in place.

cs.HC↗

arXiv2026

"The Only Thing Certain About This is Uncertainty": Exploring Informal Care Coordination Practices Among Older Adults with Mild Cognitive Impairment

Older adults aging in place often have informal support systems to help them maintain independence and quality of life. As they age, many older adults deal with the onset of Mild Cognitive Impairment (MCI), which introduces a new set of functional and cognitive changes that affect their ability to manage daily routines. The approach to arranging and coordinating support for everyday activities for older adults with MCI varies across informal care networks, but typically involves a primary care partner and a network of family, friends and others. In this paper, we present a thematic analysis of in-depth interviews with older adults with MCI and their primary care partners to gain a holistic picture of their day-to-day lived experience. Our analysis uses a multi-dimensional lens of people ("who"), activities ("what"), and tools ("how") to reveal insights about the nature of informal care coordination in MCI. Our results characterize informal care for MCI as a set of complex orchestration tasks by a primary care partner that support the practical, cognitive and emotional needs of the diagnosed individual and mediate the involvement of the broader care network. We uncover that coordination is not solely a matter of logistical organization, but also a deeply relational process shaped by negotiation with technological tools and evolving roles. Through this work, we reframe care coordination for MCI as a distinct and underexplored design space, one that demands systems capable of scaffolding autonomy, adapting to shifting capacities, responding to socio-emotional needs, and fostering collaborative caregiving.

cs.HC↗

arXiv2026

Explanations as Dialogues: Toward Human-Centered Conversational Explainable AI

As AI systems become increasingly conversational, a gap emerges wherein explanations are studied as static artifacts, yet in practice, are experienced as dialogue. In this provocation, we argue that the conversational layer around an explanation is not incidental to its effectiveness, but a critical constituent. Drawing on three illustrative scenarios, we invite the CUI community to study explanations as interactive, conversational exchanges shaped by timing, tone, persona and conversational history, and introduce our vision for Human-Centered Conversational XAI (HC2XAI).

cs.HC↗

arXiv2026

"Who wants to be nagged by AI?": Investigating the Effects of Agreeableness on Older Adults' Perception of LLM-Based Voice Assistants' Explanations

LLM-based voice assistants (VAs) increasingly support older adults aging in place, yet how an assistant's agreeableness shapes explanation perception remains underexplored. We conducted a study(N=70) examining how VA agreeableness influences older adults' perceptions of explanations across routine and emergency home scenarios. High-agreeableness assistants were perceived as more trustworthy, empathetic, and likable, but these benefits diminished in emergencies where clarity outweighed warmth. Agreeableness did not affect perceived intelligence, suggesting social tone and competence are separable dimensions. Real-time environmental explanations outperformed history-based ones, and agreeable older adults penalized low-agreeableness assistants more strongly. These findings show the need to move beyond a one-size-fits-all approach to AI explainability, while balancing personality, context, and audience.

cs.HC↗

arXiv2026

Sometimes You Need Facts, and Sometimes a Hug: Understanding Older Adults' Preferences for Explanations in LLM-Based Conversational AI Systems

Designing Conversational AI systems to support older adults requires these systems to explain their behavior in ways that align with older adults' preferences and context. While prior work has emphasized the importance of AI explainability in building user trust, relatively little is known about older adults' requirements and perceptions of AI-generated explanations. To address this gap, we conducted an exploratory Speed Dating study with 23 older adults to understand their responses to contextually grounded AI explanations. Our findings reveal the highly context-dependent nature of explanations, shaped by conversational cues such as the content, tone, and framing of explanation. We also found that explanations are often interpreted as interactive, multi-turn conversational exchanges with the AI, and can be helpful in calibrating urgency, guiding actionability, and providing insights into older adults' daily lives for their family members. We conclude by discussing implications for designing context-sensitive and personalized explanations in Conversational AI systems.

cs.HC↗

arXiv2025

"It feels like hard work trying to talk to it": Understanding Older Adults' Experiences of Encountering and Repairing Conversational Breakdowns with AI Systems

Designing Conversational AI systems to support older adults requires more than usability and reliability, it also necessitates robustness in handling conversational breakdowns. In this study, we investigate how older adults navigate and repair such breakdowns while interacting with a voice-based AI system deployed in their homes for medication management. Through a 20-week in-home deployment with 7 older adult participant dyads, we analyzed 844 recoded interactions to identify conversational breakdowns and user-initiated repair strategies. Through findings gleaned from post-deployment interviews, we reflect on the nature of these breakdowns and older adults' experiences of mitigating them. We identify four types of conversational breakdowns and demonstrate how older adults draw on their situated knowledge and environment to make sense of and recover from these disruptions, highlighting the cognitive effort required in doing so. Our findings emphasize the collaborative nature of interactions in human-AI contexts, and point to the need for AI systems to better align with users' expectations for memory, their routines, and external resources in their environment. We conclude by discussing opportunities for AI systems to integrate contextual knowledge from older adults' sociotechnical environment and to facilitate more meaningful and user-centered interactions.

cs.HC↗

arXiv2024

Categorizing Sources of Information for Explanations in Conversational AI Systems for Older Adults Aging in Place

As the permeability of AI systems in interpersonal domains like the home expands, their technical capabilities of generating explanations are required to be aligned with user expectations for transparency and reasoning. This paper presents insights from our ongoing work in understanding the effectiveness of explanations in Conversational AI systems for older adults aging in place and their family caregivers. We argue that in collaborative and multi-user environments like the home, AI systems will make recommendations based on a host of information sources to generate explanations. These sources may be more or less salient based on user mental models of the system and the specific task. We highlight the need for cross technological collaboration between AI systems and other available sources of information in the home to generate multiple explanations for a single user query. Through example scenarios in a caregiving home setting, this paper provides an initial framework for categorizing these sources and informing a potential design space for AI explanations surrounding everyday tasks in the home.

cs.HC↗