arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2510.15531

A Feasibility Study on Usability and Trust among Population Groups of a Medical Avatar Supported by Large Language Models with Retrieval Augmented Generation

Roel Boumans·Lisa Cramer·Sascha van de Poll·Henria Vermeulen
View original source ↗Read source document ↗Export metadata ↓

Abstract

Healthcare professionals have limited time to support patients and their relatives, but their information needs are high. Therefore, the Radboud University together with the Canisius Wilhelmina Hospital hospital developed a speaking virtual hu-man avatar which, contrary to many avatars, uses a Large Language Model (LLM) enhanced with Retrieval Augmented Generation (RAG). The RAG tech-nique enables medical information supplied by the hospital to be utilized during interactions, rather than generic LLM information. Two videos were produced, one presenting a patient-avatar interaction regarding a total hip surgery, and an-other one presenting an interaction between a relative of a patient and the avatar concerning postoperative delirium. A survey was conducted among adults over 40 from the Netherlands, the UK and the USA to study the effects of gender, country and education level on usability and trust, which are important factors for avatar acceptance. Participants watched videos, imagining themselves as the pa-tient (video 1) or relative (video 2), and rated the constructs on a 7-point Likert scale (0-6). 165 persons (MeanAge=51.6, SDAge=8.9, Male=80, Female=85) completed the survey. In the patient role, participants scored the usability as M=4.61 (SD=0.97) and trust as M=3.92 (SD=1.10), all above the mean scale value. In the role as relative to the patient, participants scored usability as M=4.64 (SD=1.08) and trust as M=4.31 (SD=1.06). No effects were found of gender, country and education level.

Explore related subjects

cs.HC

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Roel Boumans, Lisa Cramer, Sascha van de Poll, Henria Vermeulen. 2025-10-17. A Feasibility Study on Usability and Trust among Population Groups of a Medical Avatar Supported by Large Language Models with Retrieval Augmented Generation. https://arxiv.org/abs/2510.15531

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Are explainable AI (XAI) evaluation strategies aligned? Comparing subjective, objective, and mathematical evaluation measures using saliency maps

The evaluation of explainable AI (XAI) approaches often relies on three families of methods: subjective measures (e.g., questionnaires on trust or satisfaction), objective measures (e.g., task performance metrics), and mathematical metrics (e.g., for faithfulness). Yet, it remains unclear how these families align or diverge in practice. In a{preregistered} between-subjects study (N=166), we use three established saliency map techniques (LIME, Grad-CAM, Guided Backpropagation) as a testbed to examine this issue. We find that each family of methods leads to different conclusions: participants reported no differences in trust or satisfaction, Grad-CAM improved user performance, while mathematical metrics favored Guided Backpropagation. At the same time, mathematical metrics were only partially related to user performance, and these relationships were sometimes counterintuitive. Our findings highlight the methodological importance of comparing subjective, objective, and mathematical approaches when evaluating XAI, illustrating both tensions and aspects that are aligned. We discuss implications for XAI evaluation frameworks.

cs.HC↗
arXiv2026

Mind Your Ps and Qs: Positive Moderation Practice in the Positive Queue

Online communities rely on volunteer moderators to maintain order. Despite their key role, moderators are given a toolbox of punishments and far less support for encouraging contributions they want to see more of. We introduce the Positive Queue as a positive counterpart to Reddit's modqueue: a dedicated space for moderators to discover contributions and behaviors they want to encourage and positively reinforce. With five moderators, four with 6-14 years of experience, we use the Positive Queue to examine how moderators operationalize positive reinforcement. Moderators combined predicted community reception, observed engagement, and their own judgment; used prediction-engagement mismatches to identify overlooked content; and repurposed positive features for punitive and retrospective work. These findings surface tensions around labor, attribution, and community fit. We contribute the Positive Queue as a working system and conceptualize positive moderation as recognition infrastructure that shapes what moderators notice, whose judgment becomes visible, and how recognition reaches contributors.

cs.HC↗
arXiv2026

PILOT: Control Surfaces for Authoring Social Media Feeds

Personalized social media feeds infer preferences from behavior, leaving people little direct control over what they see. Existing controls range from post-level reactions to rules and natural language, but little is known about how people use them together or how added expressiveness changes effort. We built PILOT, a Bluesky feed-authoring system that turns in-feed actions into explicit preferences, deterministic ranking, and inspectable outcomes. A study with seven participants informed an expanded implementation, which we organized into three nested control surfaces that ten participants compared within subjects. Participants assigned controls to distinct jobs: broad controls set direction, in-post actions refined results, and filters removed content. Richer surfaces did not necessarily feel more effortful, and participants' experiences depended more on whether they could verify and repair outcomes. Our findings show that usable feed control requires not simply more controls, but orchestration across mechanisms that support expression, inspection, repair, and episodic use.

cs.HC↗