Huajie Cao | arXiv Science

arXiv2025

Human-Robot Teaming Field Deployments: A Comparison Between Verbal and Non-verbal Communication

Healthcare workers (HCWs) encounter challenges in hospitals, such as retrieving medical supplies quickly from crash carts, which could potentially result in medical errors and delays in patient care. Robotic crash carts (RCCs) have shown promise in assisting healthcare teams during medical tasks through guided object searches and task reminders. Limited exploration has been done to determine what communication modalities are most effective and least disruptive to patient care in real-world settings. To address this gap, we conducted a between-subjects experiment comparing the RCC's verbal and non-verbal communication of object search with a standard crash cart in resuscitation scenarios to understand the impact of robot communication on workload and attitudes toward using robots in the workplace. Our findings indicate that verbal communication significantly reduced mental demand and effort compared to visual cues and with a traditional crash cart. Although frustration levels were slightly higher during collaborations with the robot compared to a traditional cart, these research insights provide valuable implications for human-robot teamwork in high-stakes environments.

cs.RO↗

arXiv2025

Alignment Under Pressure: AR-HMD Support Tools for Action Teams

Team communication breakdowns represent a contributor to patient safety risks within action teams-defined as interdependent groups of specialized people who perform coordinated work under high workload, time pressure, and uncertainty. Approximately 70% of such instances lead to adverse patient outcomes amid intense time pressure, uncertainty, and high cognitive load. While prior research has focused on maintaining shared cognition during these interactions, existing technologies largely prioritize individual task execution and decision-making, offering limited support for real-time team coordination. This study investigates the potential of augmented reality head-mounted displays (AR-HMDs) to address this gap by facilitating what we call 'team alignment' - the active maintenance of shared understanding regarding tasks, patient state, responsibilities, and ongoing clinical activity. Through an 11-month multi-phase qualitative study with ten healthcare professionals, we first elicited coordination challenges through semi-structured interviews complemented by real-time storyboard creation. Participants then engaged in reflection and refinement of these scenarios while contemplating the potential impact of AR-HMDs on their situation. Our findings revealed that breakdowns frequently arose when clinicians lacked sufficient contextual information, when assigned responsibilities did not align with available expertise, or when procedural progress was difficult to track - particularly during critical bedside activity. We subsequently developed the Team Alignment and Coordination Taxonomy (TACT), encompassing information, expertise, procedural, and cognitive dimensions. By reframing coordination as this active maintenance of alignment, our research shifts the design focus from individual decision support systems to holistic, team-level system interventions.

cs.HC↗