arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.26360

Remote Expert Evaluation of Tabletop Avatar Gaze Control in Asymmetric Multi-Scale MR--VR Collaboration

Carlos Mosquera·Neven Elsayed·Ernst Kruijff·Joseph Newman·Valeriya Lehrbaum·Eduardo Veas
View original source ↗Read source document ↗Export metadata ↓

Abstract

This paper proposes an integrated setup for a multi-scale asymmetric collaboration scenario in the context of a remote-expert use case, focusing on the expert side. In this system, the remote expert (with an exocentric view in Mixed Reality (MR)) uses a Tangible User Interface (TUI) to precisely position and rotate their avatar within a scaled tabletop World-in-Miniature (WIM). Inside the WIM, the expert's avatar and the operator share the same scale and egocentric view, while the expert retains a global tabletop overview of the plant to support collaboration. Interviews with industry experts during the participatory design phase revealed the need for an egocentric view inside the plant on the remote-expert side to enable full collaboration. We designed and studied three interaction-visualisation combinations to integrate and control the expert avatar's gaze: VR (fully immersive with direct head control), Head (floating screen with direct head control), and Touch (on-avatar screen with touchpad control). We evaluated these methods with 29 participants across two fault-detection tasks: Same Machine, where both collaborators inspect the same machine, and Twin Machine, where they inspect identical machines in separate locations. The VR condition, which combines immersion, direct head control, and a full-scale view, yielded the strongest overall performance and user experience, while the tabletop avatar setup was well received for collaboration. Our findings inform the design of gaze-control techniques for asymmetric MR-VR collaboration and reveal challenges and opportunities for future work.

Explore related subjects

cs.HC

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Carlos Mosquera, Neven Elsayed, Ernst Kruijff, Joseph Newman, Valeriya Lehrbaum, Eduardo Veas. 2026-10-19. Remote Expert Evaluation of Tabletop Avatar Gaze Control in Asymmetric Multi-Scale MR--VR Collaboration. https://doi.org/10.1145/3822517.3848661

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

FlexMind: Supporting Deeper Creative Thinking with LLMs

Expert ideation requires more than generating ideas. People must articulate trade-offs, develop mitigations, and compare parallel directions, yet this reasoning process is cognitively demanding. Existing ideation tools fall short by either focusing only on expanding or organizing the idea space, or by offering evaluations without supporting mitigation generation and continued reasoning over newly introduced trade-offs. We present FlexMind, an AI-augmented system that proactively scaffolds multi-threaded trade-off-mitigation chains within a structured workspace. FlexMind helps users surface concrete trade-offs, generate actionable mitigations, and navigate and expand multiple idea branches. In a controlled study (n=20), FlexMind supported deeper exploration without sacrificing breadth and produced higher-quality ideas, as judged by domain experts, compared to a baseline. A case study with six experts (n=6) further reveals how FlexMind supports idea analysis while helping uncover new solutions. These results inform implications for enhancing human-AI co-creation.

cs.HC↗
arXiv2026

ZORO: Active Controls to Support Rule Following in Vibe Coding

Rules files (e.g., AGENTS$.$md, CLAUDE$.$md) are the primary mechanism for human-agent alignment when developers vibe code. However, they remain passive: it is not immediately apparent when rules are being used or followed, or how to improve them. To transform rules from passive text into active controls, we introduce ZORO, an interactive interface that integrates directly with a coding agent and anchors rules to every step of the coding process. After an agent generates an initial plan, ZORO enriches the plan with rules, enforces the rules during implementation by requiring the agent prove that each rule was followed, and allows users to provide in-situ feedback when they are unsatisfied with a rule application to evolve the ruleset. A technical evaluation shows that coding agents follow rules more with ZORO than without. A user study demonstrates a change in people's behavior and cognitive strategies when rules are at the forefront of vibe coding. We discuss how making rules active in agentic systems unlocks broader opportunities for human-agent alignment in coding settings and beyond.

cs.HC↗
arXiv2026

Calibrating LLM Judges for Human and AI Conversations

Measuring how successful a conversation is remains difficult, even for humans judging spoken dialogue. We evaluate state-of-the-art LLMs as pointwise and pairwise judges of conversational success on CANDOR, finding pointwise scoring correlates moderately with human ratings, while pairwise comparison suffers from long transcripts and positional bias. Since this leaves judge scores incomparable across models, we propose a small anchor set and a calibration function that calibrates any judge onto a shared, interpretable scale. We further release the Voice Arena Goal Dataset (VA), 200 task-oriented human-AI and human-agent conversations with pairwise annotations, revealing a substantial gap between current judges and human-level discrimination. Using VA, we test whether CANDOR-fitted calibration transfers to human-AI conversations, finding it brings judges onto a shared scale despite never observing VA during fitting.

cs.HC↗