arXiv · 2611.21634
Trusting Trust in AI Software Engineering Agents: The Why, What, and How?
Abstract
AI software engineering agents are increasingly integrated into development workflows, from autocomplete assistants to autonomous repair agents and multi-agent software development pipelines. Trust matters because these agents can produce, revise, and pass on artifacts that developers, other agents, or organisations may later rely on under uncertainty and risk. Yet trust in such systems is often treated as a single measurable property of an AI system. This is insufficient for software engineering, where trust depends on who relies on the agent, how that reliance is structured, and which properties must hold in that deployment. We propose a structural framework for reasoning about trust in AI software engineering agents. Inspired by the recursive nature of trust in software systems, we decompose trust into three analytical questions: Why trust?, identifying the trust scenario; What trust?, identifying the trust configuration; and How much trust?, identifying the trust properties. From these questions, we derive three scenarios, four configurations, and five trust-relevant properties, state which of these are closed by construction and which remain open to revision, and instantiate the resulting profile on a ChatDev-style multi-agent workflow. The framework is conceptual, and is offered as a foundation for the empirical work that would validate it, rather than as a numerical trust metric.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Pranav V, Sridhar Chimalakonda, Vibhu Saujanya Sharma, Vikrant Kaulgud. 2026-09-19. Trusting Trust in AI Software Engineering Agents: The Why, What, and How?. https://arxiv.science/abs/2611.21634
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.