arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.04123

Agent Reliability Profiles in Financial Services

Mike Hsu·Medha Bankhwal·Béatrice Moissinac·Kevin Werbach·Lukasz Szpruch·Bennett Hillenbrand
View original source ↗Read source document ↗Export metadata ↓

Abstract

AI agents can take actions. At times, those actions can go beyond what is intended. Agent reliability can be defined as assurance that an agent will stay within intended bounds and operate within limits. Today, there is no shared framework or language for describing, validating, and benchmarking the reliability of agentic deployments in financial services. This makes it difficult for financial institutions, vendors, and regulators to assess and trust agents at scale, thus limiting the pace of development and adoption. A standardized, shared representation of agent reliability would fill the gap. This paper introduces the Agent Reliability Profile, a per-agent unit of assurance evidence for agent deployments in financial services. Each Profile records a bounded, falsifiable claim, this agentic system reliably functions within its operating boundary. We define "operating boundary" as an agent having; (1) a defined autonomy tier, (2) a defined operational design domain, (3) defined classes of action, and (4) a defined control envelope. Production assurance progresses through three levels while the Profile schema remains constant: a Profile Builder compiles a Level 1 Asserted Profile from institutional evidence, a Profile Validator tests the deployment in its own environment to produce a Level 2 Validated Profile, and operation of the same tests by a qualified independent assessor produces a Level 3 Verified Profile. Separately a Benchmarked Profile reports results comparable across institutions under reference conditions. We describe the architecture, the artifact, the assurance ladder, the comparability flag, associated tools, an evaluation methodology, applications for financial institutions and supervisors, limitations, and a staged implementation program.

Explore related subjects

cs.CYcs.AI

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mike Hsu, Medha Bankhwal, Béatrice Moissinac, Kevin Werbach, Lukasz Szpruch, Bennett Hillenbrand. 2026-10-02. Agent Reliability Profiles in Financial Services. https://arxiv.org/abs/2610.04123

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Changes in Help-Seeking Strategies Predict unaided Performance during AI-based Mathematical Learning

Generative AI systems (GenAI) are increasingly used by students as learning companions, yet little is known about how they regulate these tools in open-ended learning settings, where the goal is to improve understanding for later independent performance. This study examined Grade-9 students' use of a general-purpose GenAI during mathematical-modeling practice through the lens of epistemic proactivity (EP)---the extent to which learners retain responsibility for regulating and advancing their own knowledge-building. We operationalized EP through two complementary behavioral dimensions: self-regulated learning (SRL) functions and help-seeking (HS) content. We asked whether static summaries of these behaviors or their within-session development were more informative about subsequent unaided performance. A total of 112 students interacted with a web-based LLM tutor, producing 880 substantive student turns; 95 completed both the unaided pre- and post-tests. Interactions were strongly request-dominated, with comparatively little explicit planning, monitoring, or evaluation, and students' stated HS intentions were only weakly reflected in their enacted behavior. Static summaries of AI use did not account for additional post-test variance beyond pre-test performance. In contrast, among the 89 students with HS computable trajectories, within-session HS development was informative: students whose requests became relatively more understanding-oriented---toward conceptual and procedural assistance rather than answer-seeking or verification---showed higher subsequent unaided performance. These findings suggest that AI-supported learning cannot be understood from aggregate interaction characteristics alone; the change in the depth with which students formulate their requests as an interaction develops may provide additional insight into their subsequent performance without AI.

cs.CY↗
arXiv2026

Is AI Widening the Wage Gap? A Hybrid Agentic Simulation for Labor Equity

Artificial intelligence (AI) is reshaping labor markets, yet its effects on wage distribution and the underlying mechanisms remain insufficiently understood. Conventional analytical approaches are limited in their ability to directly examine the dynamic evolution of worker behavior and income distribution under sustained AI shocks and counterfactual policy scenarios. To address this limitation, we present a hybrid agentic framework that aims to challenges of scalability of rule-based models and the limited explainability in LLM-agentic frameworks. Using this framework and sociodemographic data from China, we simulate changes in wage distribution under repeated AI shocks. The results show that both the average-wage ratio between workers in the top and bottom income deciles (T10/B10) and the Gini coefficient increase persistently, suggesting that AI shocks widen the wage gap and exacerbate income inequality. This pattern of a widening wage gap remains robust across alternative large language model decision engines and 30 Monte Carlo simulations. We further conduct counterfactual policy experiments. The results show that education subsidies targeted at low-income workers increase both the number of skill-upgrading attempts and the number of successful upgrades, with particularly pronounced improvements in the upskilling success probability of workers in the bottom income decile. These effects enable the policy to partially mitigate wage inequality. The proposed framework provides an interpretable simulation approach for examining the effects and mechanisms of AI shocks on wage distribution. It also offers policymakers a complementary analytical tool for evaluating policy interventions.

cs.CY↗
arXiv2026

From Algorithmic Marginalization to AI-Mediated Re-Centering: Can Culturally Grounded AI Bring Hakka Language and Culture Back into Mainstream Society?

As large language models increasingly mediate writing, translation, information retrieval, and education, the technological support available to a language may influence its position in contemporary social life. For minority and minoritized languages, this raises a dual problem: inadequate functionality can encourage movement toward dominant languages, while apparently fluent assistance can normalize culturally distinctive expression. This conceptual Research Note develops a framework connecting algorithmic cultural marginalization, cultural grounding, and AI-mediated cultural re-centering. Algorithmic cultural marginalization describes the interaction of representational asymmetry, functional exclusion, homogenizing transformation, and recursive feedback. Cultural grounding identifies interventions across resources, models, services, and governance. Cultural re-centering concerns changes in accessibility, actual language use, public visibility, participation, and the circulation of new knowledge. Drawing on research on language shift and language technologies, the paper uses Hakka in Taiwan as an illustrative case and develops eight propositions for subsequent empirical investigation. Its central argument is that expanded AI access should be assessed alongside the retention of linguistic variation and community authority. The framework distinguishes technological availability from social use, and factual accuracy from cultural fidelity, without assuming that AI can substitute for intergenerational transmission. It provides a basis for investigating whether minority-language AI expands meaningful domains of use or reproduces linguistic marginalization through convenience and standardization.

cs.CY↗