arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.31521

Jev-DLC: Decision-Level Continual Learning from Typed Feedback

Yangyang Feng·Jianle Gan·Zhuoyan Feng·Chengwei Qin
View original source ↗Read source document ↗Export metadata ↓

Abstract

Individual preferences often become visible only after deployment, when a user accepts one decision or revokes it in favor of another. Jev-style typed interfaces make this feedback explicit by identifying the selected action and, under revocation, the decision it replaces. We study how these consequences persist across requests as Decision-Level Continual Learning from Typed Feedback (Jev-DLC). Jev-DLC treats each correction as both evidence about a recurring action identity and a directed relation between the preferred and rejected choices. It preserves these signals in complementary bounded channels above a frozen scorer and combines their scores to shape the next decision. The method retains no raw interaction history, adds no scorer call, and performs no runtime language-model backward pass. We also introduce TCPA-Bench, a chronological suite that credits a correction only through its effect on later decisions. On TCPA-Repeat, Jev-DLC reaches 44.83% user-macro accuracy overall, 2.43 points above Recent-4 history replay. After at least two earlier feedback events, it reaches 56.07%, a 7.54-point margin over the strongest reported comparison at this depth. These results show how explicit typed corrections can become compact causal state for continual personalization.

Explore related subjects

cs.AI

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yangyang Feng, Jianle Gan, Zhuoyan Feng, Chengwei Qin. 2026-10-22. Jev-DLC: Decision-Level Continual Learning from Typed Feedback. https://arxiv.org/abs/2610.31521

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Anchoring Distributed Agency: Institutional Metaphors for Designing Large-Scale AI and AI Techniques for Running Institutions

Artificial Intelligence (AI) started out with the ambition to reproduce the human mind, but as soon as the sheer scale of that ambition became apparent, it retreated into either studying specialized intelligent behaviours or proposing overarching architectural concepts for interfacing specialized intelligent components---conceived of as agents acting through organizational structures. The agent-based modelling paradigm proved to have interesting applications beyond the original domain, supporting the understanding, simulation, and the assessment of behaviour of socio-economic and legal structures on an aggregate level. Looking at contemporary AI, whereas text completion provides a successful example of specialized behaviour, surprisingly little of the rich foundation of multi-agent systems (MAS) and normative systems research is currently reflected in Agentic AI systems. Addressing this gap, the chapter examines cross-cutting conceptualisations, modelling problems, and design challenges shared by large-scale distributed AI and institutional systems. Three main contributions can be highlighted. First, by tracing the historical trajectory of AI, the chapter identifies an \textit{ecological} perspective on intelligence, examining both the value and limits of the \textit{compression-as-intelligence} hypothesis. Second, it shows how moving between internal cognitive mechanisms and external manifestations of agency supports a functional separation of concerns for both individual and collective agency. Third, it argues that \textit{epistemological}, \textit{normative}, and \textit{value pluralisms} are necessary conditions for sustaining the ecological character of intelligence. Furthermore, we indicate how AI techniques can support institutions by modelling social roles, simulating normative interactions, detecting and diagnosing failures, and supporting procedures of review and revision.

cs.AI↗
arXiv2026

Risk-Aware Alignment Must Incorporate Reward Uncertainty

We consider the problem of policy optimization with noisy rewards, where the policy is constrained to be in the neighborhood of a reference policy.We study the risk of the policy optimization process, defined to be the chance of obtaining a policy worse off than the reference policy. In an idealized multivariate Gaussian model for the noisy reward function, we show that the regularizer achieving optimal risk in a suitably local neighborhood of the reference policy is the quadratic norm weighted by the reward covariance matrix. This result is used to develop a new policy optimization algorithm based on regularization via reward variance estimates. Experiments across synthetic bandit models, large language models and reward models show that this algorithm yields more robust alignment outcomes than existing approaches.

cs.AI↗
arXiv2026

Agent-Environment Alignment via Automated Interface Generation

Large language model (LLM) agents have shown impressive reasoning capabilities in interactive decision-making tasks. These agents interact with environment through intermediate interfaces, such as predefined action spaces and interaction rules, which mediate the perception and action. However, mismatches often happen between the internal expectations of the agent regarding the influence of its issued actions and the actual state transitions in the environment, a phenomenon referred to as agent-environment misalignment. While prior work has invested substantially in improving agent strategies and environment design, the critical role of the interface still remains underexplored. In this work, we empirically demonstrate that agent-environment misalignment poses a significant bottleneck to agent performance. To mitigate this issue, we propose ALIGN, an Auto-Aligned Interface Generation framework that alleviates the misalignment by enriching the interface. Specifically, the ALIGN-generated interface enhances both the static information of the environment and the step-wise observations returned to the agent. Implemented as a lightweight wrapper, this interface achieves the alignment without modifying either the agent logic or the environment code. Experiments across multiple domains including embodied tasks, web navigation and tool-use, show consistent performance improvements, with up to a 45.67% success rate improvement observed in ALFWorld. Meanwhile, ALIGN-generated interface can generalize across different agent architectures and LLM backbones without interface regeneration. Code and experimental results are available at https://github.com/THUNLP-MT/ALIGN.

cs.AI↗