arXiv Science⌕ Search

arXiv subjects

Yong Wang

Publications and source records attributed to Yong Wang.

At least 55 records · Page 3Linked to original sources
arXiv2026

SkillForge: Evolving Verifiable Skills for Reinforcement Learning Agents

Large language model (LLM) agents are trained with reinforcement learning (RL) for complex decision-making tasks. However, most RL-trained agents remain episodic and cannot accumulate reusable knowledge across episodes. Recent skill-based approaches, such as SkillRL, attempt to address this issue by extracting skills from raw trajectories, but treat the skill bank as an append-only repository without verifying whether stored skills remain effective. In this paper, we propose SkillForge, a framework for continuous skill evolution that enables skills to be verified and refined through environment interaction. By making skill usage explicit during agent interaction, RL can directly optimize both environment actions and skill invocation decisions. SkillForge further introduces evidence-based skill verification and multi-pathway skill induction, allowing the skill bank to continuously grow while maintaining its quality. Extensive experiments on ALFWorld, WebShop, and AppWorld show that SkillForge consistently outperforms SkillRL, demonstrating the effectiveness of continuously verified skills in training stronger LLM agents.

cs.CL↗
arXiv2026

A method to identify the ordinary edges for symmetric traveling salesman problem based on frequency $K_i$s

The frequency $K_i$s ($i\in[4,n]$) are studied for symmetric traveling salesman problem ($TSP$) to characterize the structure properties of the edges inside and outside the optimal Hamiltonian cycle ($OHC$). Given a $K_i$ in $K_n$ where $i\in [4,n]$, the frequency $K_i$ is computed with the set of ${{i}\choose{2}}$ optimal $i$-vertex paths with fixed endpoints (optimal $i$-vertex paths) in the $K_i$. Given an $OHC$ edge in a $K_i$, it has a frequency bigger than $\frac{1}{2}{{i}\choose{2}}$ in the frequency $K_i$, and that of an ordinary edge outside the $OHC$ is smaller than $\frac{1}{2}{{i}\choose{2}}$. As the frequency of an edge is computed with the frequency $K_i$s, an $OHC$ edge of $K_n$ has an average frequency bigger than $\frac{1}{2}{{i}\choose{2}}$. It indicates an $OHC$ edge of $K_n$ is also one $OHC$ edge of a $K_i$ containing it. It also found that the probability that an $OHC$ edge has the frequency bigger than $\frac{1}{2}{{i}\choose{2}}$ increases according to $i\in [4, n]$ based on the frequency $K_i$s. For an ordinary edge outside the $OHC$, the probability that it has a frequency smaller than $\frac{1}{2}{{i}\choose{2}}$ increases according to $i$. Based on the findings, a method is given to identify the ordinary edges for $TSP$.

math.CO↗
arXiv2026

Theories of Truly Concurrent Processes

A process is able to execute a set of actions with a predefined manner, while a truly concurrent process executes this set of actions with a manner with the flavour of true concurrency. The so-called truly concurrent process algebras bridge the true concurrency (such as Petri nets, event structures, etc), and the interleaving concurrency (such as CCS, CSP, ACP, etc). In this paper, we give truly concurrent processes testing and bisimulation semantics followed by Hennessy's great work, which inherits the trinity of operational semantics, axiomatic semantics and denotational semantics.

cs.LO↗
arXiv2026

$π$-Girsanov: A Generalized Method to Construct Markov State Models from Non-Equilibrium and Multiensemble Biased Simulations

We introduce $π$-Girsanov, a new method for constructing Markov state models from biased enhanced-sampling molecular dynamics simulations based on Girsanov reweighting. The key idea behind this new method is to separate the reweighting of the stationary density from the reweighting of the correlation function. We evaluate the effectiveness of this approach on several analytical potentials and on a model biomolecular system, comparing its performance with the original method. Our results show that $π$-Girsanov not only improves the estimation in a single-ensemble setting, but also resolves key challenges in estimating transition matrices from multiensemble and non-equilibrium biased trajectories. Overall, $π$-Girsanov represents a substantial advance in kinetic reweighting, strengthening the connection between enhanced sampling techniques and Markov state modeling.

physics.bio-ph↗
arXiv2026

FOX: Visual Exploration of Data Fact Outliers

Exploratory Data Analysis (EDA) systems extract and present data facts to summarize meaningful patterns such as trends and correlations for efficient dataset exploration. However, existing approaches rarely consider outlier detection at the level of data facts,and heterogeneous facts from different analytical scopes are often aggregated in a single view, making it difficult to define meaningful metrics and effectively analyze data fact outliers. To fill this gap, we present FOX, a novel visual analytics system for interactive data Fact Outlier eXploration. FOX organizes data facts into groups with consistent analytical scopes and computes a unified outlier score that combines distribution-based and pattern-based components. Its interface comprises an Upload Panel for data preparation and two coordinated exploration panels: the Overview Panel employs a matrix-based visualization to enable an intuitive overview of all data facts, and the Main Panel provides four linked views for cluster-level and fact-level analysis. We evaluated the usability and effectiveness of the system through two usage scenarios on public datasets and in-depth interviews with 12 participants. The results show that FOX enables meaningful detection, analysis, and explanation of data fact outliers.

cs.HC↗
arXiv2026

Doubly Robust Estimation of Causal Effect on CVR with Targeted Regularization

Post-click conversion rate (CVR) is a key metric in various scenarios including e-commerce and advertising, reflecting the efficiency and user experience in the second stage of the conversion process. Estimating the causal effect on CVR is therefore of great practical importance. However, directly applying existing causal inference methods to clicked samples introduces sample selection bias and increased variance due to the exclusion of non-click data. Recent studies on CVR prediction introduce "ideal loss", which optimizes model parameters using an unbiased estimate of the loss over the full sample. Nevertheless, there is no guarantee that unbiasedness of the loss implies unbiasedness of the final estimator. We revisit this challenge from the perspective of semiparametric theory. Specifically, we develop a new doubly robust causal effect estimator for chain-structured outcomes such as CVR, and derive its theoretical properties in detail. It achieves a faster convergence rate compared to nuisance parameters estimation and is therefore more robust when using flexible nonparametric estimators, including neural networks. Based on these theoretical findings, we further design a framework based on targeted regularization to improve numerical stability and practical applicability. Extensive experiments on synthetic and real-world data demonstrate the effectiveness and robustness of our method. In addition, we find that naively combining loss debiasing with standard causal estimators underperforms our method, highlighting the necessity of developing the new estimator tailored to this CVR-style objective with solid theoretical guarantees.

cs.LG↗
arXiv2026

SkillClaw: Let Skills Evolve Collectively with Agentic Evolver

Large language model (LLM) agents such as OpenClaw rely on reusable skills to perform complex tasks, yet these skills remain largely static after deployment. As a result, similar workflows, tool usage patterns, and failure modes are repeatedly rediscovered across users, preventing the system from improving with experience. While interactions from different users provide complementary signals about when a skill works or fails, existing systems lack a mechanism to convert such heterogeneous experiences into reliable skill updates. To address these issues, we present SkillClaw, a framework for collective skill evolution in multi-user agent ecosystems, which treats cross-user and over-time interactions as the primary signal for improving skills. SkillClaw continuously aggregates trajectories generated during use and processes them with an autonomous evolver, which identifies recurring behavioral patterns and translates them into updates to the skill set by refining existing skills or extending them with new capabilities. The resulting skills are maintained in a shared repository and synchronized across users, allowing improvements discovered in one context to propagate system-wide while requiring no additional effort from users. By integrating multi-user experience into ongoing skill updates, SkillClaw enables cross-user knowledge transfer and cumulative capability improvement, and experiments on WildClawBench show that limited interaction and feedback, it significantly improves the performance of Qwen3-Max in real-world agent scenarios.

cs.AI↗
arXiv2026

EvoMaestro: Toward Interpretable and Steerable LLM-Driven Program Evolution

Recent program evolution systems use large language models (LLMs) to generate and iteratively improve populations of programs, producing striking advances in mathematics, algorithm design, and scientific computing. Yet these systems largely operate as fully automated black boxes. As populations grow, domain experts must make sense of the scores, code changes, reasoning, and algorithmic ideas across many programs, while current interfaces provide limited support for understanding or redirecting the evolution. We characterize this need to understand and steer populations of evolving algorithmic ideas as semantic oversight. A formative study with 8 domain experts yields six design requirements for this emerging human-computer interaction problem. We then propose a steerable program evolution framework that lets expert judgments shape subsequent evolution. Built on this framework, EvoMaestro is an interactive visual analytics system that organizes evolution information from population overview to source code. It helps experts locate and compare noteworthy programs, guide evolution with natural language, combine promising ideas, and prune unproductive directions. A seven-day system demonstration illustrates how an expert applied these capabilities throughout a long-running evolution process. A within-subjects study with 12 participants shows that EvoMaestro improves users' understanding of evolution processes, reduces cognitive workload, and supports expert steering. These findings suggest that preserving expert agency in open-ended LLM-driven search requires support for both informed judgment and the ability to shape subsequent automation.

cs.HC↗
arXiv2026

LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks

Large language model (LLM) agents increasingly undertake long-horizon tasks that require sustained reasoning, tool use, and revision across many interdependent steps. However, existing agent harnesses maintain task execution, task state, and completion assessment within a growing context, making the state difficult to track and allowing incorrect self-assessments to propagate into later decisions. We reformulate long-horizon execution as a task-state management problem and propose LongHorizon-Harness, which maintains the task state explicitly outside execution and updates it only with facts independently verified from the environment. Its Manage-Execute-Audit(MEA) loop uses a manager to maintain the task state and determine the next subtask, a fresh-context executor to perform it, and a read-only auditor to verify the resulting environment state before the next round. A lightweight AgentAdapter supports interchangeable model and harness backends without modifying their native agent loops. LongHorizon-Harness improves Qwen~3.7-Plus from 51.8% to 80.7% on WeaveBench, from 69.7% to 77.2% on Terminal-Bench~2.1, and from 2.8% to 8.3% on OSWorld~2.0. It also raises Claude Opus~4.7 from 20.0% to 34.3% on an OSWorld2.0 subset, demonstrating consistent gains across models, harnesses, and interaction domains.

cs.CV↗
arXiv2026

GARDRec: Decision-Level Graph Grounding for Large Language Model Recommendation

Large language models (LLMs) offer new opportunities for recommendation by interpreting item descriptions, user instructions, and external knowledge through natural-language prompts. However, existing graph-augmented LLM recommenders often use knowledge graphs mainly as prompt-level evidence, leaving ranking decisions weakly constrained by structured user-item relations. This is problematic for next-item recommendation, where the model must compare candidates under the same user context while preserving temporal preference, collaborative signals, and attribute matches. To address this issue, we propose \emph{GARDRec}, a Graph-grounded Adaptive Reasoning and Decision-aware Recommendation framework for LLM-based next-item ranking. GARDRec constructs semantic-structural item representations from textual node features and graph propagation, derives personalized graph contexts from temporally weighted histories and first-order neighborhoods, and aligns graph-derived representations with a frozen LLM through continuous multimodal prompts. Explicit interaction and matching features are injected through late-stage decision branches, while inter-candidate attention and restricted generative likelihood support final ranking. Experiments on three public benchmarks with multiple LLM backbones show that GARDRec generally improves candidate-ranking performance over representative baselines. Ablation and diagnostic analyses verify the contributions of graph projection, neighborhood retrieval, explicit decision features, ranking loss, and generative calibration.

cs.IR↗
arXiv2026

Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution

Although Large Language Model (LLM) agents have demonstrated strong performance on complex tasks, their learning is often limited by inefficient interaction feedback and static training environments, which hinder broader generalization. To address these limitations, this paper introduces Role-Agent, \textcolor{black}{a framework} that harnesses a single LLM to function concurrently as both the agent and the environment, enabling a bootstrapped co-evolution. Role-Agent comprises two synergistic components: World-In-Agent (WIA) and Agent-In-World (AIW). In WIA, the LLM acts as the agent and predicts future states after each action; the alignment between predicted and actual states is then used as a process reward, encouraging environment-aware reasoning. In AIW, the LLM analyzes failure modes from failed trajectories and retrieves tasks with similar failure patterns, thereby reshaping the training data distribution for targeted practice. Experiments on multiple benchmarks show that Role-Agent consistently improves performance, yielding an average gain of over 4\% over strong baselines.

cs.AI↗
arXiv2026

APPO: Agentic Procedural Policy Optimization

Recent advances in agentic Reinforcement Learning (RL) have substantially improved the multi-turn tool-use capabilities of large language model agents. However, most existing methods assign credit over coarse heuristic units, such as tool-call boundaries or fixed workflows, making it difficult to identify which intermediate decisions influence downstream outcomes. In this work, we study agentic RL from two perspectives: \textit{where to branch and how to assign credit after branching}. Our pilot analysis shows that influential decision points are broadly distributed throughout the generated sequence rather than concentrated at tool calls, while token entropy alone does not reliably reflect their impact on final outcomes. Motivated by these observations, we propose \textbf{Agentic Procedural Policy Optimization (APPO)}, which shifts branching and credit assignment from coarse interaction units to fine-grained decision points in the sequence. APPO selects branching locations using a Branching Score that combines token uncertainty with policy-induced likelihood gains of subsequent continuations, enabling more targeted exploration while filtering out spurious high-entropy positions. It further introduces procedure-level advantage scaling to better distribute credit across branched rollouts. Experiments on 13 benchmarks show that APPO consistently improves strong agentic RL baselines by nearly 4 points, while keeping efficient tool-calls and maintaining behavior interpretability.

cs.LG↗
arXiv2026

ReSum: Synergizing LLM Reasoning and Summarization with Reinforcement Learning

Reinforcement Learning with Verifiable Rewards (RLVR) is a central technique for improving long-horizon reasoning in Large Language Models (LLMs). However, existing RLVR methods often encourage unnecessarily long reasoning rollouts, which can degrade reasoning coherence and exhaust the available context budget. Existing approaches to long-context organization often depend on external mechanisms to organize rollouts, rather than enabling the model to manage its own reasoning trajectory. To address this limitation, we propose ReSum, a novel RLVR framework that enables LLMs to compress and organize their reasoning trajectories through self-summarization. Our pilot studies show that self-summarization stabilizes generation by lowering token-level entropy, and that introducing a ``summarization'' phrase can substantially mitigate errors propagated from an incorrect rollout prefix. Motivated by these findings, ReSum adopts a summarization-aware adaptive rollout mechanism that contrastively evaluates whether self-summarization benefits the ongoing reasoning process. Specifically, when the model spontaneously triggers self-summarization, ReSum masks the summarization phrase to create a contrastive branch; for non-summarization positions, it instead randomly injects the phrase to create a matched branch. We further design a summarization-aware advantage to enable finer-grained comparison between contrastive rollout trajectories. Extensive experiments show that ReSum improves performance at an average of 4\% while reducing rollout length by 18.6\%.

cs.AI↗
arXiv2026

VizPilot: Automated Onboarding for SVG-based Composite Visualizations using Multimodal LLMs

Composite visualizations integrate multiple visualizations to represent complex datasets effectively, but their intrinsic composite designs often impose a high initial cognitive load on novice users. Existing visualization onboarding approaches are typically platform-dependent, require substantial manual authoring effort, and struggle with the structural complexity of composite visualizations, limiting their general applicability. We present VizPilot, an automated visualization onboarding approach that reverse-engineers composite visualization structure to generate interactive onboarding experiences directly from raw visualization artifacts. VizPilot consists of two modules: a Composite Visualization Analyzer and an Onboarding Interface. Leveraging Multimodal Large Language Models (MLLMs), the Analyzer employs a two-stage pipeline that decomposes a visualization into visual components, extracts structured explanations, and maps them to precise SVG elements for reliable highlighting and interaction. Implemented as a browser extension, VizPilot requires only a brief visualization description and optional interaction source code from the visualization developer to automatically generate onboarding content. The Onboarding Interface supports both guided narrative scrollytelling and free exploration, enabling users to learn visualization components progressively or on demand. We evaluate VizPilot through a comparative analysis of different input modalities, a usage scenario demonstrating reduced authoring effort, and a user study assessing its impact on users' cognitive load. The results demonstrate that VizPilot effectively automates the authoring of onboarding experiences while improving the usability and accessibility of composite visualizations.

cs.HC↗
arXiv2026

Causal Discovery with Inverted Self-attention for Multivariate Time Series

Causal discovery in multivariate time series data is challenging due to complex interactions, high dimensionality, and nonlinear dependencies among variables. Existing methods often struggle to capture these complexities, resulting in inaccurate causal structures. To address this issue, we propose a novel framework that leverages self-attention mechanisms within the transformer architecture for causal discovery. Our approach introduces a novel inverted causal self-attention mechanism (CSAM) that emphasizes latent and indirect causal relationships by inverting tokens and inducing sparsity in attention scores, focusing on significant causal interactions and reducing spurious correlations. Additionally, we develop a global causal algorithm to identify global causal links, providing a holistic metric for causal influence, along with a causal verification module to ensure robustness in the identified causal relationships, enhancing the reliability of our framework. Experiments on both linear and nonlinear datasets, along with ablation studies and sensitivity analyses, show that our framework outperforms existing methods, demonstrating its potential for causal discovery in complex multivariate time series.

cs.CL↗
arXiv2026

SAVVY: Student Attention Visualization for Video-based Learning Analysis

Video-Based Learning (VBL) has become a popular delivery medium of education in the past decade, ranging from online education to hybrid learning. Students' rising expectations for video quality have motivated teachers to enhance the design of instructional videos before releasing them. Analyzing the attention of pilot cohorts in advance has become a conventional optimization strategy to guide course improvement. However, existing attention quantification algorithms are highly susceptible to noise in real-world environments, degrading estimation accuracy. Moreover, even when attention data are available, teachers must still invest substantial effort in empirical revision attempts, limiting practical feasibility. To address these challenges, we first propose a novel attention modeling framework based on multimodal brain signals that enables stable tracking of student attention levels. We then develop SAVVY, a novel interactive visual analytics system that integrates visual and auditory attention to support top-down exploration of student attention variations. SAVVY comprises three coordinated visualization modules. These modules incorporate multi-level information, including course content structure, audiovisual information density, and attentional resource allocation, and provide multi-temporal-resolution attention trajectories of individual students, enabling teachers to comprehensively analyze the underlying causes of attention fluctuations and inform their subsequent instructional video improvement. We evaluate SAVVY through quantitative experiments, two case studies, and expert interviews. The results demonstrate the effectiveness and usability of SAVVY in intuitively identifying student attention variations and supporting instructional video optimization.

cs.HC↗
arXiv2026

AniMaster: From Story Texts to Animated Videos via Cinematic Script Generation and Interactive Authoring

Recent advances in Video Generation Models (VGMs) have demonstrated strong capabilities in producing short video clips. However, it is still challenging for everyday creators to leverage these models to produce polished long-form animated videos from brief story texts. Informed by a formative study with both novice creators and film experts, we identify two major challenges of interactive video authoring: (1) the lack of expertise in translating free-form story texts to professional cinematic scripts and finally high-quality animated videos, and (2) the absence of effective ways to convey video design intents to key variables of visual storytelling, such as shot composition, camera controls and shot sequencing. Drawing on narratology and film studies, we propose a three-layer design framework that defines the key design dimensions across three layers (i.e., story texts, cinematic scripts, and animated videos) as well as the translation between them. Built on this framework, we present AniMaster, a VGM-powered authoring tool to enable everyday creators to easily produce smooth animated videos from free-form story texts. AniMaster automatically expands brief story texts to detailed cinematic scripts, and further translates cinematic scripts into polished videos by following professional visual storytelling principles. It also allows users to interactively edit the scripts and refine the generated videos via text instructions and intuitive interactions. We extensively evaluated AniMaster through an in-depth user study with 16 participants, two case studies, and expert interviews with 2 film professionals. The results demonstrate the effectiveness and usability of AniMaster in helping everyday creators create polished animated videos from free-form story texts.

cs.HC↗
arXiv2026

Hydrodynamic limit and Newtonian limit from the relativistic Vlasov-Maxwell-Boltzmann system to the classical Euler-Poisson system

In this paper, around a global smooth irrotational solution to the classical isentropic compressible Euler-Poisson system, we construct classical solutions to the one-species relativistic Vlasov-Maxwell-Boltzmann system on any finite time interval $[0,T]$, and rigorously justify the combined hydrodynamic and Newtonian limits to the Euler-Poisson system. In particular, this yields a rigorous derivation of the compressible Euler-Poisson system, whose Poisson coupling induces an instantaneous electrostatic response and thus no longer preserves a strict finite-speed propagation structure, from a relativistic kinetic model with finite propagation speed. The analysis is based on a Hilbert expansion in $\varepsilon$ for the relativistic Vlasov-Maxwell-Boltzmann system, an asymptotic expansion in $\mathfrak{c}^{-1}$ for the relativistic Euler-Maxwell system, and estimates for both the expansion coefficients and the remainder terms that are uniform in $\mathfrak{c}$ and $\varepsilon$, without imposing any \emph{a priori} relation between these two parameters.

math.AP↗