arXiv Science⌕ Search

arXiv subjects

Jicheng Wang

Publications and source records attributed to Jicheng Wang.

At least 19 recordsLinked to original sources
arXiv2026

WebHarbor: Docking Real Websites for Evolving GUI Agent Environments

GUI web agents require realistic and interactive environments that remain stable during both evaluation and training. Live website evaluation suffers from changing content, access restrictions, and limited coverage of authenticated workflows, while existing synthetic environments for training often lack functional depth and visual fidelity. We propose WebHarbor, a suite of 153 executable and dockerized website environments that faithfully reconstruct the visual interfaces, content, and functional workflows of real-world web services under deterministic control. We build WebHarbor through task-driven human-agent collaboration, where environments evolve as new tasks expand their functional scope, coding agents implement the required changes, and human contributors audit visual fidelity, functional correctness, and task validity. The resulting suite comprises 3,518 tasks spanning multi-step and post-authentication workflows, where existing works often fail to cover. Beyond reliable evaluation, WebHarbor provides high-fidelity synthetic web environments for cost-efficient reinforcement learning (RL). We demonstrate that a Qwen 4B-level GUI agent trained with RL in WebHarbor generalizes to unseen tasks and performs competitively with leading open-source GUI web agents across four benchmarks. The code and data are publicly available at https://github.com/aiming-lab/WebHarbor.

cs.AI↗
arXiv2026

AgentPersonaBench: Benchmarking Persona-Driven User Simulation

We introduce AgentPersonaBench (APB), a benchmark evaluating whether persona conditioning faithfully steers downstream agent behavior. While language models are increasingly deployed for persona-driven user simulation, existing benchmarks primarily evaluate conversational styling or self-reports rather than authentic behavioral fidelity. APB evaluates latent persona adherence one trait at a time, embedding each target trait within a complete synthetic profile without explicitly naming the trait or disclosing the test. Ground-truth adherence is verified strictly from observable actions across four interaction surfaces of increasing realism: survey, chat, web (interactive web environments), and app (desktop software environments). APB comprises 2,460 tasks spanning 867 traits, verified through automated audits and expert review. Our evaluation of 20 frontier model arms demonstrates that high-fidelity user simulation is already attainable: leading models achieve up to 84.7% full-pass adherence under unprompted conditions. At the same time, APB identifies clear behavioral boundaries: adherence drops across interaction modalities (only 37.9-64.3% pass all four surfaces), multi-attribute demands degrade retention, and competing model families exhibit pronounced behavioral divergence.

cs.AI↗
arXiv2026

Open-Endedness Bench: Measuring Epistemic Process from Agent Records

Agents are increasingly given open-ended research tasks: discovering an empirical law from self-designed experiments, improving a heuristic whose optimum nobody knows, or beating a standing record. Their execution logs record every step of this research, yet the runs are still judged by their outcome score. That score alone does not establish whether an agent's claims follow from executed experiments, and a reference answer may be unavailable. We evaluate the agent's epistemic process: how it forms hypotheses, tests them, and revises them in response to evidence. We introduce OEB (Open-Endedness Bench), a benchmark-agnostic methodology that reads only the agent's execution record and never a reference answer or an outcome score. OEB compiles the record into a unified epistemic event graph whose edges connect the propositions the agent states to the executed actions that test them; each node carries an exact excerpt that code verifies against the record. One principle governs scoring: prose can state a proposition, but only evidence returned by an executed action can support or refute it, so OEB checks what the agent writes against what it actually ran. From the graph, OEB scores four competence axes (evidence, experiment, revision, and no reward hacking), mostly as the share of opportunities for sound research that the agent took, and profiles six subjective persona traits that describe the agent's research habits. We score 119 existing runs over 12 tasks from three benchmarks: LLM post-training, chip design, and a training-speed record. Against logged results, only 16-29% of the improvements agents claim are real. On 9 of 10 tasks, the best run tries more new ideas in its second half than the worst run. The persona readings follow the model: for every trait, the model that ran explains more of its variance across runs than the task (a median of 43% against 7%).

cs.AI↗
arXiv2026

ContractBench: Can LLM Agents Preserve Observation Contracts?

Tool-augmented LLM agents call APIs whose intermediate outputs, such as presigned URLs, session tokens, and OAuth state parameters, are observation contracts: artifacts whose later use is constrained by the external system that produced them. We show that observation contract compliance (preserving the temporal validity and byte-level integrity) is an emergent, regression-prone capability: it is neither guaranteed by general tool-use ability nor consistently improved by larger or newer models. To measure this, we introduce ContractBench, a benchmark of 33 dual-axis tasks that probe two orthogonal failure modes no existing benchmark evaluates: validity failures (using an artifact after expiry) and integrity failures (corrupting an artifact's bytes through the observation-to-action pipeline). Our evaluation is deterministic and programmatic, with a virtual clock controlling time and SHA-256 hashes verifying byte integrity. We assign each outcome a failure label drawn from real-world API specifications. We evaluate 38 models and report four findings: (i) no evaluated model clears 80%, with Claude-Opus-4.6 leading at 77.8%, revealing that current frontier models still fail to comply with observation contracts; (ii) a sharp within-family capability cliff in Qwen 3.5 between 4B (0%) and 9B (56.6%), smoothing to 70.7% at 397B-A17B: what emerges across the cliff is mid-trajectory restraint, not tool-call competence; (iii) non-monotonic scaling across the GPT-5 family: agentic post-training can erode compliance through sycophancy-driven regression; (iv) our failure taxonomy works as an actionable in-context reward signal, yielding +7.1 pp on 42 paired GPT-5.1 failures.

cs.SE↗
arXiv2026

ForkLeft: Entropy-First Rollouts for Prefix-Aligned Autoregressive-to-Diffusion Distillation

Autoregressive Next-Token Prediction (NTP) has enabled strong reasoning capabilities in language models, while Diffusion Language Models (DLMs) offer flexible token orders and parallel generation. We ask whether DLMs can acquire NTP-style reasoning through distillation without giving up their native generation process. Direct distillation, however, faces a fundamental mismatch: an autoregressive teacher predicts from a left prefix, whereas a DLM can condition on tokens on both sides. We introduce ForkLeft, a distillation framework that resolves this mismatch by separating the student's rollout from teacher supervision. During training, the student first performs entropy-first rollouts that commit uncertain positions and expose potential forks. We then fix the resulting student prefix and distill an NTP teacher under the same context, with answer correctness determining the supervision source. At inference, the student returns to its native confidence-first parallel decoding. With Qwen3-30B-A3B-Base, ForkLeft improves Efficient-DLM-4B on all ten benchmarks, raising MATH500 from 72.60% to 79.60% and consistently outperforming three alternative designs. The gains scale with teacher strength and generalize to SDAR-4B with only $500$ updates. At matched scale, the distilled 4B and 8B students exceed the published SDAR-Chat and OPDLM models on seven benchmarks, showing that DLMs can learn NTP-style reasoning without sacrificing native parallel generation. Code and datasets will be released upon acceptance.

cs.AI↗
arXiv2026

BenchShield: Formal Model-Backed Instrumentation for Reward Integrity in LLM-Agent Evaluation Infrastructure

LM-agent benchmarks increasingly function as interactive evaluation infrastructure. Agents observe state, call tools, modify workspaces, submit artifacts, and receive rewards from outcome procedures. This interactivity makes evaluations vulnerable to reward hacking: an agent improves its measured score by exploiting the reward-relevant trajectory instead of solving the intended task. Existing defenses rely largely on task-specific patches, prompt instructions, or post-hoc detectors. They do not provide reusable evidence that a concrete run remained within its intended evaluation boundary. This paper presents BenchShield, a model-backed instrumentation layer for reward integrity in LLM-agent evaluation. BenchShield grounds detection in a finite lifecycle model of an evaluation's reward-relevant events. Within the benchmark infrastructure, two complementary analyses operate over this model. A static, phase-aware taint analysis exposes reward-hacking paths before a run. Its runtime counterpart uses infrastructure-side evidence to attribute concrete agent use and emit evidence-backed claims. We construct BenchShield Trajectories, a human-labeled corpus of 456 adjudicated trajectories from more than 31,000 public agent runs across three benchmarks. Compared with an agentic hackability scanner baseline on the same tasks and model, BenchShield improves full-chain recall from 23-94% to 77-100%, same-vector coverage from 16-56% to 43-78%, and reduces per-task cost by up to 65%. Its runtime analysis achieves 96% accuracy in detecting reward hacking from infrastructure-side evidence.

cs.CR↗
arXiv2026

Three-Dimensional Fermiology and Thickness-Tuned Magnetotransport in Single-Crystalline Antimony Flakes

The extreme magnetoresistance of compensated semimetals is governed by both the Fermi-surface geometry and carrier relaxation, but these contributions are difficult to disentangle in finite-size structures. Here, we combine longitudinal and Hall magnetotransport measurements with temperature- and angle-dependent Shubnikov--de Haas oscillations in single-crystalline Sb flakes grown by chemical vapor deposition (CVD), with thicknesses ranging from 110 to 783 nm. As thickness increases, the non-saturating MR at 2 K and 14 T rises nearly 30-fold, reaching $7.13\times10^{5}\%$, while the primary frequency $F_α$ remains approximately 99 T without any systematic shift. A joint three-channel analysis of $ρ_{xx}(B)$ and $ρ_{xy}(B)$ reveals that this evolution is driven by an increase in the mobility of a nearly compensated electron--hole pair, rather than by a reconstruction of the primary pockets. Angle-dependent measurements confirm the existence of a closed three-dimensional $α$ pocket, and a reproducible high-frequency sector (335-377 T) is consistent with the electron $β$ orbit of the $L$-point pockets in bulk Sb. Together, the transport and quantum-oscillation results show that thickness tunes extreme MR through dimension-dependent scattering while preserving bulk-like fermiology.

cond-mat.mes-hall↗
arXiv2026

The Greatness of Science Cannot Be Planned: Agentic Auto-Research is Fuzz Testing

Agentic auto-research is emerging, but most systems treat scientific discovery as goal-oriented optimization against a final benchmark. This paradigm rewards a sparse final verdict and ignores the exploration that precedes it. When agents optimize only the final score, they overfit to the test conditions and sample blindly rather than search. Within a declared research problem, a research agent and a greybox fuzzer for software analysis face the same sparse feedback. A fuzzer rarely finds a bug directly, but coverage makes partial progress observable on every execution. Fuzzers use that dense signal to mutate inputs and allocate effort, rather than merely rank completed runs. Auto-research needs the same two capabilities. First, each experiment must expose a cheap, dense signal of epistemic progress before final scientific validation is available. Second, that signal must determine the next intervention so the agent searches rather than repeatedly samples. Because the progress signal provides guidance rather than a final verdict, final validation must still evaluate claims using evidence protected from adaptive reuse. We propose controlled tests to determine whether candidate signals predict validated progress, whether feedback-directed search yields more validated discoveries per unit cost than repeated sampling, and whether protected validation reduces false discoveries. In a simulated physics environment, an AI research agent that tracks its intermediate epistemic progress discovers a hidden physical law. Optimization-driven baselines fail because they repeatedly sample and overfit to their existing data instead of probing unfamiliar regimes. Feedback architecture, not generation capacity, is the central bottleneck in auto-research.

cs.AI↗
arXiv2026

CurveShift: Is Agent Progress Scalar? Separating Level from Shape

Progress in large language models is often summarized using a single scalar measure, such as a time horizon, a latent ability estimate, or an aggregate benchmark score. These summaries capture the overall performance, but they do not test whether progress is distributed differently across task difficulty. We find that most of the apparent shift in gains toward harder tasks does not reflect a change in the shape of the difficulty-response curve. On METR time-horizon data, a single Rasch model with rising ability reproduces this pattern, so it is largely explained by ceiling effects rather than a qualitative change in capability. This echoes how the choice of metric can make claimed emergent abilities look like a property of the models themselves. We then identify a smaller hard-task effect that survives this control. Isolating it is difficult on agentic benchmarks, because newer models are usually run with newer agentic harnesses, so a gain on hard tasks cannot be assigned to the model or its scaffold. We break the confound with LiveCodeBench, a public competitive programming benchmark that runs no agentic scaffold while pairing dated models with an exogenous difficulty ordering. After accounting for the rise in overall ability, models released after September 2024 still gain on the hardest problems beyond what their easy and medium performance predicts, by about +0.40 logits under our most conservative assumption, raising the hard-problem solve rate from roughly 18% to 25%. The effect is led by the strongest reasoning models and holds for hard tasks that need only short reasoning, not autonomy over long horizons. We present this as a result specific to competitive programming, since our clean identification rests on a single coding benchmark. We release the LiveCodeBench Difficulty Panel (66 dated models x 1,055 problems) and our analysis code.

cs.CL↗
arXiv2026

Is Progressive Disclosure All You Need for Long-Context Agents?

Long-document question answering usually forces a choice between loading the whole document into the context window and bolting on a separate retriever. Agentic AI suggests a broader option, giving the agent the document path and letting it decide how and what to read. Agent Skills, a standard for packaging expertise into folders an agent loads on demand, supply a ready mechanism: progressive disclosure, which exposes only what a query needs, from a short description down to the specific passages. Practitioners rapidly adopted this pattern for book-length understanding tasks, but the evidence to support such choices has been anecdotal. We run the first controlled study of the pattern, comparing raw-document navigation and several designs of Agent Skills packs against a classical hybrid retriever across three agent harnesses and three model families on InfiniteBench. On a single book, the gain depends on the harness, running large when the agent navigates the raw document poorly but near zero when a strong agent harness already divides and retrieves on its own. When scaling up to tasks that span many books, raw-document navigation collapses while one-level progressive disclosure degrades more slowly and pulls ahead. A second, deeper routing level never helps and sometimes breaks accuracy outright, so one level is enough. Progressive disclosure buys context, not intelligence: it is redundant while a strong agent can locate the right passages itself, and decisive once the corpus grows too large to navigate by reading.

cs.AI↗
arXiv2026

Code Generation by Differential Test Time Scaling

Test-time scaling has emerged as a promising approach for improving code generation by exploring large solution spaces at inference time. However, existing methods often rely on public test cases that are unavailable in practice, or require extensive LLM inference for candidate selection, leading to significant token consumption and time overhead. We present DiffCodeGen, a novel test-time scaling method for code generation based on coverage-guided differential analysis. DiffCodeGen generates diverse code candidates using various sampling and prompting strategies, then applies coverage-guided fuzzing to synthesize inputs without requiring any existing tests or large language models. By executing all candidates on these inputs, DiffCodeGen captures their dynamic behavior and clusters candidates based on behavioral similarity. DiffCodeGen selects the medoid of the largest cluster as the final output. Unlike prior test-time scaling methods that invoke additional LLM inference for candidate selection, DiffCodeGen performs selection without any extra model calls, incurring little to no additional token consumption. DiffCodeGen is fully asynchronous, naturally suited to the current trend of agentic coding, and is thus efficient and highly scalable. We evaluate DiffCodeGen across 4 large language models, demonstrating consistent improvements over baselines. Compared to state-of-the-art test-time scaling methods, DiffCodeGen achieves competitive or superior performance while using only a fraction of time and tokens. DiffCodeGen is model-agnostic and can be combined with reasoning models to further boost performance.

cs.SE↗
arXiv2026

Unidirectional magnetoresistance driven by nonequilibrium antiferromagnetic magnons

Magnetoresistive effects are typically symmetric under magnetization reversal. However, nonlinear spin transport can give rise to unidirectional magnetoresistance in systems with strong spin-orbit interaction and broken inversion symmetry. Here, we demonstrate that the nonequilibrium magnon accumulation characterized by a finite magnon chemical potential can lead to a large and robust magnonic unidirectional spin Hall magnetoresistance (USMR) in the weakly coupled van der Waals antiferromagnet CrPS4 in contact with Pt. Unlike conventional magnonic USMR driven by magnetization fluctuations, this effect persists under strong magnetic fields and low temperatures, with a pronounced peak near the spin-flip transition. The magnitude of magnonic USMR in CrPS4/Pt exceeds that of YIG/Pt by more than two orders of magnitude and surpasses the electrical USMR in metallic Ta/Co bilayers by a factor of two. The observed field and temperature dependence indicates that spin transport is dominated by magnon chemical potential gradients rather than thermal- or fluctuation-driven magnon generation. These findings establish a new mechanism for nonlinear magnetoresistance in antiferromagnetic van der Waals heterostructures and open a route to magnon-based antiferromagnetic spintronic functionalities in two-terminal device geometries.

cond-mat.mtrl-sci↗
arXiv2026

Magnetic field-induced non-trivial Lifshitz transition in TaCo2Te2

Magnetic-field-driven Lifshitz transitions are typically considered zero-temperature phenomena involving Fermi-surface reconstruction without symmetry breaking. Here, we report an unconventional Lifshitz transition in TaCo2Te2 that emerges exclusively within a narrow finite-temperature window under cooperative tuning by both temperature and magnetic field. Bulk-sensitive transport and thermoelectric measurements demonstrate continuous Fermi-surface renormalization at low temperatures, where the transition is sharply triggered by a critical magnetic field. Crucially, neutron diffraction reveals the absence of structural or magnetic phase transitions, while angle-resolved photoemission spectroscopy shows no spectral anomalies in electronic structure without magnetic field. These observations constrain the mechanism to a Zeeman-driven process invisible to equilibrium probes, establishing a paradigm where Fermi-surface topology is jointly controlled by temperature and magnetic field.

cond-mat.mtrl-sci↗
arXiv2025

FuzzAug: Data Augmentation by Coverage-guided Fuzzing for Neural Test Generation

Testing is essential to modern software engineering for building reliable software. Given the high costs of manually creating test cases, automated test case generation, particularly methods utilizing large language models, has become increasingly popular. These neural approaches generate semantically meaningful tests that are more maintainable compared with traditional automatic testing methods like fuzzing. However, the diversity and volume of unit tests in current datasets are limited, especially for newer but important languages. In this paper, we present a novel data augmentation technique, FuzzAug, that introduces the benefits of fuzzing to large language models by introducing valid testing semantics and providing diverse coverage-guided inputs. Doubling the size of training datasets, FuzzAug improves the performance from the baselines significantly. This technique demonstrates the potential of introducing prior knowledge from dynamic software analysis to improve neural test generation, offering significant enhancements in neural test generation.

cs.SE↗
arXiv2025

Reconfigurable Room Temperature Exchange Bias through Néel Order Switching in van der Waals Heterostructures

Exchange bias effect plays a crucial role in modern magnetic memory technology. Recently, van der Waals magnetic materials have emerged and shown potential in spintronic devices at atomic scale. Owing to their tunable physical properties and the flexibility in fabrication, the van der Waals heterostructures offer more possibilities for investigating potential mechanisms of the exchange bias effect. However, due to low magnetic ordering temperatures for most van der Waals magnets, to establish exchange bias in van der Waals antiferromagnet/ferromagnet heterostructures at room temperature is challenging. In this study, we fabricate (Fe$_{0.56}$Co$_{0.44}$)$_{5}$GeTe$_{2}$(FCGT)/Fe$_{3}$GaTe$_{2}$(FGaT) heterostructures with magnetic ordering temperatures of each component well above room temperature to achieve a room temperature exchange bias effect. It is found that the sign and magnitude of the exchange bias field can be efficiently controlled by manipulating the Néel order of FCGT with magnetic field. The manipulation of Néel order shows significant magnetic field dependence. A strong pre-set field induces a switch in the Néel order of FCGT, which aligns the interfacial magnetization at the FCGT/FGaT interface, leading to robust exchange bias, as revealed by both transport measurements and macro-spin model calculations. Our findings demonstrate the intrinsic manipulation and switchable of room-temperature exchange bias in all-van der Waals heterostructures and further promote the development of novel two-dimensional spintronic devices.

cond-mat.mtrl-sci↗
arXiv2025

Colossal magnetoresistance in a quasi-two-dimensional cluster glass semiconductor

With a surge of interest in spintronics, the manipulation and detection of colossal magnetoresistance in quasi-two-dimensional layered magnetic materials have become a key focus, driven by their relatively scarce occurrence compared to giant magnetoresistance and tunneling magnetoresistance. This study presents an investigation into the desired colossal magnetoresistance, achieved by introducing magnetic frustration through Te doping in quasi-two-dimensional antiferromagnet Cr2Se3 matrix. The resulting Cr0.98SeTe0.27 exhibits cluster glass-like behavior with a freezing temperature of 28 K. Magnetotransport studies reveal a significant negative magnetoresistance of up to 32%. Additionally, angle-dependent transport measurements demonstrate a magnetic field-induced transition from positive to negative resistance anisotropy, suggesting a magnetic field-driven alteration in the electronic structure of this narrow band gap semiconductor, a characteristic feature of the colossal magnetoresistance effect. This behavior is further corroborated by density functional theory calculations. This systematic investigation provides a crucial understanding of the control of colossal magnetoresistance in quasi-two-dimensional materials via competing exchange interactions.

cond-mat.mtrl-sci↗
arXiv2025

Revisiting MnSe : a Magnetic Semiconductor with Spin-Phonon coupling

Spin-phonon interactions in 2D magnetic materials are crucial in advancing next-generation spintronic devices. Therefore, identifying new materials with significant spin-phonon interactions is of great importance. In this context, MnSe, previously recognized as an exemplary non-layered p-type semiconductor emerges in this study as an intriguing material with notable spin-phonon characteristics. The complex magnetism in pristine MnSe, primarily dominated by antiferromagnetism with a weak ferromagnetic component, gives rise to both spontaneous and conventional exchange bias effects at low temperatures. In an effort to understand this intriguing magnetism, we conducted a detailed Raman spectroscopy study, which reveals unconventional deviations from the usual phonon anharmonicity around Neel temperature (170 K), in the self-energies of the P1, P2, and P3 modes. Notably, the P1 mode is most sensitive to spin-phonon coupling, while the P2 mode is particularly responsive to the structural phase transition at 250 K. Therefore, these findings provide comprehensive insights into the phase transitions of pristine MnSe, particularly highlighting the previously unobserved interplay between its magnetic behavior and phonon dynamics.

cond-mat.mtrl-sci↗
arXiv2024

Local Avalanche Photodetectors Driven by Lightning-rod Effect and Surface Plasmon Excitations

Sensitive avalanche photodetectors (APDs) that operate within the ultraviolet spectrum are critically required for applications in detecting fire and deep-space exploration. However, the development of such devices faces significant challenges, including high avalanche breakdown voltage, the necessity for complex quenching circuits, and thermal runaway associated with Geiger-mode avalanche operation. To mitigate these issues, we report on a 4H-SiC APD design utilizing micro-holes (MHs) structures and Al nano-triangles (NTs) to enhance surface electric field driven by strong localized surface plasmon excitations and lightning-rod effect. The device demonstrates a record low avalanche breakdown voltage of approximately 14.5 V, a high detectivity of 7E13 Jones, a nanosecond-level response time, and repeated stable detections without the requirement of a quenching circuit. Collectively, when compared with the conventional wide-bandgap-based APDs, this device achieves a reduction in avalanche breakdown voltage by an order of magnitude and exhibits a substantial increase in detectivity. Consequently, the proposed APD configuration presents a promising candidate for ultraviolet detection and integrated optoelectronic circuits.

physics.optics↗