arXiv ScienceSearch

arXiv subjects

Jicheng Wang

Publications and source records attributed to Jicheng Wang.

At least 19 recordsLinked to original sources

BenchShield: Formal Model-Backed Instrumentation for Reward Integrity in LLM-Agent Evaluation Infrastructure

LM-agent benchmarks increasingly function as interactive evaluation infrastructure. Agents observe state, call tools, modify workspaces, submit artifacts, and receive rewards from outcome procedures. This interactivity makes evaluations vulnerable to reward hacking: an agent improves its measured score by exploiting the reward-relevant trajectory instead of solving the intended task. Existing defenses rely largely on task-specific patches, prompt instructions, or post-hoc detectors. They do not provide reusable evidence that a concrete run remained within its intended evaluation boundary. This paper presents BenchShield, a model-backed instrumentation layer for reward integrity in LLM-agent evaluation. BenchShield grounds detection in a finite lifecycle model of an evaluation's reward-relevant events. Within the benchmark infrastructure, two complementary analyses operate over this model. A static, phase-aware taint analysis exposes reward-hacking paths before a run. Its runtime counterpart uses infrastructure-side evidence to attribute concrete agent use and emit evidence-backed claims. We construct BenchShield Trajectories, a human-labeled corpus of 456 adjudicated trajectories from more than 31,000 public agent runs across three benchmarks. Compared with an agentic hackability scanner baseline on the same tasks and model, BenchShield improves full-chain recall from 23-94% to 77-100%, same-vector coverage from 16-56% to 43-78%, and reduces per-task cost by up to 65%. Its runtime analysis achieves 96% accuracy in detecting reward hacking from infrastructure-side evidence.

cs.CR

Three-Dimensional Fermiology and Thickness-Tuned Magnetotransport in Single-Crystalline Antimony Flakes

The extreme magnetoresistance of compensated semimetals is governed by both the Fermi-surface geometry and carrier relaxation, but these contributions are difficult to disentangle in finite-size structures. Here, we combine longitudinal and Hall magnetotransport measurements with temperature- and angle-dependent Shubnikov--de Haas oscillations in single-crystalline Sb flakes grown by chemical vapor deposition (CVD), with thicknesses ranging from 110 to 783 nm. As thickness increases, the non-saturating MR at 2 K and 14 T rises nearly 30-fold, reaching $7.13\times10^{5}\%$, while the primary frequency $F_{\alpha}$ remains approximately 99 T without any systematic shift. A joint three-channel analysis of $\rho_{xx}(B)$ and $\rho_{xy}(B)$ reveals that this evolution is driven by an increase in the mobility of a nearly compensated electron--hole pair, rather than by a reconstruction of the primary pockets. Angle-dependent measurements confirm the existence of a closed three-dimensional $\alpha$ pocket, and a reproducible high-frequency sector (335-377 T) is consistent with the electron $\beta$ orbit of the $L$-point pockets in bulk Sb. Together, the transport and quantum-oscillation results show that thickness tunes extreme MR through dimension-dependent scattering while preserving bulk-like fermiology.

cond-mat.mes-hall

The Greatness of Science Cannot Be Planned: Agentic Auto-Research is Fuzz Testing

Agentic auto-research is emerging, but most systems treat scientific discovery as goal-oriented optimization against a final benchmark. This paradigm rewards a sparse final verdict and ignores the exploration that precedes it. When agents optimize only the final score, they overfit to the test conditions and sample blindly rather than search. Within a declared research problem, a research agent and a greybox fuzzer for software analysis face the same sparse feedback. A fuzzer rarely finds a bug directly, but coverage makes partial progress observable on every execution. Fuzzers use that dense signal to mutate inputs and allocate effort, rather than merely rank completed runs. Auto-research needs the same two capabilities. First, each experiment must expose a cheap, dense signal of epistemic progress before final scientific validation is available. Second, that signal must determine the next intervention so the agent searches rather than repeatedly samples. Because the progress signal provides guidance rather than a final verdict, final validation must still evaluate claims using evidence protected from adaptive reuse. We propose controlled tests to determine whether candidate signals predict validated progress, whether feedback-directed search yields more validated discoveries per unit cost than repeated sampling, and whether protected validation reduces false discoveries. In a simulated physics environment, an AI research agent that tracks its intermediate epistemic progress discovers a hidden physical law. Optimization-driven baselines fail because they repeatedly sample and overfit to their existing data instead of probing unfamiliar regimes. Feedback architecture, not generation capacity, is the central bottleneck in auto-research.

cs.AI

CurveShift: Is Agent Progress Scalar? Separating Level from Shape

Progress in large language models is often summarized using a single scalar measure, such as a time horizon, a latent ability estimate, or an aggregate benchmark score. These summaries capture the overall performance, but they do not test whether progress is distributed differently across task difficulty. We find that most of the apparent shift in gains toward harder tasks does not reflect a change in the shape of the difficulty-response curve. On METR time-horizon data, a single Rasch model with rising ability reproduces this pattern, so it is largely explained by ceiling effects rather than a qualitative change in capability. This echoes how the choice of metric can make claimed emergent abilities look like a property of the models themselves. We then identify a smaller hard-task effect that survives this control. Isolating it is difficult on agentic benchmarks, because newer models are usually run with newer agentic harnesses, so a gain on hard tasks cannot be assigned to the model or its scaffold. We break the confound with LiveCodeBench, a public competitive programming benchmark that runs no agentic scaffold while pairing dated models with an exogenous difficulty ordering. After accounting for the rise in overall ability, models released after September 2024 still gain on the hardest problems beyond what their easy and medium performance predicts, by about +0.40 logits under our most conservative assumption, raising the hard-problem solve rate from roughly 18% to 25%. The effect is led by the strongest reasoning models and holds for hard tasks that need only short reasoning, not autonomy over long horizons. We present this as a result specific to competitive programming, since our clean identification rests on a single coding benchmark. We release the LiveCodeBench Difficulty Panel (66 dated models x 1,055 problems) and our analysis code.

cs.CL

Is Progressive Disclosure All You Need for Long-Context Agents?

Long-document question answering usually forces a choice between loading the whole document into the context window and bolting on a separate retriever. Agentic AI suggests a broader option, giving the agent the document path and letting it decide how and what to read. Agent Skills, a standard for packaging expertise into folders an agent loads on demand, supply a ready mechanism: progressive disclosure, which exposes only what a query needs, from a short description down to the specific passages. Practitioners rapidly adopted this pattern for book-length understanding tasks, but the evidence to support such choices has been anecdotal. We run the first controlled study of the pattern, comparing raw-document navigation and several designs of Agent Skills packs against a classical hybrid retriever across three agent harnesses and three model families on InfiniteBench. On a single book, the gain depends on the harness, running large when the agent navigates the raw document poorly but near zero when a strong agent harness already divides and retrieves on its own. When scaling up to tasks that span many books, raw-document navigation collapses while one-level progressive disclosure degrades more slowly and pulls ahead. A second, deeper routing level never helps and sometimes breaks accuracy outright, so one level is enough. Progressive disclosure buys context, not intelligence: it is redundant while a strong agent can locate the right passages itself, and decisive once the corpus grows too large to navigate by reading.

cs.AI

Code Generation by Differential Test Time Scaling

Test-time scaling has emerged as a promising approach for improving code generation by exploring large solution spaces at inference time. However, existing methods often rely on public test cases that are unavailable in practice, or require extensive LLM inference for candidate selection, leading to significant token consumption and time overhead. We present DiffCodeGen, a novel test-time scaling method for code generation based on coverage-guided differential analysis. DiffCodeGen generates diverse code candidates using various sampling and prompting strategies, then applies coverage-guided fuzzing to synthesize inputs without requiring any existing tests or large language models. By executing all candidates on these inputs, DiffCodeGen captures their dynamic behavior and clusters candidates based on behavioral similarity. DiffCodeGen selects the medoid of the largest cluster as the final output. Unlike prior test-time scaling methods that invoke additional LLM inference for candidate selection, DiffCodeGen performs selection without any extra model calls, incurring little to no additional token consumption. DiffCodeGen is fully asynchronous, naturally suited to the current trend of agentic coding, and is thus efficient and highly scalable. We evaluate DiffCodeGen across 4 large language models, demonstrating consistent improvements over baselines. Compared to state-of-the-art test-time scaling methods, DiffCodeGen achieves competitive or superior performance while using only a fraction of time and tokens. DiffCodeGen is model-agnostic and can be combined with reasoning models to further boost performance.

cs.SE

ContractBench: Can LLM Agents Preserve Observation Contracts?

Tool-augmented LLM agents call APIs whose intermediate outputs, such as presigned URLs, session tokens, and OAuth state parameters, are observation contracts: artifacts whose later use is constrained by the external system that produced them. We show that observation contract compliance (preserving the temporal validity and byte-level integrity) is an emergent, regression-prone capability: it is neither guaranteed by general tool-use ability nor consistently improved by larger or newer models. To measure this, we introduce ContractBench, a benchmark of 33 dual-axis tasks that probe two orthogonal failure modes no existing benchmark evaluates: validity failures (using an artifact after expiry) and integrity failures (corrupting an artifact's bytes through the observation-to-action pipeline). Our evaluation is deterministic and programmatic, with a virtual clock controlling time and SHA-256 hashes verifying byte integrity. We assign each outcome a failure label drawn from real-world API specifications. We evaluate 38 models and report four findings: (i) no evaluated model clears 80%, with Claude-Opus-4.6 leading at 77.8%, revealing that current frontier models still fail to comply with observation contracts; (ii) a sharp within-family capability cliff in Qwen 3.5 between 4B (0%) and 9B (56.6%), smoothing to 70.7% at 397B-A17B: what emerges across the cliff is mid-trajectory restraint, not tool-call competence; (iii) non-monotonic scaling across the GPT-5 family: agentic post-training can erode compliance through sycophancy-driven regression; (iv) our failure taxonomy works as an actionable in-context reward signal, yielding +7.1 pp on 42 paired GPT-5.1 failures.

cs.SE

Magnetic field-induced non-trivial Lifshitz transition in TaCo2Te2

Magnetic-field-driven Lifshitz transitions are typically considered zero-temperature phenomena involving Fermi-surface reconstruction without symmetry breaking. Here, we report an unconventional Lifshitz transition in TaCo2Te2 that emerges exclusively within a narrow finite-temperature window under cooperative tuning by both temperature and magnetic field. Bulk-sensitive transport and thermoelectric measurements demonstrate continuous Fermi-surface renormalization at low temperatures, where the transition is sharply triggered by a critical magnetic field. Crucially, neutron diffraction reveals the absence of structural or magnetic phase transitions, while angle-resolved photoemission spectroscopy shows no spectral anomalies in electronic structure without magnetic field. These observations constrain the mechanism to a Zeeman-driven process invisible to equilibrium probes, establishing a paradigm where Fermi-surface topology is jointly controlled by temperature and magnetic field.

cond-mat.mtrl-sci

Unidirectional magnetoresistance driven by nonequilibrium antiferromagnetic magnons

Magnetoresistive effects are typically symmetric under magnetization reversal. However, nonlinear spin transport can give rise to unidirectional magnetoresistance in systems with strong spin-orbit interaction and broken inversion symmetry. Here, we demonstrate that the nonequilibrium magnon accumulation characterized by a finite magnon chemical potential can lead to a large and robust magnonic unidirectional spin Hall magnetoresistance (USMR) in the weakly coupled van der Waals antiferromagnet CrPS4 in contact with Pt. Unlike conventional magnonic USMR driven by magnetization fluctuations, this effect persists under strong magnetic fields and low temperatures, with a pronounced peak near the spin-flip transition. The magnitude of magnonic USMR in CrPS4/Pt exceeds that of YIG/Pt by more than two orders of magnitude and surpasses the electrical USMR in metallic Ta/Co bilayers by a factor of two. The observed field and temperature dependence indicates that spin transport is dominated by magnon chemical potential gradients rather than thermal- or fluctuation-driven magnon generation. These findings establish a new mechanism for nonlinear magnetoresistance in antiferromagnetic van der Waals heterostructures and open a route to magnon-based antiferromagnetic spintronic functionalities in two-terminal device geometries.

cond-mat.mtrl-sci

Reconfigurable Room Temperature Exchange Bias through N\'eel Order Switching in van der Waals Heterostructures

Exchange bias effect plays a crucial role in modern magnetic memory technology. Recently, van der Waals magnetic materials have emerged and shown potential in spintronic devices at atomic scale. Owing to their tunable physical properties and the flexibility in fabrication, the van der Waals heterostructures offer more possibilities for investigating potential mechanisms of the exchange bias effect. However, due to low magnetic ordering temperatures for most van der Waals magnets, to establish exchange bias in van der Waals antiferromagnet/ferromagnet heterostructures at room temperature is challenging. In this study, we fabricate (Fe$_{0.56}$Co$_{0.44}$)$_{5}$GeTe$_{2}$(FCGT)/Fe$_{3}$GaTe$_{2}$(FGaT) heterostructures with magnetic ordering temperatures of each component well above room temperature to achieve a room temperature exchange bias effect. It is found that the sign and magnitude of the exchange bias field can be efficiently controlled by manipulating the N\'eel order of FCGT with magnetic field. The manipulation of N\'eel order shows significant magnetic field dependence. A strong pre-set field induces a switch in the N\'eel order of FCGT, which aligns the interfacial magnetization at the FCGT/FGaT interface, leading to robust exchange bias, as revealed by both transport measurements and macro-spin model calculations. Our findings demonstrate the intrinsic manipulation and switchable of room-temperature exchange bias in all-van der Waals heterostructures and further promote the development of novel two-dimensional spintronic devices.

cond-mat.mtrl-sci

Colossal magnetoresistance in a quasi-two-dimensional cluster glass semiconductor

With a surge of interest in spintronics, the manipulation and detection of colossal magnetoresistance in quasi-two-dimensional layered magnetic materials have become a key focus, driven by their relatively scarce occurrence compared to giant magnetoresistance and tunneling magnetoresistance. This study presents an investigation into the desired colossal magnetoresistance, achieved by introducing magnetic frustration through Te doping in quasi-two-dimensional antiferromagnet Cr2Se3 matrix. The resulting Cr0.98SeTe0.27 exhibits cluster glass-like behavior with a freezing temperature of 28 K. Magnetotransport studies reveal a significant negative magnetoresistance of up to 32%. Additionally, angle-dependent transport measurements demonstrate a magnetic field-induced transition from positive to negative resistance anisotropy, suggesting a magnetic field-driven alteration in the electronic structure of this narrow band gap semiconductor, a characteristic feature of the colossal magnetoresistance effect. This behavior is further corroborated by density functional theory calculations. This systematic investigation provides a crucial understanding of the control of colossal magnetoresistance in quasi-two-dimensional materials via competing exchange interactions.

cond-mat.mtrl-sci

Revisiting MnSe : a Magnetic Semiconductor with Spin-Phonon coupling

Spin-phonon interactions in 2D magnetic materials are crucial in advancing next-generation spintronic devices. Therefore, identifying new materials with significant spin-phonon interactions is of great importance. In this context, MnSe, previously recognized as an exemplary non-layered p-type semiconductor emerges in this study as an intriguing material with notable spin-phonon characteristics. The complex magnetism in pristine MnSe, primarily dominated by antiferromagnetism with a weak ferromagnetic component, gives rise to both spontaneous and conventional exchange bias effects at low temperatures. In an effort to understand this intriguing magnetism, we conducted a detailed Raman spectroscopy study, which reveals unconventional deviations from the usual phonon anharmonicity around Neel temperature (170 K), in the self-energies of the P1, P2, and P3 modes. Notably, the P1 mode is most sensitive to spin-phonon coupling, while the P2 mode is particularly responsive to the structural phase transition at 250 K. Therefore, these findings provide comprehensive insights into the phase transitions of pristine MnSe, particularly highlighting the previously unobserved interplay between its magnetic behavior and phonon dynamics.

cond-mat.mtrl-sci

Local Avalanche Photodetectors Driven by Lightning-rod Effect and Surface Plasmon Excitations

Sensitive avalanche photodetectors (APDs) that operate within the ultraviolet spectrum are critically required for applications in detecting fire and deep-space exploration. However, the development of such devices faces significant challenges, including high avalanche breakdown voltage, the necessity for complex quenching circuits, and thermal runaway associated with Geiger-mode avalanche operation. To mitigate these issues, we report on a 4H-SiC APD design utilizing micro-holes (MHs) structures and Al nano-triangles (NTs) to enhance surface electric field driven by strong localized surface plasmon excitations and lightning-rod effect. The device demonstrates a record low avalanche breakdown voltage of approximately 14.5 V, a high detectivity of 7E13 Jones, a nanosecond-level response time, and repeated stable detections without the requirement of a quenching circuit. Collectively, when compared with the conventional wide-bandgap-based APDs, this device achieves a reduction in avalanche breakdown voltage by an order of magnitude and exhibits a substantial increase in detectivity. Consequently, the proposed APD configuration presents a promising candidate for ultraviolet detection and integrated optoelectronic circuits.

physics.optics

Spin Seebeck in the weak exchange coupled van der Waals antiferromagnet

Spin Seebeck effect (SSE) refers to the creation of spin currents due to a temperature gradient in the magnetic materials or across magnet-normal metal interfaces, which can be electrically detected through the inverse spin Hall effect (ISHE) when in contact with heavy metals. It offers fundamental insights into the magnetic properties of materials, including the magnetic phase transition, static magnetic order, and magnon excitations. However, the SSE in van der Waals antiferromagnet is still elusive, especially across the spin-flip transition. Here, we demonstrate the SSE in the weak exchange coupled van der Waals antiferromagnet CrPS$_4$. The SSE increases as the magnetic field increases before the spin-flip transition due to the enhancement of the thermal spin current as a function of the applied field. A peak of SSE is observed at the spin-flip field, which is related to the magnon mode edges across the spin-flip field. Our results extend SSE research to van der Waals antiferromagnets and demonstrate an enhancement of SSE at the spin-flip transition.

physics.app-ph

RepoGenReflex: Enhancing Repository-Level Code Completion with Verbal Reinforcement and Retrieval-Augmented Generation

In real-world software engineering tasks, solving a problem often requires understanding and modifying multiple functions, classes, and files across a large codebase. Therefore, on the repository level, it is crucial to extract the relevant information to achieve accurate code completion effectively. Existing code completion tools have achieved some success, but they struggle to optimize the retrieval and generation process dynamically. In this paper, we propose RepoGenReflex, a generic, dynamic, effective framework to address this challenge. By leveraging the Retrieval-Augmented Generation (RAG) enhanced with Verbal Reinforcement Learning (VRL), it can dynamically choose the optimal results for repository-level code completion. RepoGenReflex uses Reflector to give directional feedback to the next loop. RepoGenReflex chooses the optimal results stored in the Experience cache based on the RAG-VRL loop. To validate the framework's generalization ability, we propose a new benchmark RepoGenEval, which consists of the latest, high-quality real-world repositories in line completion scenarios. Our experiments demonstrate that RepoGenReflex achieves significant improvements after optimizing the Reflector component, resulting in enhanced accuracy and relevance of code completions. Additionally, RepoGenReflex consistently demonstrates superior performance and effectiveness across standard code completion tasks, highlighting the robustness and adaptability of our framework.

cs.SE

FuzzAug: Data Augmentation by Coverage-guided Fuzzing for Neural Test Generation

Testing is essential to modern software engineering for building reliable software. Given the high costs of manually creating test cases, automated test case generation, particularly methods utilizing large language models, has become increasingly popular. These neural approaches generate semantically meaningful tests that are more maintainable compared with traditional automatic testing methods like fuzzing. However, the diversity and volume of unit tests in current datasets are limited, especially for newer but important languages. In this paper, we present a novel data augmentation technique, FuzzAug, that introduces the benefits of fuzzing to large language models by introducing valid testing semantics and providing diverse coverage-guided inputs. Doubling the size of training datasets, FuzzAug improves the performance from the baselines significantly. This technique demonstrates the potential of introducing prior knowledge from dynamic software analysis to improve neural test generation, offering significant enhancements in neural test generation.

cs.SE

Formation of bound states in the continuum in double trapezoidal grating

In the field of optics, bound state in the continuum (BIC) has been researched in many photonic crystals and periodic structures due to a strong resonance and an ultrahigh Q factor. Some designs of narrowband transmission filters, lasers, and sensors were proposed based on excellent optical properties of BIC. In this paper, we consider symmetrical rectangular grating structure firstly, then cut off the corner of one of the gratings, the Fano peak of quasi-BIC can be observed in the spectrum. After that, we further change the tilt parameter of the other grating, which minimizes the Fano line width. In the momentum space, the process of structural change corresponds to topological charges split from q=1 into two half charges q=1/2.We analyze guided mode resonance (GMR) excitation of the grating structure, and discuss the dispersion relations in the waveguide layer with the position of BIC in energy bands. In addition, the reflectance spectrum is found to exhibit asymmetric line-shapes with different values of the asymmetry parameters, M1 and M2. BIC is transformed into quasi-BIC as the symmetry of the structure is broken. This work demonstrates a double trapezoid structure with strong resonance properties, which has significant implications for exploring the phenomenon of BIC.

physics.optics

Designing Few-layer Graphene Schottky Contact Solar Cell: Theoretical Efficiency Limits and Parametric Optimization

We theoretically study the efficiency limits and performance characteristics of few-layer graphene-semiconductor solar cells (FGSCs) based on a Schottky contact device structure. We model and compare the energy conversion efficiency of various configurations by explicitly considering the non-Richardson thermionic emission across few-layer graphene/semiconductor Schottky heterostructures. The calculations reveal that ABA-stacked trilayer graphene-silicon solar cell exhibits a maximal conversion efficiency exceeding 28\% due to a lower reversed saturation current when compared to that of the ABC-stacking configuration. The thermal coefficients of PCE for ABA and ABC stacking FGSCs are -0.064\%/K and -0.049\%/K, respectively. Our work offers insights for optimal designs of graphene-based solar cells, thus paving a route towards the design of high-performance FGSC for future nanoscale energy converters.

physics.app-ph