arXiv Science⌕ Search

arXiv subjects

Chao Yang

Publications and source records attributed to Chao Yang.

At least 19 recordsLinked to original sources

Better Rankers, Worse Retrievers: The Hidden Cost of RL Post-Training in Generative Recommendation

Generative recommenders decode the semantic ID of a user's next item with a language model, and post-training them with reinforcement learning (RL) after supervised fine-tuning (SFT) has become standard practice. The gains are mostly reported on the first ten results, yet in deployment such models hand hundreds of candidates to a downstream ranker or reward model. We show that RL post-training has a hidden cost: it improves accuracy at the top of the list (hit@K for small K) but, on all five datasets we study, lowers the recall of the candidate list (hit@K for K in the hundreds). The model becomes a better ranker and a worse retriever. Controlled experiments trace the loss to the negative advantages that RL assigns to the candidates it samples, the rollout. The root cause is that only one next item is logged per user, so RL treats every other candidate as wrong. Yet these candidates are the model's most plausible alternatives, and often the next items of other users with similar histories. Penalising them pushes down exactly what similar users choose next, and these items drop out of those users' candidate lists. This diagnosis points directly to a remedy: out-of-rollout anchoring, a single additional loss term that preserves the SFT model's ordering of the items outside the rollout. It keeps the gain at the top and restores recall to the SFT level on all five datasets, and it is effective under other RL configurations as well. To our knowledge, this is the first systematic study of this recall loss: we measure it, identify its cause, and show that, once the cause is known, a simple remedy suffices.

cs.IR↗

We Are What We Remember: Mental-State-Driven Memory for Long-Term Character Dialogue

Shared history in human dialogue is not merely a repository of facts, but the foundation of evolving relationships and mutual understanding. However, mainstream conversational memory systems rely on passive semantic similarity over external fact stores, frequently retrieving topically similar records while missing relationally pivotal experiences. Inspired by cognitive psychology's Self-Memory System (SMS), we propose MindMem, a mental-state-driven memory framework that asynchronously consolidates shared experiences into source-linked mental states of the character, the user, and their relationship. At each turn, a specialized mental-state reasoner (Mind) contextualizes these persistent states to anticipate latent user needs, form proactive intentions, and recover supporting episodic evidence that surface-level matching overlooks. To evaluate history-sensitive adaptation beyond factual recall, we introduce MemReal-Bench, a longitudinal benchmark grounded in month-long real-user interactions across dyadic and group scenes. By pairing Direct Question Answering (DQA) with Situated Memory Realization (SMR), it tests whether agents bridge the gap between knowing past facts and naturally using shared history, world rules, and relational trajectories. On MemReal-Bench, MindMem reaches 59.03% SMR and 82.58% DQA, exceeding the strongest memory baseline by 24.19 and 9.19 percentage points, respectively, and outperforming oracle target-memory injection on SMR. Code and dataset are available at https://github.com/jiazhicheng7-ctrl/MindMem.

cs.CL↗

Representability of Intertwining Operators for Weak Modules of Vertex Operator Algebras

Let $V$ be a vertex operator algebra. For every weak $V$-module $W$, we construct a weak $V \otimes V$-module $\mathcal{R}(W)$ representing the bifunctor $\mathcal{I}\binom{W}{-\;-}$ of intertwining operator spaces, in the sense that there exists a natural isomorphism \[ \mathcal{I}\binom{W}{-\;-} \cong \Hom_{V\otimes V} \ab\big(-\otimes -, \; \mathcal{R}(W)). \] As applications of this natural isomorphism, we first establish a Yoneda-type lemma for spaces of intertwining operators, and then identify the unique largest locally restricted submodule $\mathcal{R}_{\lr}(V^\prime)$ of $\mathcal{R}(V^\prime)$ with the coend of the bifunctor $-\otimes-^\prime$: \[ \mathcal{R}_{\lr}(V^\prime) \cong \int^{M} M \otimes M^\prime, \] where $M$ ranges over restricted $V$-modules. Finally, the connection between $\mathcal{R}(W^\prime)$ and the regular representation $\mathfrak{D}_ξ(W)$ constructed in \cite{Li02} is established, where $ξ\in \C^{\times}$. In particular, if $V$ is a $C_2$-cofinite vertex operator algebra and $W$ is a restricted $V$-module, then $\mathcal{R}(W^\prime)$ is also a restricted $V \otimes V$-module and is canonically isomorphic to $\mathfrak{D}_ξ(W)$.

math.QA↗

Sage-Taiyi: A Metacognitive Architecture for Scientific Discovery

We introduce Sage-Taiyi, a metacognition-inspired architecture that uses accumulated scientific understanding to guide what to investigate next and how to investigate it. Through explicit monitoring and control, the system revises its understanding of evidence, assumptions, and unresolved questions, then uses these assessments to adapt research targets and select reusable reasoning methods. On Taiyi-Bench, an AI co-scientist ideation benchmark comprising 265 tasks from 50 papers across ten disciplines, Sage-Taiyi ranks first on all eight metrics of historical rediscovery and open-ended ideation, achieving an Overall score of 54.0 compared with 47.9 for the strongest baseline, AI Scientist-v2. It also performs well on two external scientific ideation benchmarks. Five expert-guided collaborations further connect its proposals to experimental and computational validation across chemistry, materials science, and engineering. In chemistry, reaction-condition optimization raises the yield of cobalt-catalyzed carbonylation from trace amounts to 84% and photocatalytic allylic amination from 13% to 69%. These results support metacognitive regulation as an approach to scientific ideation and its progression toward practical validation.

cs.AI↗

Well-posedness for $p(x)$-Laplacian parabolic equations under a multiple-regime setting on an annulus

This paper proposes an energy-variational framework for the well-posedness of the initial boundary value problem of the parabolic equation with variable exponents on an annulus, under the multiple-regime setting consisting of the subcritical, critical and supercritical regimes of the variable exponents. The multiple-regime setting leads to the appearance of the critical and supercritical regions of positive measure, which cause the failure of the classical Sobolev embedding and the lack of compactness. To address the challenges posed by multiple regimes to well-posedness within the energy framework, we recover the compact Sobolev embedding for a class of radially symmetric functions by the Strauss inequality and obtain the local existence of the solution via the combination of the subdifferential technique and the Principle of Symmetric Criticality for any given radially symmetric initial data. Additionally, the uniqueness result is also given with the recovered Sobolev embedding. Moreover, examining the impact on well-posedness of solutions caused by the variable exponents crossing three sensitive regions, we establish a variational structure of the potential well theory for the evolution equation under the multiple-regime setting on the annulus. For subcritical and critical initial energy levels, we consider the non-positive and positive initial energy cases separately. We obtain the finite-time blow-up of the solution with non-positive initial energy and the threshold condition for global existence and finite-time blow-up of the solution with positive initial energy. For supercritical initial energy level, several sufficient criteria for the global existence and finite-time blow-up of the solution are given. Finally, the above results, including global existence and finite-time blow-up, are generalized to a more general locally symmetric domain containing an annulus.

math.AP↗

Semilinear Schrödinger equation with harmonic potential and combined power-type nonlinearities

We study the Cauchy problem for the semilinear Schrödinger equation with a harmonic potential and combined power-type nonlinearities. The goal is to classify initial data that lead to either global existence or blowup solutions by using an enhanced cross-constrained variational theory. First, we review and analyze this variational approach, pinpointing the main issue for our specific problem. We then introduce new variational structures by carefully selecting terms in the energy functional and adjusting their weights, enabling us to create eight cross-constrained variational combinations and related manifolds to distinguish initial data that result in global solutions or finite-time blowup. Using these structures, we examine three initial energy levels: negative, non-negative low, and high energy. Notably, we prove that for any initial data with negative energy, solutions blow up in finite time regardless of their size. Throughout the study, we utilize these new variational frameworks and functionals to systematically classify initial data for global existence or finite-time blowup. We highlight the comprehensiveness of our approach as we analyze numerous combinations of the energy and mass terms, despite the complexity involved. Interestingly, we find that when initial energy is minimized, classifications based on different functionals coincide. For high initial energy, an unresolved issue even for the standard Schrödinger equation, we develop a strategy controlling bounds of energy to classify the solution dynamics, including global existence or blowup, for our model. We also provide a complete proof for the standard case addressing this open problem.

math.AP↗

Realization of a Superleak in a Quantum Gas

Ultracold quantum gases offer a controllable and microscopically accessible platform for understanding and engineering superfluidity. Yet, realizing a superleak that selectively transports the superfluid while suppressing normal flow has remained elusive. Here, we harness an optical superlattice to realize such a superleak through dynamical selectivity. The superfluid undergoes coherent Josephson transport, whereas the normal component exhibits slow, thermodynamically limited response, resulting in a flow-rate contrast of 500(49). Exploiting this contrast, we demonstrate repeated filtering of the normal component and dynamical purification of the superfluid, while sustaining coherent driven oscillations for up to 100 cycles. Our results establish a controllable atomic superleak and open possibilities for manipulating transport and thermodynamics in quantum fluids.

cond-mat.quant-gas↗

Sage-A1.5: From Long-Horizon Execution to Scientific Exploration with Capability Composition

In this report, we introduce Sage-A1.5, a 35B Mixture-of-Experts agentic model that builds on A1 to advance long-horizon problem solving through adaptive capability composition. Compared with A1, Sage-A1.5 learns not only to solve individual tasks, but also to organize work and revise its approach during execution. Sage-A1.5 highlights three improvements: agentic orchestration, verification, and open scientific discovery. First, agentic orchestration extends single-agent execution through task delegation and parallel collaboration among subagents with isolated contexts, enabling complex tasks to be decomposed and addressed concurrently and supporting efficient execution while reducing interference across concurrent subagents. Second, agentic verification strengthens long-horizon reliability through progress checking, evidence validation, and reflective strategy revision, allowing the agent to recognize unproductive search paths and pursue alternative approaches. Third, open scientific discovery extends agentic capabilities beyond answering predefined questions to conducting exploratory research, connecting scientific inquiry with interactive analysis and inspectable research artifacts. We showcase these capabilities through complicated agentic tasks and multidisciplinary scientific applications. Besides, we hope Sage-A1.5 provides the community with an accessible foundation for open scientific discovery, offering a practical path from long-horizon task execution to collaborative, verifiable, and inspectable scientific exploration.

cs.AI↗

PowerAtlas: Feasibility-Aware Language Models for Electricity-Computing Co-Scheduling

Electricity-computing co-scheduling (ECCS) decides where and when computing tasks run together with how generators are dispatched, because task placement changes nodal demand while power availability determines whether tasks can be served. Prior work addresses such coupled problems with optimization or learned controllers, and large language models (LLMs) are increasingly used to generate structured decisions for scheduling and power systems. Solver runtimes vary across instances, and LLM outputs that parse correctly can still violate grid and service constraints. We formalize ECCS as a structured decision task and release ECBench, 2,000 instances with Gurobi-optimal reference schedules and executable checks for grid limits, task service, cost, and latency. We propose PowerAtlas, which trains an LLM with supervised initialization and Feasibility-Aware GRPO on deterministic scorer feedback, and generates the joint schedule in a single response without solver calls or retrieval. On 10-40 paired instances per backbone, selected PowerAtlas checkpoints lower violations by 89-98% and penalized cost by up to 26x relative to base models, with residual supply deficits. Code and data are available at https://github.com/JAVA-Jiang/PowerAtlas.

cs.LG↗

Virtual Head Attention

The design of attention mechanisms in long-context large language models faces an ``impossible triangle'' among KV cache size, training and prefill FLOPs, and model quality. GQA achieves strong quality but incurs high KV cache overhead; alternative approaches such as MLA and MFA can compress the cache, but MLA suffers from quality loss while MFA substantially increases training and prefill compute. We propose Virtual Head Attention (VHA), which simultaneously improves all three vertices through two lightweight linear operations: Q Premix applies a near-identity transformation to queries within each KV group to recover virtual head diversity from halved physical query heads, and Linear Postmix fuses inter-head features via a low-rank $I + AB^\top$ residual structure. Since VHA introduces no nonlinear operations, Premix can be folded into the query projection and Postmix into the output projection at inference time, reducing the model to a standard GQA-2 architecture that directly reuses all existing GQA inference optimizations. With only two KV heads, the group size in large models readily reaches 64, fully exploiting Tensor Core parallelism during decoding. Across four scales with 4K-context 50B-token pretraining, VHA consistently surpasses the standard GQA baseline at every scale ($+$0.05\% to $+$0.81\%), while reducing KV cache by $4\times$ vs.\ GQA-8 at dense scales and $2\times$ vs.\ GQA-4 at the MoE scale, and lowering training and prefill FLOPs by 7.9\% (1.7B, $S{=}4096$). On an industrial 30B-A3B MoE model trained on 500B tokens at 8K context, VHA outperforms both MLA and GQA-4 by $+$0.70\,/\,$+$2.60\,\% on a 12-benchmark base-model evaluation suite; in a separate matched 10B-A1B MoE comparison after long-context mid-training, VHA attains an average RULER score of 84.4 over 8K--128K versus 73.0 for GQA, while using two rather than four KV heads in the full-attention layers.

cs.CL↗

$T$-efficient unitary synthesis via block-sparse Hamiltonian simulation

We construct Clifford+$T$ circuits implementing arbitrary $n$-qubit unitaries with worst-case $T$-count $\widetilde{O}(N^{8/7})$ at constant operator-norm error, where $N=2^n$, improving the previous exponent $5/4$. The construction uses $\widetilde{O}(N^{6/7})$ clean ancillas. The main idea is to reduce the data addressed by each query to the block-encoding circuit for a sparse piece while controlling the additional simulation work needed to combine the pieces. We simulate a Hermitian logarithm of the target by flattening its traceless part with a two-layer random similarity transformation, randomly partitioning the transformed generator into block-sparse Hermitian pieces, and combining their evolutions using qDRIFT. For a target operator-norm error $ε\in(0,1/2)$, let $L=\log_2(N/ε)$, the qubit count plus the requested bits of accuracy. By successively correcting the approximation error, we obtain a circuit using $\widetilde{O}(N^{8/7}L^{3/7}+NL)$ $T$ gates and $\widetilde{O}(N)$ clean ancillas whenever $L\le N$. We also prove that, at constant precision, the exponent $8/7$ is optimal within a sequential block-SELECT model.

quant-ph↗

Subliminal Learning as Trait-Direction Drift: A Mechanism and Targeted Control under SFT Distillation

Beyond intended capabilities, model distillation can transfer hidden traits from a teacher. A teacher biased by a system prompt can generate semantically clean training data, such as numeric sequences, that still causes a downstream student to inherit the hidden preference, a phenomenon known as subliminal learning. Prior work has identified several parts of this process. How the signal builds up during training and produces behavioral transfer remains unclear, making targeted mitigation difficult. We propose and validate trait-direction drift as a mechanism for subliminal learning: biased generation creates measurable preference gaps in teacher data, and student-recognizable gaps induce trait-aligned updates during supervised fine-tuning that accumulate into behavioral transfer. Guided by this mechanism, we propose probe-space corridor regularization, a targeted defense that constrains drift along a calibrated trait direction during distillation. The method substantially reduces hidden-trait transfer, preserving task performance: for example, it lowers malicious-response transfer from 29.55% to 6.45% with low main-task accuracy cost, and consistently suppresses animal-preference transfer across the main Qwen setting. The preference-gap, training-trajectory, and intervention evidence links subliminal learning to trait-direction drift and motivates corridor regularization as a targeted control during distillation.

cs.LG↗

Learning Holistic Scene Layout against View Shifts in Cross-View Geo-Localization

Cross-view geo-localization remains challenging due to drastic appearance variations and geometric distortions caused by viewpoint changes. Existing methods primarily rely on discriminative feature learning or explicit geometric alignment, yet often overlook an important observation: humans tend to match scenes by integrating the spatial context of multiple landmarks rather than relying solely on isolated local visual cues. Inspired by this, we propose a Spatial Context Modeling (SCM) module, which traverses feature maps along four orthogonal directions and models interactions among the resulting directional representations at each spatial position. By aggregating complementary directional observations, SCM constructs richer scene layout representations. Since reliable spatial context depends on robust visual features, we introduce a High-Frequency Information Guidance (HFIG) module that extracts stable structural cues from the frequency domain. By emphasizing edges and contours that are less sensitive to appearance variations, HFIG encourages the model to learn more robust representations. Extensive experiments demonstrate that our method achieves competitive performance on standard cross-view geo-localization benchmarks while exhibiting strong robustness under more challenging scenarios with unknown orientations and limited fields of view (FoVs).

cs.CV↗

A hybrid method for quantum dynamics simulation

We propose a hybrid approach to simulate quantum many-body dynamics by combining Trotter-based quantum evolution with classical dynamic mode decomposition. In quantum simulation, the interest often lies in estimating observables rather than explicitly obtaining the wave function. Instead of characterizing a quantum state, our method predicts observables of the quantum state at later times by using data from a set of short-time measurements from a quantum computer. For a fixed set of measurements, the global error bound for our method scales at most as $\mathcal{O}(t^{3/2})$, with constants determined by the DMD approximation error and the conditioning of the learned modes. We apply our method to quench dynamics in the Hubbard model and nearest neighbor spin systems and show that the observable properties can be predicted up to a reasonable error by controlling the number of data points obtained from the quantum measurements.

quant-ph↗

When History Misleads: Asymmetric Margin Supervision for Instruction-Guided LLM Generative Recommendation

In instruction-guided generative recommendation, LLM-based recommenders need to balance two goals: responding to the user's current request and aligning with the preferences in their interaction history. When the two conflict, history events can override the request. We show that turning the effect of individual history events into supervision faces two obstacles. First, the events that most influence a recommendation are not necessarily the ones that support the target item. Second, removing a misleading event can raise the target's score but a competing item's score even more, so a higher target score alone does not guarantee a better ranking. We propose Asymmetric Intervention-Guided Margin Supervision (AIMS), which converts the effect of removing individual history events into ranking supervision. For training requests already ranked correctly, a frozen reference model identifies request-specific deletions that improve both the target's score and its margin over a competitor near the recommendation cutoff. These margins serve as training targets, while the complete history is retained as input. Training combines cross-entropy with an asymmetric auxiliary loss that penalizes margin shortfalls and routes its gradient only through the competitor score. Inference is unchanged, requiring no history editing or deletion search. Across six LLM backbones on an industrial dataset and two public benchmarks, AIMS improves Recall and NDCG over strong baselines. Ablations support request-specific margins and asymmetric supervision, and the selected deletions preferentially remove constraint-violating history.

cs.IR↗

Exponentially Compressed and Garbage-Free Alias Sampling for Polynomial State Preparation

Coherent alias sampling implement an important subroutine for block encoding and qubitization based quantum simulation using quantum lookup table. Related constructions exploit data lookup and matrix structure to implement block encodings for use in quantum singular value transformation. For a state on $n$ qubits, constructing and storing the alias table requires both classical and quantum resources exponential in $n$. We show that when the amplitudes are samples of a polynomial of degree at most $d$, the table can be represented and evaluated coherently with cost polynomial in $n$, $d$, exponentially reduced from $Θ(2^n)$ classical and quantum cost. We construct a quantum circuit for coherently computing the alias table for polynomial states using reversible integer arithmetic. By employing fast arithmetic, we construct a deterministic circuit for preparing polynomial states over Clifford+$T$ with a complete gate count of $\tilde{O}(ndB+B^2)$, where arithmetic width $B=\tilde{O}(dn+d\log(d+1))$. In the high precision limit for state fidelity $ε$ with fixed $n$ and $d$, it is sufficient have $B=Θ(\log(1/ε))$ and the complete gate count becomes $O(\log^3(1/ε)\log\log(1/ε))$. Additionally, the effective representation of the alias table can also be used for classical sampling algorithms. Furthermore, we develop a novel technique for uncomputing the auxilary register generated by coherent alias sampling. This technique opens a research direction in sampling based initial state preparation.

quant-ph↗

Beyond Model Ranking: Regime Diagnosis for Distributional-Statistical Misspecification in Industrial Time-Series Forecasting

Time-series forecasting models achieve strong benchmark performance but exhibit severe systematic bias in industrial deployments. This train--deploy gap is conventionally attributed to temporal-structural errors or distribution shifts. We characterize a complementary source that these explanations overlook: canonical losses embed fixed statistical priors, while industrial demand mixes benign and pathological regimes---zero-inflation, skewness, high variability---in which these priors are systematically violated. The induced bias persists even under perfect temporal modeling, remains in a distributional-shape component that normalization cannot remove, and creates an aggregation trade-off invisible to aggregate metrics. We turn these observations into an evaluation toolkit centered on the Regime-wise Relative Bias Vector (RBV): a metric-agnostic, regime-decomposed diagnostic that audits how pooled training allocates systematic mismatch across pathological subpopulations. A controlled attribution analysis decomposes RBV into a model-independent intrinsic floor, set by each loss's estimand, and an excess component attributable to training, tracing observed bias to the loss rather than the model. A large-scale study---13 loss objectives, 3 seeds, 60,000+ series spanning RetailShiftBench and M5, with random-split controls---shows that regime-aware diagnosis separates optimization-type from bias-type failure, and that regime-aware training resolves the pooling-induced bias that capacity scaling cannot, for mean-type losses. A formal structural observation, that risk under evaluation-distribution contamination is affine in the pathology mixture weight, grounds these findings. Our work complements model ranking with mechanism-grounded, regime-oriented evaluation.

cs.LG↗

The Physical Origins of Scatter in the Dust Attenuation Scaling Relation of Star-Forming Galaxies: Star--Dust Geometry

Characterising the physical drivers of dust attenuation in star-forming galaxies (SFGs) is essential for interpreting their spectral energy distributions and star formation histories. The infrared excess (IRX$\equiv$$L_{\rm IR}/L_{\rm UV}$) follows a universal scaling relation with metallicity, star formation rate, galaxy size, and inclination. However, the origin of the scatter around this relation remains poorly understood. We revisit this relation using $\sim$32,000 local SFGs from SDSS, GALEX, and WISE, and investigate why some galaxies deviate systematically from the best-fit relation. We find that the deviations are systematically linked to UV luminosity. UV-faint SFGs ($\log(L_{\rm UV}/{\rm L}_\odot)\le 9$) exhibit a median IRX excess of +0.23 dex, while UV-bright SFGs ($\log(L_{\rm UV}/{\rm L}_\odot)\ge 10$) show a median deficit of $-$0.20 dex relative to the relation defined by the dominant UV-intermediate population (86.38 percent of the sample). These offsets are not driven by metallicity, total infrared luminosity, or specific star formation rate. Instead, the deviations are closely linked to systematic differences in star--dust geometry. UV-faint SFGs are compact (median $R_{\rm e} = 2.90$ kpc) and preferentially viewed edge-on (median $b/a = 0.41$), leading to high effective dust column densities along the line of sight. UV-bright SFGs are extended (median $R_{\rm e} = 5.99$ kpc) and preferentially viewed face-on (median $b/a = 0.74$), allowing UV photons to escape efficiently. Galaxies with significant bulge components ($B/T > 0.4$) populate the envelope of the relation, exhibiting larger scatter. We conclude that the scatter in the IRX relation can be largely explained by variations in the three-dimensional star--dust geometry, with UV luminosity acting as an effective tracer of these geometric and physical differences.

astro-ph.GA↗