arXiv subjects

Yiwen Zhang

Publications and source records attributed to Yiwen Zhang.

At least 19 recordsLinked to original sources

arXiv2026

Bezier-Guided Adaptive Flow for Cross-domain Sequential Recommendation

Cross-domain sequential recommendation aims to alleviate data sparsity and cold-start problems by transferring useful preference knowledge across domains. However, users exhibit varying degrees of preference consistency across domains, while existing methods often rely on global alignment objectives or coarse-grained transfer strategies. Such approaches may introduce irrelevant information and provide limited flexibility in adapting semantic representations to individual user preferences. To address these challenges, we propose BGAFlow, a personalized framework that combines state-adaptive semantic evolution with user-specific transfer control. BGAFlow first establishes a shared semantic space through unified dual-domain pretraining with user profiles inferred by a large language model (LLM). Based on latent interest overlap, it then estimates a personalized horizon to determine the appropriate transfer extent for each user. To enable semantic adaptation, BGAFlow constructs a conditional Bezier curve as a geometric reference and learns a residual flow that progressively refines the trajectory based on intermediate preference states. The learned flow incorporates dynamic preference feedback to adjust transfer directions, while recommendation supervision and trajectory regularization encourage effective and smooth adaptation. Extensive experiments on real-world datasets demonstrate that BGAFlow consistently outperforms state-of-the-art baselines, validating the benefits of personalized transfer control and state-adaptive semantic evolution.

cs.IR↗

arXiv2026

The Signs Were Always There: Training-Free Detection and Control in Raw Transformer Dimensions

Because of polysemanticity and superposition, it has been challenging to attribute token understanding and generation to specific neurons or dimensions. Yet the information in the hidden states is so rich that the signs of the residual stream can surface semantic content in early layers and control what the model generates. We call this sign-pattern-driven interpretation approach Bag of Dims (BoD). Using BoD, we read each dimension of the residual stream individually. Since dimensions carry almost no shared information, a concept is simply the set of dimensions that agree in sign. This lets us discover tens to hundreds of thousands of concepts per model without training or labels. A concept is detectable as early as the first few layers, at AUC above 0.9 across the model families we tested, well before the answer it resolves to becomes legible. BoD can therefore screen harmful prompts at prefill, without a trained guard model. The prediction capability of the signs is strong: setting all magnitudes to unity preserves 56-94% top-5 next-token accuracy through the language model head. Flipping a concept's sign pattern during the forward pass suppresses its logits, and a separate training-free intervention steers a chosen concept into generated text. The BoD method depends on the transformers' per-dimension sign pattern, present across the residual stream, attention, and MLP subspaces, rather than on any particular architecture, making it applicable to a wide range of models.

cs.LG↗

arXiv2026

Towards Reconstructing Geographically Diverse Architecture with 3D Foundation Models

Internet-scale photo collections of real-world landmarks have driven progress in 3D computer vision yet remain highly challenging for modern 3D foundation models (3DFMs) that estimate scene structure in a single feed-forward pass. In this work, we introduce ArchWorld, a benchmark of 3D architectural landmarks with high geographic coverage and rich metadata. We use this benchmark to conduct a thorough error analysis of current 3DFMs to understand where they fall short and how they can be improved. We examine socially relevant disparities in model error and find that model performance varies by geographic region; however, unlike typical fairness regimes, the trends only partially match training data representation. Our investigation reveals that the observed geographic disparities reflect not only differences in data representation and scene size but also differences in region-specific architectural features and background distractors that make scenes from different regions inherently vary in difficulty. Leveraging insights from these model failings, we introduce an intervention scheme that improves 3DFM performance while simultaneously reducing geographic disparities.

cs.CV↗

arXiv2026

Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation

Video diffusion models repeatedly process long spatiotemporal token sequences during denoising, making attention a major computational bottleneck. Linear attention offers an appealing alternative and has been widely adopted in recent large language models, but directly applying it to video models often fails to preserve the fine-grained interactions required for high-quality generation. We present Video DeltaNet (VDN), which combines local Softmax attention with bidirectional linear memory for long-range video context. Its linear branch introduces Video Delta Attention (VDA), which updates memory once per frame by jointly incorporating its spatial tokens. Separate output projections and learnable gates calibrate the two branches, while a staged teacher-alignment recipe progressively introduces the new pathway into pretrained models. We instantiate VDN on MiniMax H3, applying the hybrid to video-to-video interactions while retaining Softmax for interactions involving text or audio. With eight-step distillation and an optimized SGLang serving stack, VDN-H3 completes DiT denoising for a 14.3-second, 768p video in 6.70 seconds on eight NVIDIA B200 GPUs, corresponding to a 14.5x speedup over the 50-step dense H3 baseline on the same GPU count. GitHub code available at: https://github.com/OpenVDN/vdn-minimax-h3. Weights available at: https://huggingface.co/OpenVDN/vdn-minimax-h3

cs.LG↗

arXiv2026

MosaiChunk: Compositing Spatio-Temporal Memory for Autoregressive Video Generation

Long-horizon autoregressive video generation is limited by a finite context window. When an object or scene falls out of context, its fine-grained visual details may be lost and difficult to recover upon reappearance. To retain access to such visual details, we introduce MosaiChunk, a spatio-temporal memory mechanism that composes a mosaic of selected historical key-value (KV) entries across space and time. Our approach is motivated by the observation that a frozen video generator can directly consume such non-contiguous historical KV and recover the corresponding visual content. We therefore keep the generator fixed and learn only a lightweight router that determines which historical sections to include in the mosaic under a fixed active-memory budget. We further introduce RememBench, a benchmark of long-horizon revisits with prompt-driven text-to-video (T2V) and camera-driven image-to-video (I2V) splits. Our experiments show that MosaiChunk consistently improves revisit consistency over both sliding-window inference and whole-chunk retrieval under matched memory budgets, across both T2V and I2V settings.

cs.CV↗

arXiv2026

Bond-selective modulation of scalar spin chirality in strained Mn4N

Scalar spin chirality (SSC) underlies a variety of Berry-phase-driven transport phenomena in noncoplanar magnets. Mn4N is a unique ferrimagnetic system in which both collinear and noncoplanar magnetic configurations have been reported at different lattice parameters, featuring vanishing and finite SSC, respectively. However, the microscopic mechanism governing the competition between these magnetic states and the associated modulation of SSC remains unclear. This issue is particularly important for Mn4N because its high magnetic ordering temperature (TN = 740 K) provides an attractive platform for exploring chiral magnetic states and their associated topological functionalities at elevated temperatures. Here, using first-principles calculations, we investigate the strain-driven evolution of the magnetic ground state and SSC in Mn4N and uncover the microscopic origin of the collinear-to-noncoplanar magnetic transition. We demonstrate that tensile strain continuously stabilizes the noncoplanar configuration and enhances SSC, as quantified by the magnitude of the chirality-order vector. Orbital-resolved crystal orbital Hamilton population and charge-density-difference analyses reveal that strain selectively weakens the Mn3c-N hybridization while preserving direct Mn3c-Mn3c interactions, leading simultaneously to the activation of the Mn3c in-plane magnetic moment and the suppression of N-mediated ferromagnetic superexchange between nearest-neighbor Mn3c atoms. This bond-selective electronic response governs the magnetic ground state and consequently controls the emergence and enhancement of SSC in Mn4N. Our work establishes bond selectivity as an effective strategy for engineering SSC in high-temperature ferrimagnetic materials.

cond-mat.mtrl-sci↗

arXiv2026

Symmetric Quantum Latin Squares with Maximal Cardinality

In this paper, we prove that there exist a symmetric quantum Latin square with maximal cardinality of order $n$ for all $n\geq 6$, and a symmetric idempotent quantum Latin square with maximal cardinality of order $4k+2$ for all $k\geq 1$.

math.CO↗

arXiv2026

Effective Ionic Valence and Local Magnetic Moment in Kagome Superconductors

In order to understand the unexpected similarity and the correlated behavior in kagome superconductor families AV$_3$Sb$_5$ (A = K, Rb, Cs) and ATi$_3$Bi$_5$ (A = Rb, Cs), we investigate the Hartree-scale local electronic structure of these systems. Our result indicates that V and Ti ions are both of 2+ valence such that the corresponding itinerant carrier densities are similar, and the difference in electron count is instead reflected in their quantum fluctuating ionic magnetic moments. However, due to the frustrated lattice geometry of these materials, such local moments are difficult to experimentally observe via standard probes. For verification, we systematically introduce nonmagnetic Sn impurities to locally relieve the geometric frustration and experimentally demonstrate the existence of well-defined local magnetic moments via magnetic susceptibility and muon spin rotation or relaxation ($μ$SR) measurements. All experiments discover a systematic increase of magnetic susceptibility upon increasing nonmagnetic impurity level. Our discovered ionic moments suggest a paradigm shift from the existing itinerant carrier-only picture to one incorporating strong correlation from local ionic spins. The associated interatomic and local-itinerant correlations offer a solid ground for the emergence of the observed rich correlated behavior in this new family of superconducting materials.

cond-mat.str-el↗

arXiv2026

Robust Code RL via Faulty-Code-Driven Test case Synthesis and Dense Reward Shaping

Reinforcement Learning from Verifiable Rewards (RLVR) is pivotal for enhancing LLM code generation, yet its efficacy is often hindered by insufficient test case coverage, leading to reward hacking and policy degradation. To address this, we propose RobustTests, a framework featuring a faulty-code-driven test case synthesis strategy. By leveraging "near-correct" faulty codes, RobustTests captures latent logical discrepancies and employs validator agents with behavioral feature clustering to filter invalid or redundant test cases. Additionally, a stepwise dense reward function based on pass rates is introduced to mitigate false negatives and enhance training robustness. Using this pipeline, we construct an augmented version of the CodeContests+ dataset with superior diagnostic utility. Experimental results show that RL fine-tuning of Qwen3-32B via RobustTests achieves a 3% absolute gain on LiveCodeBench, demonstrating its effectiveness in advancing LLM code generation proficiency. Codes and data are available at https://huggingface.co/datasets/sid6/RobustTests.

cs.AI↗

arXiv2026

Preference-Based Self-Distillation: Beyond KL Matching via Reward Regularization

On-policy distillation is an efficient alternative to reinforcement learning, offering dense token-level training signals. However, its reliance on a stronger external teacher has driven recent work on on-policy self-distillation, where the same model serves as both teacher and student under different prompt contexts. Yet, existing self-distillation methods largely reduce learning to KL matching toward the context-augmented teacher model. This approach often suffers from training instability and can degrade reasoning performance over time. Moreover, self-distillation from the same model with prompt augmentation lacks the exploratory diversity provided by a genuine external teacher. To address these limitations, we move beyond fixed-teacher KL matching and propose \textbf{P}reference-\textbf{B}ased \textbf{S}elf-\textbf{D}istillation (\textbf{PBSD}), which revisits on-policy self-distillation through a reward-regularized perspective. Instead of directly matching the teacher distribution, we derive a reward-regularized objective whose analytic optimum is a reward-reweighted teacher distribution, yielding a target policy provably superior to the original teacher under this objective. Practically, PBSD optimizes preference gaps between teacher and student samples while maintaining on-policy student sampling. We support this framework with a statistical analysis of the induced preference-learning problem, formally establishing when on policy self-distillation is preferable to learning from an external teacher in our setting. Experiments on mathematical reasoning and tool-use benchmarks across multiple model scales demonstrate that PBSD consistently achieves the strongest average performance among comparable baselines, showing improved training stability over prior self-distillation baselines while preserving token efficiency.

cs.LG↗

arXiv2026

Multi-dimensional Bias in Modeling Multi-dimensional Preferences: Evaluating the Ability of Synthetic Agents to Replace Human Participants in Conjoint Experiments

Despite growing interest in using LLMs to add robustness or reduce data-collection costs in survey experiments, their efficacy in conjoint design---an increasingly popular method in political science---remains underexplored. This paper addresses that gap by investigating whether synthetic agents can reproduce the multi-dimensional human preference patterns that conjoint is designed to capture. It replicates published conjoint studies and compares the results generated by synthetic agents with original human data along three dimensions: representational correspondence, inferential correspondence, and procedural stability. Our analysis evaluates the alignment of choice distributions as well as the statistical and substantive similarity of estimates, and the results are uneven across these dimensions and studies replicated. This implies that the validity of synthetic participants should be considered claim-dependent and hierarchical. Reproducing a figure or obtaining strong sign agreement is evidence of similar aggregate outputs, but not enough to support replacing human respondents. Our results suggest that the discipline as a whole must first map this innovation's boundaries across various levels before considering synthetic agents a robust substitute for human samples.

cs.MA↗

arXiv2026

An AI Scientist that Doesn't Drift: Taste, Structure, and Falsifiable Findings in a Quadruped Navigation Research Loop

Autonomous research loops driven by large language models can run machine-learning experiments at scale but tend to drift toward local refinements of whichever metric they optimise rather than testing the hypotheses that motivate the experiments. We address this structurally and present an AI Scientist for studying generalisation in quadruped robot navigation policies in simulation. Building on the autoresearch paradigm of Karpathy, our loop adds three components: an immutable experiment card that pairs each iteration's prediction with its outcome under a fixed schema, so a falsified hypothesis cannot be retconned; specialised subagents restricted to mechanical roles; and kkanbu, a preference oracle that holds the user's research taste as a typed knowledge graph and is the only component permitted to make subjective judgements. To isolate the oracle we run the identical loop twice across eleven research streams, with and without kkanbu. Neither arm drifts: both falsify roughly three quarters of their own hypotheses, and the best trained policy comes from the oracle-less arm. What the oracle changes is direction, not score: it alone explores test-time adaptation, it authored the winning designs where its arm led, and it carried lessons across streams that the other arm repeatedly re-derived. The scaffold keeps the loop honest; kkanbu decides where it looks.

cs.AI↗

arXiv2026

UniRank: Benchmarking Ranking Models for Unified Sequential Modeling and Feature Interaction

Ranking is a core stage in online advertising and recommender systems. Modern ranking models increasingly unify sequential modeling and feature interaction, yet many advances rely on proprietary data, closed implementations, and large-scale industrial infrastructure. This setting limits reproducible comparison and hinders academic study of scaling laws, long-sequence modeling, and multi-task ranking. To address these limitations, this paper proposes UniRank, an open benchmark for ranking models that unify sequential modeling and feature interaction. UniRank uses chronological pointwise autoregressive supervision, standardizes evaluation across feedback tasks, and provides a PyTorch toolkit with Distributed Data Parallel training, operator optimization, mixed-precision training, attention optimization, and other efficiency techniques that reduce hardware requirements. We benchmark 15 representative unified ranking models on five large-scale public datasets from short-video, advertising, and e-commerce platforms, with the largest dataset containing over 700 million instances and the longest behavior sequence exceeding 10^5 interactions. UniRank provides a reproducible basis for comparing unified ranking models, studying scaling laws under limited compute, and narrowing the gap between academic and industrial ranking research. We believe UniRank benefits researchers, practitioners, and beginners through reproducible experiments, production-oriented evaluation, and accessible implementations. Code and data are available at https://github.com/salmon1802/UniRank.

cs.IR↗

arXiv2026

Adaptive Fusion Self-supervised Learning for Recommendation

Self-supervised learning (SSL) has recently attracted significant attention in the field of recommender systems. Contrastive learning (CL) stands out as a major SSL paradigm due to its robust ability to generate self-supervised signals. Mainstream graph contrastive learning (GCL)-based methods typically implement CL by creating contrastive views through various data augmentations. Despite these methods are effective, we argue that there still exist several challenges. i) Data augmentation requires additional graph convolution (GCN) or modeling operations, significantly increasing time costs. Moreover, graph augmentation disrupts the intrinsic properties of the user-item graph by randomly removing nodes/edges, while feature augmentation applies noise to all nodes, neglecting their unique characteristics. ii) Existing GCL-based methods use traditional CL objectives to capture self-supervised signals. However, few studies have explored obtaining more beneficial CL objectives from more perspectives and have attempted to fuse the varying self-supervised signals from these CL objectives to enhance recommendation performance. To overcome these challenges, we propose Adaptive Fusion Graph Contrastive Learning (AFGCL) for recommendation. AFGCL exploits structural information naturally produced during graph propagation to construct contrastive representations. Specifically, we introduce an adaptive fusion strategy that estimates the contributions of different propagation depths to the primary recommendation task and adaptively combines their representations. Furthermore, we construct an explicit representation for each observed user--item interaction and propose a fused contrastive objective. Experimental results on three public datasets demonstrate the superior recommendation performance and training efficiency of AFGCL compared with state-of-the-art baselines.

cs.IR↗

arXiv2026

Integrated Terahertz Photonic Receiving Frontend with Link Noise Outperforming Electronics

Terahertz technology is a key enabler for sixth-generation (6G) wireless networks, yet its application is constrained by increasingly severe free-space loss at high frequencies. To efficiently retrieve weak signals at the receiving end, a compact frontend that features both a high-gain antenna and a low-noise signal-detection chain is critical. Current transistor-based THz electronic frontends face significant challenges in meeting these demands because both on-chip antenna efficiency and transistor noise performance degrade rapidly when approaching their cut-off frequencies. Photonic technology provides an alternative solution to circumvent the transistor bandwidth limit, yet most microwave photonic links to date exhibit noise performance substantially worse than state-of-the-art electronics. Here, we demonstrate low-noise integrated THz photonic frontends that deliver undegraded link noise performance across three major THz windows from 140 to 450 GHz, and outperform electronic frontends in the upper two windows. We achieve this through co-design of high-gain on-chip THz antenna array and broadband THz-optic modulator on a single thin-film lithium niobate (TFLN) chip, leading to distributed reception of free-space THz signals and continuous coherent build-up of the THz-optic conversion process with unprecedented efficiency. Combined with an efficient heterodyne detection chain, our integrated frontends exhibit effective isotropic noise figures of 13.6 and 16.2 dB at 250 and 450 GHz, respectively, both setting new benchmarks in their respective bands. We further demonstrate 6G-oriented multi-link communication up to 20 Git/s. Our integrated frontends represent a significant step towards compact, cost-effective and energy-efficient THz wireless systems in 6G and beyond.

physics.optics↗

arXiv2026

Koopman-based NMPC for Virtually Coupled Train Control System

This paper investigates an analytical Koopman-based nonlinear model predictive control (K-NMPC) approach for tracking control of virtually coupled train systems. A nonlinear train movement model incorporating train dynamics, speed and control input limits, passenger comfort constraints, and collision avoidance is systematically lifted into a finite-dimensional Koopman space through closed-form observable functions. After freezing the affine parameter-varying lifted predictor along the shifted predicted trajectory, the online optimal control problem is solved as a quadratic program that can be solved efficiently. The proposed KNMPC is benchmarked against a time-discrete NMPC scheme, demonstrating comparable control performance with significantly reduced online computation time and strong potential for real-time implementation in practical virtually coupled train control systems.

eess.SY↗

arXiv2026

IntElicit: Eliciting and Assessing Contextualized Creativity via Dialogue Policy Optimization

Contextualized assessment offers high ecological validity for evaluating creativity but introduces a critical challenge: observed performance may be confounded with cognitive proficiency (domain knowledge) and agency (willingness to engage). Meanwhile, in the age of generative AI, creative problem solving increasingly occurs in tool-mediated and human--AI interactive environments, making fully static assessment less aligned with contemporary creative practice. To address these issues, this paper proposes IntElicit, a framework for eliciting and assessing contextualized creativity via dialogue policy optimization. IntElicit functions as a constrained adaptive AI Interviewer: it provides non-directive knowledge and agency scaffolds in multi-turn interaction to reduce non-creative confounders, while preserving participants' responsibility for generating the creative content being evaluated. Specifically, to tackle sparse rewards and potential reward hacking (e.g., answer dictation) in open-ended educational dialogue, IntElicit introduces a decomposed process reward mechanism. This mechanism aligns the policy with pedagogical elicitation, rewarding prompts that draw out participant reasoning rather than producing optimal answers on their behalf. Extensive experiments, including participant simulation and a human subject study (N=64), show that IntElicit improves elicited creative outcomes over expert-designed baselines. Together, the results suggest that interactive elicitation can reveal creative potential that static FPSP-style assessment may miss, providing a formative and diagnostic lens for contextualized creativity assessment in AI-mediated learning contexts.

cs.AI↗

arXiv2026

GARL: Game-Theoretic Reinforcement Learning for Multi-Agent Strategic Prioritisation

LLM-based multi-agent systems are increasingly used for strategic decision-making tasks. In such settings, performance depends not only on individual model capabilities, but also on the policies by which agents interact and adapt. Multi-agent reinforcement learning can optimise these interaction policies, but its reward design often remains task-specific and weakly grounded in interaction structure. To address this gap, we propose GARL, a GAme-theoretic Reinforcement Learning framework for multi-agent strategic prioritisation. GARL formalises strategic prioritisation as a two-stage game: competing agents first allocate strategic resources over a shared candidate set, and a higher-level arbiter then produces the final ranking. The resulting game-theoretic utilities are converted into role-specific reinforcement signals, allowing policy optimisation to be guided by structured interaction. We instantiate GARL on issues-in-dispute ranking, where the goal is to prioritise core issues in legal proceedings. Experiments show that GARL improves ranking performance, enables small open-source LLMs to become competitive with a strong closed-source LLM under the same candidate-ranking setting, and yields gains in legal-domain competence and broader strategic decision-making. Overall, GARL demonstrates how game-theoretic interaction structure can be turned into reinforcement-learning objectives, providing a principled approach to policy optimisation in multi-agent strategic prioritisation.

cs.CL↗