arXiv subjects

Yiwen Chen

Publications and source records attributed to Yiwen Chen.

At least 19 recordsLinked to original sources

arXiv2026

Motion-guided Contrastive Regularization For Latent World Models

JEPA-style world models learn action-conditioned latent dynamics without reconstructing observations, but distributional regularization alone does not ensure that their representations preserve information needed for control. We identify static collapse, a failure mode in which the encoder preserves episode-specific static content while suppressing manipulation-relevant state changes. Because static content is temporally predictable yet diverse across episodes, this failure can persist despite regularizers such as SIGReg. A controlled study on OGBench-Cube shows that introducing randomized backgrounds substantially degrades planning performance while leaving the underlying manipulation task unchanged. To address this problem, we propose motion-guided contrastive regularization. Our approach compares predicted latent transitions with transitions to candidate observations from the same episode, reducing the usefulness of static background identity for distinguishing action outcomes. Optical-flow similarities provide soft contrastive targets, allowing candidates with similar motion to receive similar supervision. Combined with latent prediction and SIGReg, our objective encourages representations to preserve within-episode state distinctions and similarities between related transitions. Our method improves planning success over LeWorldModel (LeWM) from 52% to 78% on OGBench-Cube with randomized backgrounds and from 14% to 54% on LIBERO-Object, while maintaining comparable performance on four other visual-control benchmarks.

cs.CV↗

arXiv2026

VidEdit3D: Flexible 3D Gaussian Editing with Video Diffusion

Recent advancements in text-guided 3D editing, particularly with 3D Gaussian Splatting (3DGS), have shown promise but still lag behind the flexibility of 2D editing tools. Existing methods face a critical trade-off between preserving multi-view consistency and allowing structural modifications. Image-based editors can also struggle to apply the intended edit to objects viewed from unusual angles. To address these limitations, we introduce VidEdit3D, a framework that reformulates 3D scene editing as a trajectory-based video editing task. By drawing a parallel between camera movement in static 3D scenes and temporal dynamics in video, we leverage the robust spatiotemporal priors of pre-trained Video Diffusion Models (VDMs) to encourage semantic and structural coherence across views. Specifically, we propose Trajectory-Guided Rendering (TGR) to select informative keyframes and construct smooth video clips aligned with VDM input requirements. To propagate edits from an anchor view to these clips, we develop Flow-Aligned Video Editing (FAVE), a training-free framework incorporating an Editing Consistency Guidance (ECG) mechanism. ECG contrasts source and edited image conditions at a shared latent state, using scheduled source-image amplification to strengthen adherence to the edited reference while maintaining original scene context. Finally, we introduce Region-Selective 3DGS Refinement (RS-GS) to strictly confine geometric and appearance updates to target primitives, reducing background attribute leakage. Experiments demonstrate stronger instruction alignment and better multi-view consistency than the baselines.

cs.CV↗

arXiv2026

Random-subspace Ellipsoidal Trust-region Methods for Derivative-free Optimization

Random-subspace model-based methods offer a promising approach to solving derivative-free optimization (DFO) problems in high dimensions. However, the usual ratio of actual to predicted reduction assesses model agreement at the trial point without directly measuring subspace quality. An accurate prediction in a poorly aligned subspace may therefore trigger trust-region expansion in all directions. We introduce Random-subspace Ellipsoidal TRust-region Optimization (RETRO), a framework for unconstrained DFO using ellipsoidal trust regions. Its trust-region updates combine global size changes with additional expansion or contraction within the sampled subspace, reflecting where the trial step was computed. We define an ellipsoidal subspace alignment measure that accounts for both the subspace and trust-region shape, and analyze Haar-uniform sampling and metric-guided sampling based on the current shape matrix. We establish almost-sure first-order liminf convergence and an $\mathcal{O}(ε^{-2})$ bound on the expected number of iterations required to reach an iterate with gradient norm at most $ε$. Numerical experiments on projected low-rank problems in dimension $1000$ show that using ellipsoidal shape information in subspace selection can reduce function evaluation costs relative to ball-based QARSTA, with the most pronounced improvements occurring when the solver subspace dimension matches the projection rank.

math.OC↗

arXiv2026

Surrogate-Assisted Estimation of Exposure-Time Effects in Stepped-Wedge Trials with Administratively Censored Outcomes

In stepped-wedge trials, effects often change with the time since a cluster crossed over, and a delayed primary outcome is administratively censored for clusters that cross over late. The design couples them: long exposure times occur only in the last periods, where censoring is heaviest. We study exposure-time-specific effects when a short-term surrogate is always recorded and censoring is ignorable given the surrogate, exposure time, covariates and calendar time. The usual immediate-treatment estimandgives more weight to short exposures. Each exposure-time effect is identified through a surrogate bridge, and because the rollout fixes the exposure law, neither the surrogate distribution nor the bridge regression enters theremainder of the efficient influence function. The efficiency bound is a full-data part plus a censoring burden whose share grows with exposure time; as a function of the allocation of clusters to waves, it becomes a design criterion that can favor the heavily censored last wave. We propose a cross-fitted surrogate-assisted augmented estimator, prove joint asymptotic normality, show that with a consistent bridge its variance is the same for independent and fixed-wave crossover times, and justify a fixed-partition cluster jackknife and a heterogeneity test. Treating each crossover as a sequential randomization gives a sharper bound that uses a cluster's pre-crossover history; under a random-intercept working structure the optimal correction is a one-dimensional index of the cluster's own surrogate and outcome history, and the resulting estimator attains the bound with 30 clusters in simulations.

stat.ME↗

arXiv2026

GRP v0.1 Technical Report

Industrial recommendation systems rely on multi-stage cascades whose retrieval, ranking, and serving components are difficult to replace jointly. We present GRP, a generative recommendation framework that combines retrieval, ranking, and reward modeling in a single encoder-decoder model, and evaluate a progressive path toward end-to-end recommendation. The model generates multimodal Semantic IDs and scores candidates with a jointly trained ranking module. The frozen ranking module then supplies rewards for reinforcement-learning post-training. We introduce mGRPO, which adds a reference-anchored margin to reward optimization to preserve the likelihood of logged targets. Offline experiments examine history encoding, model capacity allocation, event selection, tokenization, and reward discrimination. Serving optimizations reduce end-to-end retrieval latency by 69%. Online experiments evaluate the model as a retrieval source, with early-ranking bypass, and with replacement of weaker sources. In a retrieval-only comparison, view time increases by 0.46% and shares by 0.77% relative to production. A separate comparison combining bypass and source replacement yields increases of 0.82% in view time and 2.56% in shares, with neutral platform-level guardrails. These results support progressive deployment while identifying remaining gaps in ranking quality and performance across recommendation metrics.

cs.IR↗

arXiv2026

Anisotropic Surface State Band Splitting and Low Energy Flat Bands in 3d Correlated Topological Kondo Insulator Candidate FeSb$_2$

FeSb$_2$ is a correlated narrow-gap semiconductor that has often been discussed as a $3d$-electron Kondo insulator candidate and exhibits a low-temperature resistance plateau with possible surface-dominated conduction. We carried out a systematic high-resolution laser-based angle-resolved photoemission spectroscopy (ARPES) study of FeSb$_2$ to investigate its electronic structure. The surface states around the zone center show clear anisotropic splitting. When the temperature is lowered into the resistance plateau regime ($<6\,\mathrm{K}$), the surface states remain robust, but their photoemission peaks become much sharper and gain spectral weight. Two distinct flat-band-like features are observed at low energy. One is located at $\sim$127 meV below the Fermi level, which exists only along a specific high-symmetry direction, while the other is located at $\sim$70 meV below the Fermi level and is present along all the measured momentum cuts around the zone center. These results provide new information to understand the renormalization effects, the resistance plateau, and the topological nature of FeSb$_2$.

cond-mat.str-el↗

arXiv2026

CLARSTA: A random subspace trust-region algorithm for convex-constrained derivative-free optimization

This paper proposes a random subspace trust-region algorithm for general convex-constrained derivative-free optimization (DFO) problems. Similar to previous random subspace DFO methods, the convergence of our algorithm requires a certain accuracy of models and a certain quality of subspaces. For model accuracy, we define a new class of models that is only required to provide reasonable accuracy on the projection of the constraint set onto the subspace. We provide a new geometry measure to make these models easy to analyze, construct, and manage. For subspace quality, we use a normalized random orthogonal projection matrix to provide a method to sample subspaces that preserve the first-order criticality measure by a certain fraction with a probability lower bound independent of the ambient dimension. Based on all these new theoretical results, we present an almost-sure liminf convergence result and an $\mathcal{O}(ε^{-2})$ expected iteration complexity analysis of our algorithm. Numerical experiments on problems with dimensions up to 10000 demonstrate the reliable performance of our algorithm in high dimensions.

math.OC↗

arXiv2026

Code World Model: Coding Agent as World Brain

World models aim to simulate how complex environments evolve under actions and events, yet existing video-based world models primarily learn dynamics from visual observations, which reveal outcomes rather than the underlying knowledge, rules, and mechanisms governing world evolution. This makes it difficult to maintain persistent consequences and support coherent, open-ended evolution. We introduce Code World Model, a framework that separates world evolution from visual realization by combining the reasoning and coding capabilities of language models with the generative priors of video models. A coding agent serves as the world brain, reasoning about events and their consequences and generating executable code to maintain persistent world state and perform rule-consistent evolution. To connect executable state with visual generation, we introduce a proxy representation that encodes frame-wise spatiotemporal constraints and is compiled into a proxy video, which conditions a video model to render high-fidelity visual observations. We further develop data pipelines for constructing aligned proxy-observation pairs from gameplay and real-world videos. After fine-tuning on paired gameplay data, MiniMax-H3 follows proxy-based spatiotemporal specifications from simple interactive worlds built by the coding agent while preserving rich visual details and dynamics. These results demonstrate the potential of combining code for persistent world evolution with video models for flexible visual realization, providing a new path toward open-ended world models.

cs.CV↗

arXiv2026

LumiTokens: 3D Relighting via Token-Space Lighting Transformation

Existing 3D relighting methods operate through either explicit material decomposition, diffusion-based view-space generation, or a combination of both, requiring full recomputation for each new lighting condition. We observe that recent latent scene representations, which encode multi-view images into a set of compact tokens with no fixed physical semantics, open up a novel design space for relighting. We present LumiTokens, a framework that formulates 3D relighting as a direct transformation on latent scene tokens, without explicit 3D representations, rendering equations, or physics-based decomposition. Our model introduces a Scene Token Editor that processes scene tokens jointly with light-ray tokens through self-attention, producing updated tokens that can be decoded into multi-view-consistent relit images. To support diverse lighting types through a unified interface, all lighting signals, including environment maps, point lights, and area lights, are parameterized as Plucker ray tokens, enabling native 3D user interaction with a representation that carries no explicit spatial structure. Crucially, this design supports progressive relighting: because the editor's output remains in the same latent space as its input, a user can incrementally build up illumination one light source at a time, with each edit composing in token space. Experiments demonstrate that LumiTokens achieves comparable or superior relighting quality to other methods and supports progressive, composable lighting edits. Project page: https://neu-vi.github.io/LumiTokens/

cs.CV↗

arXiv2026

ClockRoPE: Random Fourier Rotations for Temporal Routine Modeling

Rotary Position Embedding (RoPE) has been widely adopted in transformer-based large language models. However, its log-linear frequency schedule, originally designed to produce long-term attention decay, limits its adoption in domains with more complex distance-correlation patterns, such as temporal periodicity in sequential recommendation. We investigate the expressiveness of general query/key rotations and find that any normalized continuous positive-definite attention modulation function can be approximated by random rotations induced by its own Fourier transform, which we term Random Fourier Rotations. Building on this theory, we propose ClockRoPE for routine modeling in sequential recommendation, where rotation frequencies are derived from periodic attention modulation functions. In online A/B tests, ClockRoPE demonstrates consistent improvements in valued engagement metrics, and has been successfully deployed in production-scale generative retrieval system at a major video-sharing platform.

cs.LG↗

arXiv2026

LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendation

Large Language Models (LLMs) have demonstrated powerful reasoning capabilities through Chain-of-Thought (CoT) in various tasks, yet the inefficiency of token-by-token generation hinders real-world deployment in latency-sensitive recommender systems. Latent reasoning has emerged as an effective paradigm in LLMs, performing multi-step inference in a continuous hidden-state space to achieve stronger reasoning at lower cost. However, this paradigm remains underexplored in mainstream generative recommendation. Achieving this reveals three key challenges: (1) the gap between prior-less Semantic ID (SID) symbols and continuous latent reasoning, as SIDs lack pre-trained semantics, hindering joint optimization; (2) representation drift due to a lack of reasoning chain supervision; and (3) the suboptimality of applying a globally fixed reasoning depth. To address these, we propose LASAR (Latent Adaptive Semantic Aligned Reasoning), an SFT-then-RL framework. First, we bridge this gap via two-stage training: Stage 1 grounds SID semantics before Stage 2 introduces latent reasoning, ensuring efficient convergence. Second, we mitigate representation drift through explicit CoT semantic alignment. Step-wise bidirectional KL divergence constrains the latent reasoning trajectory using hidden-state anchors extracted from CoT text, while a Policy Head predicts per-sample reasoning depth. Third, during the GRPO-based RL phase, terminal-only KL alignment accommodates variable-length reasoning, and REINFORCE optimizes the Policy Head to dynamically allocate steps. This nearly halves the average latent step count while simultaneously improving recommendation quality. Experiments on three real-world datasets show that LASAR achieves the best overall performance across the evaluated settings. It adds limited inference latency and is roughly 20x faster than generating explicit CoT text.

cs.IR↗

arXiv2026

TextBridgeGNN: Pre-training Graph Neural Network for Cross-Domain Recommendation via Text-Guided Transfer

Graph-based recommendation has achieved great success in recent years. The classical graph recommendation model utilizes ID embedding to store essential collaborative information. However, this ID-based paradigm faces challenges in transferring to a new domain. This phenomenon primarily stems from two inherent challenges: (1) the non-transferability of ID embeddings due to isolated domain-specific ID spaces, and (2) structural incompatibility between heterogeneous interaction graphs across domains. To address these issues, we propose TextBridgeGNN, a pre-training and fine-tuning framework that can effectively transfer knowledge from a pre-trained GNN to downstream tasks. Specifically, TextBridgeGNN uses text as a semantic bridge to connect domains through multi-level graph propagation. During the pre-training stage, hierarchical GNNs are designed to learn both domain-specific and domain-global knowledge with text features, ensuring the retention of collaborative signals and the enhancement of semantics. During the fine-tuning stage, a similarity transfer mechanism initializes ID embeddings in the target domain by transferring from semantically related nodes, successfully transferring the ID embeddings and graph pattern. Experiments demonstrate that TextBridgeGNN consistently achieves strong overall performance across cross-domain, multi-domain, and training-free scenarios, without costly language model fine-tuning or real-time inference overhead.

cs.IR↗

arXiv2026

Coexistence of High Temperature Superconductivity and Antiferromagnetic Order in a Cuprate with Multiple Hole Fermi Pockets

The intricate relationship between high temperature superconductivity and antiferromagnetic order in cuprates, and the fundamental origin of electron pairing remain open questions. By utilizing high-resolution laser-based spatially-resolved angle-resolved photoemission spectroscopy, we investigate the seven-layer $Bi_{2}Sr_{2}Ca_{6}Cu_{7}O_{18+δ}$ (Bi2267) and identify a cuprate system that consists of multiple hole Fermi pockets. The observed Fermi pockets exhibit pronounced momentum-, temperature- and Fermi surface-dependent energy gaps. Crucially, high temperature superconductivity with a critical temperature ($T_{\mathrm{c}}$) of $\sim$75 K emerges in a system with multiple Fermi pockets and the presence of strong antiferromagnetic order and correlations. In particular, substantial electron pairing is observed along the Fermi pocket with an energy gap up to $\sim$42 meV in lightly-doped CuO$_{2}$ planes ($p\sim$0.05). These findings challenge the conventional understanding of the roles of the nodal and antinodal electronic states in driving high-temperature superconductivity. They show that superconductivity and antiferromagnetism can coexist in a cuprate with multiple Fermi pockets, offering further insights into the pairing mechanism in cuprate superconductors.

cond-mat.supr-con↗

arXiv2026

RAMBA: 4D Radar Mapping by Bundle Adjustment

4D radar is increasingly attractive for robotic mapping because it provides range, azimuth, elevation, and Doppler measurements while remaining robust in adverse visibility conditions. Although recent radar and radar--inertial odometry methods have achieved promising online state estimation performance, offline global map refinement for 4D radar remains underexplored. This paper presents RAMBA, a radar bundle-adjustment framework for globally consistent 4D radar mapping. Given initial poses and radar frames from a radar--inertial odometry front-end, RAMBA jointly refines radar frame states using covariance-weighted geometric residuals, IMU preintegration factors, and radar ego-velocity constraints. The geometric residuals extend pairwise GICP to a multi-frame optimization by forming voxel-based correspondences across selected frames and weighting each residual with point covariances. To improve robustness against drift and revisits, RAMBA enforces temporal consistency during correspondence formation while explicitly supporting loop-closure constraints. Experiments on the ColoRadar and SNAIL Radar datasets show that RAMBA improves map consistency and usually enhances trajectory accuracy over radar--inertial odometry and pose-graph optimization baselines.

cs.RO↗

arXiv2026

Route Before Retrieve: Activating Latent Routing Abilities of LLMs for RAG vs. Long-Context Selection

Recent advances in large language models (LLMs) have expanded the context window to beyond 128K tokens, enabling long-document understanding and multi-source reasoning. A key challenge, however, lies in choosing between retrieval-augmented generation (RAG) and long-context (LC) strategies: RAG is efficient but constrained by retrieval quality, while LC supports global reasoning at higher cost and with position sensitivity. Existing methods such as Self-Route adopt failure-driven fallback from RAG to LC, but remain passive, inefficient, and hard to interpret. We propose Pre-Route, a proactive routing framework that performs structured reasoning before answering. Using lightweight metadata (e.g., document type, length, initial snippet), Pre-Route enables task analysis, coverage estimation, and information-need prediction, producing explainable and cost-efficient routing decisions. Our study shows three key findings: (i) LLMs possess latent routing ability that can be reliably elicited with guidelines, allowing single-sample performance to approach that of multi-sample (Best-of-N) results; (ii) linear probes reveal that structured prompts sharpen the separability of the "optimal routing dimension" in representation space; and (iii) distillation transfers this reasoning structure to smaller models for lightweight deployment. Experiments on LaRA (in-domain) and LongBench-v2 (OOD) confirm that Pre-Route outperforms Always-RAG, Always-LC, and Self-Route baselines, achieving superior overall cost-effectiveness.

cs.CL↗

arXiv2026

Accuracy and Relationships of Quadratic Models in Derivative-free Optimization

We study three quadratic models in model-based derivative-free optimization: the minimum norm (MN), minimum Frobenius norm (MFN), and quadratic generalized simplex derivative (QS) models. Despite their widespread use, their approximation accuracy and relationships have not been systematically explored. We establish fully linear error bounds for all three models, removing the uniformly bounded model Hessian assumption required in existing MN analyses and deriving the first such results for the QS model. We further analyze Hessian approximation accuracy via directional error bounds, showing that all three models achieve fully quadratic accuracy along sample directions under a mild condition on the sample set. This reveals a form of directional fully quadratic accuracy not captured by existing theory. Finally, we characterize the relationships among these models, identifying conditions under which they coincide and clarifying their structural connections.

math.OC↗

arXiv2026

Persistent Fermi Pockets and Robust Electron Pairing in Lightly Doped CuO$_2$ Planes of Cuprate Superconductors

High temperature superconductivity in cuprate superconductors is generally considered to be generated from doping the Mott insulators. The fundamental nature of the doped parent compounds as well as the microscopic origin of electron pairing remain critical issues in understanding the emergence of superconductivity. Here, using high-resolution spatially-resolved laser angle-resolved photoemission spectroscopy, we investigate the intrinsic electronic structures of the CuO$_2$ planes in multilayer cuprates Bi$_2$Sr$_2$Ca$_{n-1}$Cu$_n$O$_{2n+4+δ}$ (n=5$\sim$8). The inner CuO$_2$ planes are well shielded from the disorders and provide a rare and ideal platform to probe the intrinsic electronic phase diagram. We observe well-defined Fermi pockets with hole doping levels as low as 0.007, demonstrating an abrupt transition from the parent Mott insulator to a metallic state upon the introduction of an infinitesimal amount of doping. The innermost CuO$_2$ planes (IP$_0$) display gapless Fermi pockets, while the second innermost planes (IP$_1$) exhibit anisotropic superconducting gaps up to $\sim$33$\,$meV, indicative of robust electron pairing coexisting with strong antiferromagnetic order. Our findings provide a revised framework for understanding the doping-driven transitions and pairing mechanisms in cuprate superconductors.

cond-mat.supr-con↗

arXiv2026

Semantic IDs for Recommender Systems at Snapchat: Use Cases, Technical Challenges, and Design Choices

Effective item identifiers (IDs) are an important component for recommender systems (RecSys) in practice, and are commonly adopted in many use cases such as retrieval and ranking. IDs can encode collaborative filtering signals within training data, such that RecSys models can extrapolate during the inference and personalize the prediction based on users' behavioral histories. Recently, Semantic IDs (SIDs) have become a trending paradigm for RecSys. In comparison to the conventional atomic ID, an SID is an ordered list of codes, derived from tokenizers such as residual quantization, applied to semantic representations commonly extracted from foundation models or collaborative signals. SIDs have drastically smaller cardinality than the atomic counterpart, and induce semantic clustering in the ID space. At Snapchat, we apply SIDs as auxiliary features for ranking models, and also explore SIDs as additional retrieval sources in different ML applications. In this paper, we discuss practical technical challenges we encountered while applying SIDs, experiments we have conducted, and design choices we have iterated to mitigate these challenges. Backed by promising offline results on both internal data and academic benchmarks as well as online A/B studies, SID variants have been launched in multiple production models with positive metrics impact.

cs.IR↗