arXiv Science⌕ Search

arXiv subjects

Ying Sun

Publications and source records attributed to Ying Sun.

At least 19 recordsLinked to original sources

Latent-Condensed Transformer for Efficient Long Context Modeling

Large language models (LLMs) face significant challenges in processing long contexts due to the linear growth of the key-value (KV) cache and quadratic complexity of self-attention. Existing approaches address these bottlenecks separately: Multi-head Latent Attention (MLA) reduces the KV cache by projecting tokens into a low-dimensional latent space, while sparse attention reduces computation. However, sparse methods cannot operate natively on MLA's compressed latent structure, missing opportunities for joint optimization. In this paper, we propose Latent-Condensed Attention (LCA), which directly condenses context within MLA's latent space, where the representation is disentangled into semantic latent vectors and positional keys. LCA separately aggregates semantic vectors via query-aware pooling and preserves positional keys via anchor selection. This approach jointly reduces both computational cost and KV cache without adding parameters. Beyond MLA, LCA's design is architecture-agnostic and readily extends to other attention mechanisms such as GQA. Theoretically, we prove a length-independent error bound. Experiments show LCA achieves up to 2.5$\times$ prefilling speedup and 90% KV cache reduction at 128K context while maintaining competitive performance.

cs.CL↗

E-GenRM: Generative Reward Modeling for Open-Ended E-Commerce Shopping Agents

We present E-GenRM (E-commerce Generative Reward Model), a generative reward model tailored to e-commerce shopping agents. User expectations are shifting from simple product queries to open-ended shopping tasks. However, existing trajectories and reward designs remain largely bounded by current agent usage patterns and known failures, providing limited guidance for further capability improvement. These limitations call for an integrated reward modeling framework for open-ended shopping agent tasks. On the data side, E-GenRM leverages naturally occurring user behavior across the shopping app to construct diverse, long-horizon conversational trajectories beyond established usage patterns. On the modeling side, E-GenRM first learns from behavior-grounded evaluation chains through supervised fine-tuning. It is then optimized through criterion-guided reinforcement learning, which rewards correct preference judgments and evidence-supported factual claims under each criterion. Personalized hard-negative training further improves its sensitivity to user preferences reflected in shopping behavior, beyond explicit requirements. We additionally develop an active evidence retrieval extension that acquires missing e-commerce information for evaluation. On E-GenRM-Bench, E-GenRM-27B achieves 87.40\% preference accuracy, outperforming the strongest baseline by 6.97 percentage points. In a 14-day online A/B test on Taobao, a shopping agent post-trained with E-GenRM improves the effective shopping-assistance rate by 1.39 percentage points and user satisfaction by 2.33 percentage points.

cs.IR↗

Stability threshold for 3D Boussinesq equations with rotation near the Couette flow and vertical stratified temperature

The most important features that distinguish fluid flow in the atmosphere and ocean are the effects of rotation and stratification, which are described by the Boussinesq equations with rotation. This paper examines the stability threshold at high Reynolds number $\mathbf{Re}$ for the 3D Boussinesq equations with rotation near Couette flow and a vertical stratified temperature. For the zero modes, the combined effects of rotation and stratification sustain velocity-temperature oscillations with frequencies bounded away from zero. In the stable rotational regime, rotation suppresses the linear growth associated with the lift-up effect, while stratification sustains oscillations in the double zero modes. Although the zero modes dynamics are not fully dispersive, we exploit the structure of the oscillatory phases and cancellations in the equations to obtain a modified energy estimate for the entire zero modes system. Combining this estimate with enhanced dissipation and inviscid damping of the nonzero modes, we establish a bound for the stability threshold, with order $\mathbf{Re}^{-2/3}(1+\log\mathbf{Re})^{-1-a_0}$ for any fixed $a_0\in(0,1/2)$.

math.AP↗

Movable-Antenna-Empowered ISAC: 3D Ambiguity Function Analysis, Waveform Design and Antenna Position Optimization

Multiple-input multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) provides abundant spatial and time-frequency degrees of freedom for integrated sensing and communication (ISAC), while movable-antennas (MAs) further introduce reconfigurable spatial freedom through array geometry adjustment. However, how the array geometry and the MIMO-OFDM waveform design jointly influence the sensing performance, i.e., the three dimensional (3D) ambiguity function property, remains insufficiently understood. Against this background, we investigate MA-empowered ISAC design under the MIMO-OFDM architecture, where the radio-frequency (RF) antenna positions and the baseband waveform are co-designed with symbol-level precoding (SLP) philosophy. The discrete periodic angle-range-Doppler ambiguity function is firstly derived for the MA-enabled ISAC framework, revealing its interesting features with respect to the waveform matrix rank. Specifically, it is proved that a rank-one waveform yields a 3D ambiguity function that is separable into angular and range-Doppler components. On the other hand, a higher-rank waveform combines multiple spatial components with angle-dependent weights, allowing the range-Doppler ambiguity function to vary across candidate angles and enabling the MA positions to further shape the 3D ambiguity function. Based on the aforementioned analysis, a 3D integrated sidelobe level ratio (ISLR) is defined, a joint optimization problem of the MA positions and the SLP waveform matrix is formulated, and a penalty dual decomposition based alternating optimization algorithm is developed. For the radar-only case, the existence of a rank-one globally optimal waveform is established, which reduces the original high-dimensional waveform optimization to a low-dimensional joint design of the spatial beam and MA positions.

eess.SP↗

Rethinking Multi-View Fusion for Urban Representation Learning

Urban region representation learning encodes heterogeneous urban signals, such as mobility flows, points of interest, and land-use patterns, into unified embeddings for downstream tasks, including check-in prediction, crime forecasting, and service demand estimation. Existing approaches rely on globally shared fusion and joint optimization, implicitly assuming uniform modality importance and naturally balanced multi-objective training. However, urban data is inherently heterogeneous. Our empirical analysis reveals two structural issues: (i) modality utility varies markedly across regions, causing static fusion to overemphasize signals from certain modalities; and (ii) heterogeneous objectives exhibit persistent gradient imbalance, causing representational bias and unstable training. We present PRISM, a self-adjusting framework for adaptive multi-view learning. PRISM adapts sparse Mixture-of-Experts (MoE) routing to learn region-specific view allocations, while a Proportional-Integral-Derivative (PID)-inspired regulation mechanism mitigates gradient conflicts during optimization. Experiments on three large-scale urban datasets show that PRISM achieves more competitive performance than strong multi-view baselines, while providing more stable optimization behavior and more balanced region representations.

cs.LG↗

AutoPRL: Automated Path Representation Learning via a Learnable View Generator

Self-supervised learning has emerged as a powerful paradigm for Path Representation Learning (PRL) in road networks. PRL aims to learn informative representations of paths traversed by moving objects, such as vehicles, where each path consists of a sequence of connected road segments. These representations are essential for various downstream tasks, including travel-time estimation and path ranking. However, existing methods often suffer from ineffective view generation and inefficient training procedures due to their reliance on heuristic augmentations and computationally intensive contrastive learning. To address these issues, we propose AutoPRL, an effective and efficient self-supervised PRL framework that integrates three key components. The Automatic Data Augmentation (AutoDA) module employs variational autoencoders to generate semantically meaningful and diverse feature-level path views by modeling each topology-aware node embedding with a Gaussian latent distribution, thereby mitigating information loss and enhancing representation quality. Second, the Cross-View Decoupled Contrastive (CVDC) learning mechanism improves training efficiency by disentangling the optimization of positive and negative pairs across node- and path-level views, enabling more stable contrastive learning. Third, an Adaptive Co-Training (ACT) module dynamically adjusts uncertainty-based loss weights to balance multiple objectives, ensuring efficient and scalable training. Extensive experiments on three real-world datasets demonstrate that AutoPRL achieves strong and consistent performance in both effectiveness and efficiency across multiple downstream tasks.

cs.LG↗

Patient-specific rubric-based evaluation of large language models across longitudinal cancer care

Large language models (LLMs) show promise in specialty medicine, yet existing evaluations largely focus on isolated clinical encounters rather than tracking how clinical responsibilities evolve across a longitudinal care pathway. Here we introduce NPC-RubricBench, a phase-aware benchmark for evaluating multistage clinical reasoning across the cancer care continuum, using nasopharyngeal carcinoma as a defined disease context. Curated from longitudinal records of 405 patients across two cancer centers, the benchmark comprises 941 patient-phase units across six sequential care phases and 17,688 patient-specific atomic criteria spanning five evaluation dimensions, with each assessment strictly restricted to decision-time clinical evidence. Evaluating 30 general-purpose and medical LLMs revealed that strong diagnostic performance does not carry over to downstream care. We evaluated 30 general-purpose and medical LLMs, showing that high diagnostic performance did not translate into improved downstream care. Instead, the dominant failure modes reversed across phases. Explicit decision errors dominated anatomical staging at 48.2%, whereas decision omissions dominated initial work-up and post-treatment follow-up at 33.4% and 30.4%, respectively. In the evaluated model set, medically adapted models showed higher omission rates than general-purpose models. Moreover, varying query granularity exposes a critical specification trade-off: broad open-ended requests degrade Decision Quality across all 30 models, while more detailed, checklist-like prompts raise Decision Quality but reduce Evidence Faithfulness and Safety Adherence. Furthermore, NPC-RubricBench demonstrates that static diagnostic benchmarks are insufficient to ensure consistent clinical reliability over time, highlighting the importance of phase-adaptive safeguards in multistage medical AI.

cs.AI↗

Clock-Free Stochastic Scheduling for Real-Time Synchronized Content Delivery

Real-time synchronized content delivery is critical for applications such as cloud gaming, collaborative mixed reality, and live streaming, where a server must ensure that a group of users perceives the same content simultaneously for each delivery. Due to heterogeneous and unpredictable network delays, ensuring synchronization is highly challenging. We propose a clock-free scheduling framework that introduces latency compensation to control the server's delivery time for each user, aiming to maximize synchronization performance (i.e., minimizing the gap between the maximum and minimum latencies) while maintaining a low overall latency cost. Unlike prior work requiring synchronized clocks or client-side timestamps, our approach uses only acknowledgment feedback, enabling flexible deployment across diverse environments. We formulate the problem as a convex stochastic optimization with a non-smooth objective. To solve the problem, we employ the stochastic proximal point (SPP) algorithm that updates the delay compensation, using only the previous latency samples, rather than the latency distribution. By exploiting the subproblem structure, we apply ADMM to enable efficient updates with per-iteration complexity of at most $\mathcal{O}(N\log N)$, where $N$ is the number of users. We establish a convergence rate of $\mathcal{O}(1/\sqrt{K})$, where $K$ is the number of content deliveries for transmission. The framework is further extended to handle transmission failures, where packet loss results in successful delivery to only a subset of users. Finally, simulations using both synthetic and real-world latency traces demonstrate the consistent superiority of our algorithm against baseline methods.

cs.NI↗

Loud-loss: A Perceptually Motivated Loss Function for Speech Enhancement Based on Equal-Loudness Contours

The mean squared error (MSE) is a ubiquitous loss function for speech enhancement, but its problem is that the error cannot reflect the auditory perception quality. This is because MSE causes models to over-emphasize low-frequency components which has high energy, leading to the inadequate modeling of perceptually important high-frequency information. To overcome this limitation, we propose a perceptually-weighted loss function grounded in psychoacoustic principles. Specifically, it leverages equal-loudness contours to assign frequency-dependent weights to the reconstruction error, thereby penalizing deviations in a way aligning with human auditory sensitivity. The proposed loss is model-agnostic and flexible, demonstrating strong generality. Experiments on the VoiceBank+DEMAND dataset show that replacing MSE with our loss in a GTCRN model elevates the WB-PESQ score from 2.17 to 2.93-a significant improvement in perceptual quality.

cs.SD↗

NeuroVLA: A Brain-inspired Embodied Intelligence for Fluid and Fast Reflexive Robotics Control

Vision-language-action (VLA) models inherit powerful semantic representations from large language models, but carrying over their design priorities can leave the demands of physical control under-specified. Stable manipulation requires high-frequency proprioceptive feedback and persistent motor state, in addition to instruction understanding. Here we introduce Neuromorphic Vision-Language-Action (NeuroVLA), a brain-inspired architecture that couples a cortical vision-language planner to recurrent cerebellar modulation and a stateful spiking spinal controller. These components translate semantic intent into actions while incorporating high-frequency proprioceptive and force feedback, maintaining short-term motor memory, and enabling local responses to unexpected contact. In simulated and physical manipulation tasks, the cerebellar module reduces mean commanded jerk by 75.6%, and NeuroVLA achieves a 54.8% collision-recovery rate compared with 0.0% for the evaluated VLA baselines. The spinal controller implemented on an FPGA-based neuromorphic processor achieves 2.19 ms inference latency and 0.87 mJ per inference, corresponding to approximately 0.4 W during inference. These results motivate moving beyond inherited language-model design priorities toward embodied architectures that explicitly integrate semantic planning, high-frequency bodily feedback, motor memory, and local correction.

cs.RO↗

MultiphaseHUB for Evidence-Grounded Metadata Curation and Task-Aware Compression of Multiphase Data

Multiphase transport experiments and simulations generate high-dimensional data whose scientific value depends on the physical conditions, sensing configuration, calibration, synchronization, uncertainty, and provenance accompanying the raw signals. These data are difficult to reuse when experimental context is scattered across publications and repositories, while large measurement volumes increase the cost of transfer and analysis. In this work, we introduce MultiphaseHUB as a community infrastructure and an integrated framework for organizing, discovering, and reusing multiphase transport data. The infrastructure connects externally hosted datasets with modality-specific metadata, publications, analysis tools, derived features, source repository links, and boundaries for reuse. Within this framework, we develop two complementary components: literature analysis and data curation, comprising Large Language Model (LLM)-assisted metadata extraction and an agentic literature-analyzer for quantitative values from figures; and modality-specific scientific data compression guided by the quantities of interest needed for downstream analysis. These components address the effort required to interpret heterogeneous sources and the cost of accessing useful information from high-dimensional measurements. Public multiphase datasets provide seed resources for illustrating the framework and its workflows. Building on these components, we outline a research roadmap encompassing cross-facility harmonization, multimodal alignment, task-aware retrieval and dataset valuation, and conditional reconstruction of missing modalities. MultiphaseHUB provides a foundation for connecting distributed data resources to physically meaningful comparison and cross-study scientific discovery.

cs.DL↗

Source-Lifted Flow Matching for Intervenable Multimodal Imitation

Flow-matching policies are promising for imitation learning because they model complex multimodal action distributions. However, their stochasticity is largely passive: repeated sampling may yield diverse behaviors, but users cannot directly choose among valid continuations from the same state. We propose Source-Lifted Flow Matching (SL-FM), a source-intervenable flow-matching policy that exposes such a handle while keeping the velocity field shared and latent-free (without a separate discrete-handle input). The handle selects only the source endpoint of the conditional flow, not a mode-specific field, preserving the standard formulation while avoiding decomposition into separate mode-conditioned dynamics. The core mechanism is Orthogonal Source Lifting, designed to prevent path-crossing ambiguity. Instead of partitioning target actions by mode, SL-FM lifts handle-specific sources into auxiliary orthogonal coordinates and keeps targets in the original action subspace. This preserves the demonstrated action distribution while allowing one shared field to carry different branches without merging at crossings. To keep handles usable across states, we learn a state-dependent source mixture end to end and use a responsibility floor, giving each handle weak supervision and mitigating dead modes. Experiments on crossing-flow diagnostics and robot-control benchmarks show that SL-FM converts passive source randomness into an actionable intervention variable. It removes crossing-induced composite trajectories, changes future routes in 91.1% of matched-prefix interventions, and achieves strong free-deployment performance, with improvements in several benchmark settings. Overall, source geometry provides actionable multimodal control without conditioning the velocity field on the selected mode.

cs.RO↗

Active Learning for Low-Altitude Radio Map Construction via Plug-and-Play Flow Matching

The deployment of unmanned aerial vehicles (UAVs) in low-altitude airspace requires accurate and timely radio maps for reliable communication and safe navigation. However, constructing such radio maps is challenging due to the prohibitive overhead of exhaustive measurements and the limited flight endurance of UAVs. To address this challenge, we propose an active learning framework based on flow matching for efficient low-altitude radio map construction from sparse measurements. We first analyze a plug-and-play (PnP) inference scheme with a flow-matching prior. By characterizing the late-stage refinement behavior through an ordinary differential equation (ODE), we theoretically show how the inference steps smoothly align with a continuous ODE flow to refine the map details. Recognizing that the early generative stages are largely noise-dominated, this insight motivates our proposed truncated flow matching plug-and-play (TFM-PnP) approach. TFM-PnP utilizes a spatial interpolation-based initialization to start the reconstruction from an intermediate flow time, thereby bypassing the inefficient early stages. We further use the generative diversity of flow matching to derive an uncertainty map to guide the UAV trajectory design. Specifically, we propose a weighted sampling approach to select a target location, followed by a Utility-Aware Path Search (UAPS) algorithm to design the corresponding UAV trajectories. Simulation results based on Sionna ray-tracing datasets show that the proposed framework outperforms the considered baselines, achieving more than 50% reduction in normalized mean squared error (NMSE).

eess.SP↗

Programmable and scalable on-chip WDM processing platform enabled by cascaded FSR-free resonators

Wavelength-division multiplexing (WDM) is pivotal for expanding the capacity and functionality of photonic systems, from communications to computing. However, on-chip implementation for broadband operation is fundamentally limited by the narrow free spectral range (FSR) and inefficient drop transmission of conventional optical microcavities. Here, we transcend this limit with a scalable integrated WDM processing platform based on cascaded dual-sided coupled Fabry-Pérot add-drop resonators. This unit achieves a record-large FSR-free bandwidth (> 300 nm) and low insertion loss (< 0.5 dB), while enabling independent manipulation of monochromatic light in both the wavelength and intensity domains. Leveraging these performances, we architect programmable cores with up to 20 channels in a single bus waveguide to demonstrate application versatility by configuring as: a high-capacity on-chip WDM communication fabric (2.4-Tbps single-link WDM transmission and O-to-C-band multi-subband (de)triplexing), a reconfigurable optical processor (broadband and hitless wavelength-selective switching), and a parallel computing accelerator (theoretically capable of 1.28-TOPS convolution operations, 16-channel modulation). This work establishes a unified and versatile WDM processing platform that bridges high-speed optical communication with in-line computing, charting a scalable and backward-compatible path toward petabit-per-second-class links and hundreds of TOPS of on-chip computation, resolving a critical bottleneck for next-generation photonic systems.

physics.optics↗

Modeling nonstationary spatial processes with normalizing flows

Nonstationary spatial processes can often be represented as stationary processes on a warped spatial domain. Selecting an appropriate spatial warping function for a given application is often difficult and, as a result of this, warping methods have largely been limited to two-dimensional spatial domains. In this paper, we introduce a novel approach to modeling nonstationary, anisotropic spatial processes using neural autoregressive flows (NAFs), a class of invertible mappings capable of generating complex, high-dimensional warpings. Through simulation studies we demonstrate that a NAF-based model has greater representational capacity than other commonly used spatial process models. We apply our proposed modeling framework to a subset of the 3D Argo Floats dataset, highlighting the utility of our framework in real-world applications.

stat.ME↗

When Correlations Mislead: Confounder-Aware Multi-View Urban Region Representation Learning

Urban region representation learning commonly combines heterogeneous data sources, such as mobility flows, points of interest, and land-use information, to support tasks including mobility analysis, public safety forecasting, and service demand estimation. Existing multi-view methods typically improve region embeddings by strengthening interactions across views. However, such methods often overlook view-specific regional structures and may propagate correlations induced by shared latent factors, which can reduce the stability of downstream predictions. To overcome this major limitation, we propose CURE, a confounder-aware framework for multi-view urban region representation learning. CURE first encodes each view with its regional graph structure, estimates a shared latent component, and then reduces its projected influence before cross-view interaction. A hierarchical graph-aware fusion module subsequently aggregates the residual view representations using local and global regional contexts Experiments on three real-world cities show that CURE improves predictive performance, remains robust under missing and noisy input views, and provides reliable cross-view integration through shared component separation and context-dependent view weighting.

cs.LG↗

REFINE: Trajectory Representation Learning via Closed-Loop Transcription -- Extended Version

Trajectory representation learning underpins a wide range of trajectory analytics tasks; however, most existing self-supervised approaches, whether discriminative or generative, adopt an open-loop paradigm, relying on fixed data augmentations or random masking without feedback, which limits their ability to generalize and scale. We propose REFINE, a simple yet effective Representation lEarning Framework vIa closed-loop traNscription rEfinement for trajectory data. Drawing upon feedback control theory, REFINE tightly couples road-network-aware generative reconstruction with feedback-driven contrastive learning, enabling the model to capture fine-grained local movement semantics and global spatio-temporal dependencies without manually designed augmentation views. We further provide a control-theoretic analysis that establishes convergence guarantees for the proposed closed-loop optimization. Extensive experiments on four real-world datasets demonstrate that REFINE consistently outperforms state-of-the-art methods across multiple downstream tasks while remaining computationally efficient and scalable. This paper is an extended version of REFINE: Trajectory Representation Learning via Closed-Loop Transcription, to appear in KDD 2026.

cs.LG↗

Knowledge Distillation Driven Semantic NOMA with GAN Refinement for 6G Robotic Vehicle Networks

To achieve sustainable intelligent mobility, 6G-empowered robotic vehicles (RVs) require high-fidelity visual perception under stringent bandwidth and energy constraints. Semantic communication offers a spectral-efficient solution but suffers from severe interference in uplink non-orthogonal multiple access (NOMA) RV networks. To address this, we propose a knowledge distillation-driven and generative models-enhanced NOMA framework for robust and green RV communications, named KDG-SemNOMA. First, we develop a ConvNeXt-based deep joint source-channel coding (DeepJSCC) architecture with an enhanced attention feature (AF) module for dynamic channel adaptation. Second, to mitigate interference without inference overhead, an orthogonal transmission teacher model guides the NOMA student model via a two-stage knowledge distillation strategy. Finally, to address the over-smoothing artifacts of pixel-wise optimization, we introduce a channel-conditional GAN (cGAN). By explicitly taking the Stage-I initial reconstruction and channel states as conditional inputs, this module refines coarse outputs into high-fidelity images with realistic textures. Experiments on FFHQ-256 demonstrate that KDG-SemNOMA significantly outperforms state-of-the-art methods in both pixel-level accuracy and perceptual fidelity.

cs.IT↗