arXiv Science⌕ Search

arXiv subjects

Chang Liu

Publications and source records attributed to Chang Liu.

At least 73 records · Page 4Linked to original sources

Trapped by Their Own Rollouts: Understanding Aggregation--Rollout Feedback in Federated On-Policy Distillation

On-policy distillation (OPD) is a promising approach to language-model adaptation, aligning teacher supervision with the student's own generated trajectories. When adaptation prompts are distributed across clients, can this process benefit from federated collaboration? We study federated OPD and find that substantial collaboration gains can be obscured by learning-rate sensitivity: FedAvg can perform no better than independent local training at a small learning rate, yet recover a clear advantage at a larger rate. We explain this phenomenon through the student's dual role as learner and generator of future training data. An aggregation-induced optimization lag can delay access to useful teacher supervision, which in turn slows subsequent learning. Our theory establishes this aggregation--rollout feedback in a solvable model with a common optimum and stable updates, and identifies two coupled roles of learning rate: learning from current supervision and reaching future supervision. Guided by this analysis, we propose FedTOPS (Federated Teacher-guided On-Policy Scaling), which reuses teacher feedback on current trajectories to adapt the FedAvg update magnitude under clientwise predictive-change constraints. Across six mathematical reasoning benchmarks, FedTOPS improves macro Avg@8 over FedAvg by 4.56--14.57 percentage points across the evaluated student models and local learning rates.

cs.LG↗

ICM: Intra-class Mixing for Domain Adaptation in Adverse Weather

Unsupervised domain adaptation (UDA) for semantic segmentation remains challenging under adverse weather conditions because severe appearance changes enlarge the domain gap and degrade the reliability of pseudo labels in the target domain. To address this problem, we propose an Intra-Class Mixing Consistency (ICM) framework that enforces prediction consistency between an intra-class mixed image and its original counterpart. Unlike previous mixing-based consistency methods that combine regions across different images or domains and may introduce unrealistic semantic inconsistencies, ICM performs mixing within the same image and semantic class, preserving realistic semantic layout for consistency regularization. With ICM, we establish a new state-of-the-art performance for clear-to-adverse-weather unsupervised domain adaptation (UDA) in semantic segmentation. On the Cityscapes $\rightarrow$ ACDC benchmark, our method achieves 75.7\% mIoU, outperforming the previous state of the art by +1.9 pp, demonstrating its effectiveness in mitigating class confusion under challenging environmental conditions. The code is provided in the supplementary material.

cs.CV↗

Tomography analysis of the intermediate-luminosity Type Iax SN 2024pxl

We present an abundance tomography analysis of SN 2024pxl, an intermediate luminosity Type Iax supernova ($M_{r}=-16.82 \pm 0.19$ mag), with the most-detailed follow-up in the Type Iax subclass to-date. As one of the few intermediate luminosity Type Iax objects, SN 2024pxl may link the two extremes of the peculiar thermonuclear supernova subclass. To test this hypothesis, we analyze its spectral evolution through the first 100 days after the explosion and aim to probe the structure of its ejecta. We conduct an abundance tomography analysis using synthetic spectra produced with the one dimensional radiative transfer code TARDIS. The fit of the spectral time series provides a radial scan of physical properties and probes the stratification of chemical elements throughout most of the SN ejecta. The observed spectral evolution is well fit with the final model, similar to the general predictions of the pure deflagration scenarios, but significant modifications are required in the density function of the inner ejecta and in the chemical profiles of the outermost regions. The constrained physical characteristics, such as the photospheric velocities and the time of maximum light, are also consistent with other SNe~Iax. Despite their small number, intermediate luminosity Type Iax SNe are not outliers in the subclass but demonstrate the continuous nature of SNe Iax through their luminosity range. Following this observation, we argue that all SNe~Iax share the same progenitor and explosion origin.

astro-ph.HE↗

Digital Twin-Driven VR Teleoperation with Multi-View Spatial Perception for Surgical Robots

Current robot-assisted minimally-invasive surgery (RMIS) platforms provide a fixed console for the surgeon to view stereo endoscopic images and teleoperate instruments inside the patient. Several researchers have proposed the use of a head-mounted display (HMD) as a portable console, with video pass-through rendering of the endoscope images which, like the fixed console, restricts the operator to a single endoscopic viewpoint and limits depth perception. We present a digital twin-driven virtual reality (VR) teleoperation platform, where the digital twin is created from markerless perception of the surgical environment and streamed for display on the HMD. This overcomes the limitations of video pass-through by providing multi-view rendering and natural motion-parallax cues, enabling decoupling of the user's hand posture from strict instrument alignment. The system utilizes VR hand controllers to increase the teleoperation workspace and to improve the robustness and stability of instrument control compared to the hand tracking approach adopted by most prior systems. A 15-participant user study on the da Vinci Research Kit (dVRK) shows that our VR platform significantly outperforms a state-of-the-art HoloLens 2 mixed reality baseline, reducing path length by 86% and jerk by 95%, while achieving depth perception confidence comparable to or exceeding the traditional console across all conditions.

cs.RO↗

From Experts to Sub-experts: Fine-grained Parameter-Efficient Fine-Tuning for MoE LLMs

As large language models (LLMs) scale rapidly, dense full-parameter adaptation becomes increasingly expensive, motivating sparse and modular architectures such as Mixture-of-Experts (MoE) models. This shift raises a key question for parameter-efficient fine-tuning (PEFT): at what granularity should parameters be selected and updated? Existing PEFT methods such as LoRA operate on predefined weight matrices, while expert-level sparse tuning methods update entire selected experts. However, we observe that activated experts are internally sparse, with only a small fraction of intermediate channels strongly responding to downstream tasks, indicating that expert-level adaptation is still too coarse. We propose NSFT (Neural Sub-expert Fine-Tuning), a fine-grained PEFT framework that refines MoE adaptation from experts to sub-experts. NSFT decomposes each expert along the intermediate dimension into structured channel groups and selects task-relevant sub-experts by combining routing importance with intra-expert activation saliency. To optimize sparse partial updates, NSFT further introduces learning-rate scaling and dynamic gradient scaling to compensate for the reduced effective update magnitude. Experiments on OLMoE and Ling-mini-2.0 across challenging domain-specific tasks and general benchmarks show that NSFT consistently outperforms representative PEFT and expert-level sparse tuning baselines, while using substantially fewer trainable parameters and preserving competitive general capability. These results suggest that sub-expert-level adaptation is a more precise and efficient PEFT paradigm for MoE LLMs.

cs.LG↗

Et Tu, MacBook? Unprivileged Keystroke Inference and Context Profiling via the Built-in IMU Side Channel

Recent generations of Apple MacBooks embed an inertial measurement unit (IMU) within their unibody chassis for device orientation and motion sensing. However, this IMU inadvertently captures not only intended device-level information but also subtle physical vibrations from user interactions and the surrounding environment. These signals establish a novel, previously unexplored side channel. We uncover a vulnerability allowing non-root access to IMU data via an IOKit driver, alongside two content-free system metadata interfaces (HIDIdleTime and CGEventSource) that further enrich the side-channel leakage. Through rigorous characterization of the IMU data, we reveal that the leakage spans three core dimensions: (1) keystroke identity (which key is typed), (2) desk surface (where the laptop is placed), and (3) user behavior (who is typing). Leveraging these findings, we introduce BRUTUS, the first comprehensive unprivileged side-channel attack targeting built-in IMU sensors on Apple MacBooks. BRUTUS achieves a character-level accuracy of 89.1% to 97.5% in key recovery. Furthermore, aided by language models, it can successfully reconstruct certain sentences with 100% accuracy. For user identification and environment profiling, BRUTUS correctly discovers user and environment profiles without labels and correctly assigns subsequent segments to their corresponding profiles. Ultimately, this work highlights the urgent necessity of strictly regulating access to built-in IMU sensors.

cs.CR↗

Agentic AI Networking for Heterogeneous Unmanned Aerial Systems in Low-Altitude Wireless Networks

Low-altitude wireless networks (LAWNs) are emerging as a key infrastructure for heterogeneous unmanned aerial systems that support concurrent services within a shared three-dimensional airspace. Their coexistence creates strong coupling among mobility, connectivity, and shared network resources, while heterogeneous services impose distinct and time-varying requirements. These interactions naturally form a dynamic non-cooperative game in which both operating conditions and coordination objectives evolve over time. Conventional optimization and learning-based controllers typically rely on predefined objectives, limiting their ability to adapt autonomously to changing service requirements and resource priorities. To address this challenge, we propose a hierarchical hybrid large language model (LLM)- multi-agent reinforcement learning (MARL) architecture organized as a dual-loop structure. Specifically, an outer adaptation loop employs LLM-assisted game orchestration to interpret service requirements and operator intent, and reconfigure objectives and resource priorities, while an inner loop executes decentralized, parameter-conditioned MARL policies under the configured game. A logistics-monitoring case study illustrates how the proposed framework facilitates coordinated coexistence among heterogeneous services, adapting to evolving operating conditions without retraining the underlying MARL policies. Finally, we discuss key challenges and research directions toward scalable, trustworthy, and adaptive agentic LAWNs.

cs.AI↗

Gradient-Based Construction of Collisionless Steady-State Guiding-Center Distributions in Tokamaks and Stellarators

We present a matrix-free residual-minimization method for preparing guiding-center distribution functions on finite grids. The method minimizes a fixed conservative discrete residual in the physical Jacobian metric using Polak-Ribiere+ iterations with exact quadratic line searches. JAX/XLA evaluates the operator and its adjoint without assembling a four-dimensional matrix; independent magnetic-moment slices are batched and iterations are compiled into one execution graph. An axisymmetric hierarchy verifies invariant references and tests the workflow using a NUBEAM fast-ion distribution together with an EPCoM constants-of-motion representation constructed from it, before matched precise quasi-axisymmetric (precise-QA), HSX, and W7-X calculations. The three-dimensional endpoints reduce the discrete residual and the finite-time variation of the distribution sampled along independently integrated characteristics. Non-negative projection is treated as an optional constrained extension: it leaves the residual operator unchanged but changes the feasible zero-residual set and endpoint selection. Results are finite-grid, finite-time evidence and do not establish a continuous equilibrium, grid convergence, strict positivity, or a transport prediction.

physics.plasm-ph↗

Complex Problem Solving in Large Language Models: A Statistical Control Survey and Diagnostic Framework

Complex problem solving (CPS) with large language models (LLMs) is often framed as a matter of stronger reasoning or longer generation. Yet early-step error amplification, prompt brittleness, and failures to revise incorrect commitments are difficult to explain by missing knowledge or expressive capacity alone. This survey interprets CPS as a sequential estimation-and-decision problem over a latent solution state. A controller maintains a belief about an unobserved solution trajectory, updates it as noisy intermediate evidence arrives, and decides whether to commit, verify, branch, roll back, or abstain to minimize expected loss. Reasoning supplies candidate transitions and interpretations, whereas process control shapes and evaluates those proposals and regulates subsequent transitions and observations. Within this framework, we organize existing methods around five components: explicit state representation, transition structuring, validation and constraint enforcement, search and rollback, and uncertainty management. We also interpret evaluation metrics according to the statistical quantities they estimate. The framework further yields a diagnostic hypothesis: interventions should be most effective when they target the error or uncertainty component implicated by an observed failure. We distinguish systematic, stochastic, and irreducible error together with epistemic and aleatoric uncertainty, and call this alignment problem-control fit and its failure control mismatch. For example, additional sampling may reduce sampling variability while leaving a shared systematic error unchanged. This perspective clarifies what current methods estimate and control, what remains uncontrolled, and why reliable validation, targeted recovery, calibrated uncertainty, and matched-budget evaluation are central open problems.

stat.ML↗

SemISAC: Semantic Integrated Sensing and Communications

Conventional integrated sensing and communications (ISAC) systems primarily integrate communications and sensing through shared physical resources, without explicitly exploiting task-relevant semantic information. To move beyond such physical-level integration, we propose semantic ISAC (SemISAC), a general framework that unifies semantic communication (SemCom) and semantic sensing (SemS) to convey source meaning and acquire environmental meaning. Specifically, the transmitter combines source semantics and sensing task information with available side information to design the shared waveform and allocate radio resources, while the receiver-side communication and sensing task decoders recover the source meaning and infer the required environmental information, respectively. We also provide an information-theoretic interpretation to characterize the relationship between physical and task-relevant information and the resulting semantic trade-off in SemISAC. Building on this framework, we formulate the general SemISAC design problem and propose two realization methods, namely end-to-end (E2E) SemISAC optimization and modular SemISAC optimization. As a concrete realization, we apply modular SemISAC optimization to jointly design a learnable time-frequency (TF) precoder in an orthogonal frequency-division multiplexing (OFDM) system for representative SemCom and SemS tasks. Simulation results demonstrate that the proposed realization reduces sensing semantic distortion under a given communication requirement and achieves a more favorable communication-sensing trade-off than baseline designs.

eess.SP↗

ReaDiT Guidance: Control for Image and Video Generation using Diffusion Transformer Features

We present DiT Readout (ReaDiT) Guidance, a lightweight framework for controlling generation with Diffusion Transformer (DiT) models via their internal feature representations. ReaDiT Guidance uses features from a single DiT block to steer the generative process according to spatial targets - like depth, pose, or edge maps - provided at test time. Furthermore, since modern text-to-video models are largely built on DiT backbones, ReaDiT Guidance naturally extends to video generation, enabling camera and motion control. Experimental results demonstrate that our approach achieves competitive or improved results compared to existing feature-based and off-the-shelf adapter-based approaches while requiring fewer parameters.

cs.CV↗

U-Lens: Supporting User Uncertainty Management in Long-Form LLM Responses

Uncertainty can appear throughout LLM-generated text (e.g., questionable claims, ambiguous terms). Prior work largely focuses on making such uncertainty visible through cues such as confidence scores, but seeing uncertainty is not the same as managing it. Through a formative study, we examine uncertainty management across interpretation, evaluation, and decision. From these insights, we derive design guidelines for uncertainty target representation, evaluative explanation, response guidance, and interactive presentation. We instantiate them in U-Lens, an uncertainty-management system that organizes uncertain information into contextual inspection targets, prioritizes them, and links each to evaluative context and response options. In an 18-participant within-subjects study comparing U-Lens with a confidence-cue baseline, U-Lens improved verification efficiency and effort allocation, reduced perceived workload, and strengthened support across all three stages. This work reframes uncertainty support for generative AI from text-centered cues to a user-centered process of interpreting, evaluating, and acting on uncertainty.

cs.HC↗

TraceMind: Predicting User Information Uptake from Low-Cost Interaction Traces during Human-LLM Content Co-Generation

In human-LLM content co-generation, AI-generated information can enter final artifacts without being adequately processed by users, creating risks when artifacts are shared or acted upon. We study whether recognition-level uptake of atomic information units can be assessed in open-ended co-generation and predicted from low-cost interaction traces. We collected data from 62 participants across three tasks. For each final draft, we extracted atomic information units and generated post-task recognition questions, yielding 1187 unit-level uptake labels. We present TraceMind, which tracks units across Chat and Draft histories, aligns interaction traces with changing on-screen layouts, and models spatial, temporal, and workflow-informed evidence. TraceMind outperformed all learned baselines across AUROC, AUPRC-non, balanced accuracy, and macro-F1. We found that uptake unfolds throughout interaction, with sustained active engagement providing informative evidence beyond isolated signals. Our work shifts human-LLM co-generation from content adoption toward what users actually take up, motivating uptake-aware systems grounded in low-cost interaction traces.

cs.HC↗

Xiaomi-CocktailASR-1 Technical Report

Recently, large language model (LLM) based ASR models have achieved significant progress, yet they generally lack support for multi-speaker scenarios, where the cocktail party problem remains a critical bottleneck for further advancing ASR. Existing TS-ASR methods, including end-to-end architectures with speaker embeddings and latest LLM-based explorations suffer from degraded single-speaker performance and the inability to reject when the target speaker is absent. In this paper, we propose Xiaomi-CocktailASR-1, an LLM-based end-to-end TS-ASR architecture. By utilizing reference speech as voiceprint prompts, it directly transcribes the target speaker's speech without requiring speech separation. Xiaomi-CocktailASR-1 maintains competitive performance in single-speaker scenarios, comparable to mainstream ASR models. It also features a negative sample rejection capability, outputting empty text when the target speaker is absent from the mixed speech. Additionally, Xiaomi-CocktailASR-1 supports a Chain-of-Thought (CoT) reasoning mode to provide explicit reasoning steps. Extensive experiments on various synthetic and real-world multispeaker benchmarks demonstrate that Xiaomi-CocktailASR-1 achieves state-of-the-art performance, effectively addressing the cocktail party problem through a unified architecture that balances multispeaker and single-speaker recognition accuracy, along with rejection capability.

cs.SD↗

Lightweight LiDAR-Based Cone Detection Framework Using Random Forest for Formula Student Driverless

Reliable, low-latency perception is crucial for Formula Student Driverless vehicles, yet many existing pipelines rely on deep learning and multi-sensor fusion, often requiring GPU acceleration. This paper presents a lightweight LiDAR-only perception pipeline tailored for CPU execution, combining ground removal, IMU-based motion compensation, DBSCAN clustering, and geometric feature-based Random Forest classification. Feature importance analysis reduced the model input from 12 to 7 features while preserving performance. Evaluated on 2,371 labeled clusters collected from real FSD events, the pipeline achieves an F1-score of 98.33% and an end-to-end runtime of 3.13 ms on CPU-only hardware. The released dataset, labeling tool, and trained models provide a practical and reproducible baseline for other resource-constrained autonomous racing teams.

cs.AI↗

LoopMemGR: From Behavior Logs to Evolving Memory for Generative Recommendation

Generative recommendation formulates next-item prediction as conditional autoregressive generation over discrete Semantic IDs, enabling end-to-end recommendation over large-scale item spaces. However, most existing methods follow a history-as-context paradigm that repeatedly reconstructs user preference from behavior history while discarding system-side recommendation decisions after each request. This creates an asymmetric memory: the system remembers what the user has done, but not what it has previously recommended or learned from the resulting feedback. Consequently, useful preference-validation signals, potential negative evidence, and historical exploration information cannot be directly reused across requests. To address these limitations, we propose LoopMemGR, a closed-loop recommendation experience memory framework for generative recommendation. In addition to the conventional behavior log, LoopMemGR maintains a recommendation experience log that records past recommendation--feedback trajectories. It extracts request-relevant evidence through three complementary views: the recency view captures short-term interaction dynamics, the frequency view summarizes recurring recommendation patterns, and the global view distills transferable regularities shared across users. These signals are compressed into a fixed number of experience tokens to condition the generative backbone under a bounded input budget. Extensive experiments on an industrial Taobao dataset demonstrate the effectiveness of closed-loop experience accumulation and multi-view experience extraction.

cs.IR↗

Learning-Aided Short Code Design for ISAC based on MIMO-OFDM

This paper proposes a deep learning (DL)-based coded waveform design for integrated sensing and communications (ISAC), enabling flexible trade-offs between communication reliability and ranging accuracy in short-block transmissions. The proposed scheme is built upon a practical multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) architecture, where the communication channel state information and the angles of the static targets are assumed available at the transmitter. A transformer-based transmitter encodes input information bits directly into ISAC transmit waveforms to jointly optimize the bit error rate (BER) performance and the delay modified Cramer-Rao bound (MCRB). A corresponding transformer-based receiver is adopted at the communication side to recover the transmitted information bits. We further examine the learned codewords for communication-oriented and sensing-oriented designs, revealing that a balanced ISAC waveform naturally exhibits an intermediate structure between these two extremes. Numerical results illustrate these codeword structures and demonstrate that the proposed design provides substantial trade-off gains over conventional schemes based on standard channel coding and modulation.

cs.IT↗

Pulsar Timing Response and Spatial Correlations of Shear Modes in Torsionless Palatini Spacetime

In the nanohertz band, spatial correlations between pulsar timing residuals provide a key observable for characterizing stochastic gravitational-wave backgrounds and probing their polarization content. In torsionless Palatini spacetime, nonmetricity can generate two additional shear modes, referred to as the shear-$x$ and shear-$y$ modes. In this work, we investigate the pulsar timing response produced by the shear-induced motions of the emitting pulsar and the receiving Earth. Assuming that the electromagnetic field is minimally coupled to the physical metric and that the Earth and pulsar possess non-negligible effective hypermomentum responses, we derive the single-pulsar redshift, the frequency-domain two-point correlation function, and the corresponding spatial correlation. For a stationary and isotropic stochastic shear background, the normalized overlap reduction function (ORF) for distinct pulsars reduces in the short-wavelength limit to the pure dipolar form $Γ_{ab}^{\mathrm{sh}}(ζ)=\cosζ$, where $ζ$ is the angular separation between the two pulsars. The same dipolar correlation can also be produced by isotropic Solar System ephemeris errors, leading to a spatial degeneracy between the two signals. This degeneracy highlights the importance of information beyond the angular correlation for identifying Palatini shear signatures in PTA data.

gr-qc↗