arXiv subjects

Yang Xiao

Publications and source records attributed to Yang Xiao.

At least 19 recordsLinked to original sources

arXiv2026

DuplexLedger: Benchmarking Transactional Memory in Full-Duplex Speech Agents

Full-duplex speech agents must update persistent memory while listening and speaking, yet it remains unclear which events should be stored, revised, or excluded. Existing benchmarks isolate interaction timing from memory outcomes, obscuring the state transitions behind a correct answer. We introduce DuplexLedger, a bilingual benchmark of 1,094 persistent sessions aligning four full-duplex scenarios with event-level Write/Update/Ignore/Retain supervision, explicit pre/post memory states, and 6,564 same-session questions and checks. Evaluating five full-duplex models reveals an interaction-memory gap: no system combines strong boundary control with coherent final-state memory, and the best final-state fact coverage is 2.01%. We propose ACT-Mem, an 8.92M-parameter sidecar comprising an event controller, a versioned transactional ledger, and a typed retriever coupled with a frozen MiniCPM-o 4.5 backbone. On 219 held-out sessions, ACT-Mem increases latest-value accuracy from 4.11% to 8.68% while reducing stale assertions and distractor adoption. It improves interaction boundaries but slows interruption stopping. These results motivate selective, auditable full-duplex memory rather than indiscriminate transcript retention. Code is available at https://github.com/lyx-researcher/DuplexLedger.

cs.AI↗

arXiv2026

Beyond Two Tracks: Speaker-Anchored Full-Duplex Dialogue Recovery

Spoken interaction is moving from alternating turns to full-duplex conversation, where an agent listens while speaking. Learning this coordination requires natural dialogue with persistent speaker-resolved tracks, a data requirement that remains difficult to satisfy at scale. Generative recovery offers a route from ordinary recordings, but recovering two voices is not enough: their track assignments can drift as the conversation unfolds. We address this missing link with speaker-anchored routing before diffusion: a 1.84M-parameter module matches the separator's coarse streams to fixed enrollment identities and orders them before a frozen generator reconstructs the speech, without retraining the generator or altering the reconstructed audio. On 25-minute remote conversations, routing cuts wrong-track time from 43.9% to 4.1%, below the 6.2% of matched-enrollment waveform re-identification, with its largest advantage when one participant holds the floor (17.8% versus 28.6%), and raises fixed-track activity F1 from 0.46 to 0.84 while per-chunk reconstruction quality is unchanged. The same router transfers to unseen face-to-face and telephone recordings, and a margin-gated verification step brings their wrong-track time to 0.9-1.7% while embedding 20-36% of the output, where full re-identification embeds all of it. Recovered voices thus become the participant-consistent tracks that full-duplex dialogue modeling needs. Audio examples: https://elpsykongloo.github.io/beyond-two-tracks/

cs.SD↗

arXiv2026

PTagent: An LLM-assisted tool for finite-temperature model construction in cosmological phase transitions

Cosmological phase-transition calculations require well-defined finite-temperature numerical models, whose construction involves assembling model information under consistent theoretical prescriptions. In this work we present \texttt{PTagent}, a large language model (LLM) agent-based framework for constructing such models from SARAH model files, research papers, and DRalgo sources. The LLM agent interprets and organizes model information and identifies unresolved physical choices, while dedicated backends perform the model-dependent calculations. After review and approval of the resulting physical model specification, the backends generate the corresponding CosmoTransitions-style or PhaseTracer-style numerical potentials. By separating model interpretation from numerical implementation, PTagent provides an inspectable and reproducible approach to finite-temperature model construction for cosmological phase-transition studies.

hep-ph↗

arXiv2026

VoxTurn: Answering Several Turn-Taking Questions in One Pass with One Model

A cascaded voice agent must decide, throughout each silence of its user, whether the user has finished their turn: answering too early cuts the user off, answering too late makes the agent slow. It often needs related decisions too: will the user soon go on, is speech during its own turn an interruption or a backchannel, is a sound speech at all. With open detectors, each extra decision costs another model or another call, and on the 14-language eot-bench they cut users off in more than a quarter of mid-turn pauses. Because they are trained on segmented utterances, this mismatch is the largest single source of error. We present VoxTurn, a 0.8B speech LLM that casts these decisions as multiple-choice questions, scores the hidden state of each option, and answers any set of them in one forward pass with a block-isolating attention mask, exactly as if asked one at a time. Trained on real conversational pauses with labels derived from their timing, and re-queried while a silence lasts, VoxTurn reaches 11.5% false cut-offs in English at a 300 ms latency budget, comparable to two commercial detectors, and a 14-language mean of 19.9%, the lowest among open models, at 8.3 ms per decision. In Pipecat and LiveKit it cuts off 17% and 9% of turns, and it ranks fifth of 24 in TurnBench end-of-turn detection without any TurnBench training data. The model, code and framework plugins are released.

eess.AS↗

arXiv2026

Segal's semigroup, Virasoro structure, and Ward identities in Compactified Imaginary Liouville Theory

Compactified Imaginary Liouville Theory (CILT for short) is a probabilistically constructed Conformal Field Theory (CFT), expected to have connections to minimal models, Coulomb gas integrals, and loop models. In this paper, we study the quantization of Segal's semigroup given by CILT. Each element $\mathbf T_f$ in the quantized semigroup corresponds to a conformal annulus: the unit disk $\mathbb D$ with $f(\mathbb D^\circ)$ removed, where $f:\mathbb D\to f(\mathbb D)\subset \mathbb D^\circ$ is a contracting biholomorphism. This semigroup encodes the local conformal structure of the CFT, in particular the Virasoro symmetry with central charge $<1$ for CILT. We first relate the quantized Segal's semigroup to Segal's amplitudes of annuli and recover the Virasoro generators $\mathbf L_n,\widetilde{\mathbf L}_n$ ($n\geq0$) of CILT as generators of this semigroup. Compared to the real Liouville CFT, the main difficulty here is the absence of positivity, which we address through estimates for the imaginary Gaussian Multiplicative Chaos and non-self-adjoint operators. Using Segal's gluing axiom as in the real case, we differentiate the amplitude and use conformal covariance to derive the Ward identities in terms of all Virasoro operators $\mathbf L_n,\widetilde{\mathbf L}_n$ ($n\in\mathbb Z$). We also outline the parallel theory for Boundary CILT (BCILT), concerning Segal's semigroup of semiannuli. These results provide essential tools for the conformal bootstrap program of (B)CILT, boundary BPZ equations, boundary structure constants, and the global construction of conformal blocks.

math.PR↗

arXiv2026

RA$^2$: Retain-Anchored Attraction Preserves Forget-Adjacent Utility in LLM Unlearning

Large Language Model (LLM) unlearning is often evaluated primarily by target suppression and clean retain utility. These metrics can miss a local failure mode: a model may perform well on standard retain prompts, yet degrade on benign reasoning when prompts lie near the forgotten domain. This phenomenon is termed forget-adjacent utility loss. A fundamental question is: where should forget representations go after they leave the removed behavior? Successful unlearning depends not only on whether forget-conditioned representations depart from the harmful computation, but also on the direction in which they are redirected afterward. We propose RA$^2$ (Retain-Anchored Attraction), a latent-space unlearning method that redirects forget-token states toward nearby retain-supported representations while preserving higher-layer behavior on retain data. On WMDP and MUSE, RA$^2$ yields higher forget-adjacent utility than strong unlearning baselines at similar broad-utility levels. These results show that the migration direction of forget representations materially affects benign behavior near the forget boundary. Our code is available at https://github.com/ZacLing/retain_anchored_attraction.

cs.LG↗

arXiv2026

Reference-Guided Turn-Taking Style Transfer for Full-Duplex Spoken Language Models

Full-duplex spoken language models decide at every frame whether to take the floor, defining a conversational personality -- yet each set of weights encodes exactly one, which human speakers bracket rather than share. Existing controls mostly act from outside; none identifies the quantity that sets how much the model speaks. We identify it: a single late-layer residual-stream direction, the initiative vector, extracted from the model's own conversations without training or annotation. The same direction reads the decision, anticipating onsets up to 800 ms ahead, and shifts it: scaled during generation, it moves speech ratio from 6-12% to 42-61% (no steering: 21-30%), consistently across conversations, weights, and corpora. A short reference recording suffices to transfer a speaker's turn-taking style to the model, and the transfer is reference-specific: swapping in another speaker's reference worsens the match in 93-98% of cases, whereas the best uniform dose is indistinguishable from no steering. Turn-taking style is not frozen into the weights but a direction that can be read, shifted, and calibrated per person. Audio examples are available at https://elpsykongloo.github.io/initiative-vector/.

cs.CL↗

arXiv2026

Two-Pion Exchange Contributions to the Nucleon-Nucleon Interaction from the Roper Resonance

We derive the long-range components of the nucleon-nucleon (NN) two-pion-exchange potential with an intermediate Roper resonance. Leading-order interactions in heavy-baryon chiral perturbation theory are considered. To assess the Roper contributions in a unified framework, we include the leading contributions from the Delta resonance, as well as mixed Delta-Roper effects. NN phase shifts with orbital angular momentum $L\geq 2$ are calculated in first-order perturbation theory and compared to those obtained without the Roper resonance. We find that the Delta sets the dominant scale of the resonance-induced corrections, while the Roper-dependent effects are smaller, strongly channel dependent, and most visible in the $D$ waves.

nucl-th↗

arXiv2026

A No-Go Theorem for Nonspherical Bounces with a Single Negative Mode

False vacuum decay is conventionally described by a spherically symmetric bounce with a single negative fluctuation mode. This raises a fundamental question: can the single negative mode requirement itself enforce spherical symmetry, independently of action minimization? For a single real scalar field with a smooth potential in flat spacetime, we rigorously prove that every localized nonspherical saddle with zero initial velocity has at least three negative modes. Additional reflection symmetries further tighten these bounds, as illustrated in a sextic scalar model. Our findings exclude nonspherical bounce candidates with a single negative mode, providing a complementary spectral foundation for the spherical bounce description of false vacuum decay.

hep-th↗

arXiv2026

RAIL: Rethinking Auditory Intelligence in Large Audio-Language Models with a CHC-Grounded Benchmark

Humans process rich auditory environments through various cognitive capabilities such as audio perception, audio reasoning and memory. Despite recent progress in large audio-language models (LALMs), current evaluation remains largely task- or domain-centric, focusing on end performance while ignoring underlying auditory cognitive behaviors. This gap between how auditory cognition is understood in humans and how it is evaluated in LALMs hinders the interpretation of model behaviour in underlying capabilities and limits alignment with human auditory objectives. We introduce RAIL, a human-centric benchmark grounded in the Cattell--Horn--Carroll (CHC) framework, which formalises auditory cognition into five core capabilities, and develops them into structured evaluation tasks with principled data curation and human-aligned evaluation protocols. Evaluating 26 LALMs reveals strong performance in knowledge-related tasks but weak auditory perception and memory, reflecting reliance on language-based pretraining. Limited reasoning under auditory settings further suggests a mismatch between existing training paradigms and human-like auditory reasoning, as well as over-reasoning at the cost of efficiency. Six LALMs exceed human performance in general, while auditory processing all lags behind human. Overall, RAIL establishes a new framework for human-aligned evaluation of auditory intelligence.

cs.SD↗

arXiv2026

No Concept Escapes the Audit: Auditing-Aware Unlearning for Verifiable Concept Erasure in Diffusion Models

Text-to-image diffusion models can generate prohibited content, which motivates concept erasure through machine unlearning. Most erasure methods intervene at the text interface, through prompt modification or localized updates to text-conditioning weights, and they are evaluated by what the model outputs for given prompts. Such evaluation cannot see what the network still encodes. Latent-space auditing, which bypasses text conditioning and probes the denoising network directly, shows that erased concepts remain recoverable from internal representations. We find that this also holds for methods built to be robust against adversarial prompts, and that the problem grows with the number of erased concepts. We propose Auditing-Aware Unlearning for Verifiable Concept Erasure in Diffusion Models (AVCE), a framework that grounds erasure in the model's latent representations. AVCE audits the embedding neighborhood of each concept and condenses the discovered vulnerable directions into an anchor at the weakest geometric point. It edits cross-attention and self-attention projections in closed form at this anchor, then fine-tunes the two pathways with pathway-level auditing losses, using orthogonal gradient projection to consolidate multiple concepts. Experiments on SD v1.5, SDXL, and Flux 1.0 across object, explicit-content, and artistic-style unlearning show that AVCE reduces attack success rates by 5.07x and improves auditing scores by 3.84x over the strongest baseline, while preserving competitive generation quality.

cs.LG↗

arXiv2026

Compositional Concepts Erasing: Disentangling Object-Style via Domain Manifold Unlearning

Diffusion models pose significant risks regarding the generation of illicit content and copyright violations. This has catalyzed the development of machine unlearning to erase harmful concepts or copyrighted styles from a model's generative repertoire without compromising its general performance. However, previous unlearning approaches on diffusion models have largely focused on either object-level or style-level removal and failed to address the challenge of object-style combination unlearning. At the same time, multiple unlearning requests often lead to catastrophic forgetting. To address these challenges, we propose Domain Manifold Unlearning (DMU), which uses an EMA-updated feature proxy extracted from intermediate diffusion features to represent the retained target-object direction. As a lightweight estimating representation of an object, DMU enables selective unlearning of domain-specific components in a specific object while preserving other semantic representations, thereby significantly enhancing robustness in multiple combination unlearning scenarios. Extensive experiments show that DMU significantly mitigates catastrophic forgetting, outperforming state-of-the-art methods of batch unlearning and sequential unlearning.

cs.CV↗

arXiv2026

Vela: User Behavior as Supervision Sparks LLM Intelligence

Large language models are increasingly deployed in applications that act on users' long-term behavior histories, from personal assistants to recommendation and advertising systems. These applications demand the user dimension of LLM intelligence: inferring a person's preferences, intent, and likely future actions from weeks to years of behavior data. Yet current models are trained on static text or synthetic data, neither of which captures how user behavior evolves over time. Real-world behavior records, already available at scale on content platforms and in personal-assistant agents, offer a natural supervisory signal. We propose user behavior as supervision and introduce Vela, a framework that converts real user behavior data into trainable tasks and trajectories. From the anonymized behavior records of 100,000 users, Vela generates 100,000 tasks across 91 real-world task templates; difficulty-based filtering and trajectory acceptance criteria retain approximately 75,000 tasks with selected training trajectories. Fine-tuning Qwen3.6-35B-A3B on these trajectories improves performance over the base model by up to 11.5 points on user-related tasks and by an average of 4 points on general benchmarks. Training on more user behavior data further improves user-related performance, and reinforcement learning after fine-tuning outperforms reinforcement learning from the base model by up to 7.7 points. These gains suggest that real-world user behavior is a scalable source of supervision for both user-centered capabilities and the broader intelligence of LLMs.

cs.CL↗

arXiv2026

Overlapping Subcritical Bubbles: Free Energy and Lifetime

Subcritical bubbles can form an appreciable population during weak first-order phase transitions, but are usually treated as isolated fluctuations. This raises the question of whether spatial overlap between neighboring subcritical bubbles can modify their evolution. We address this question by combining analytic free-energy calculations for composite Gaussian profiles with Langevin simulations of overlapping configurations. We find that the overlap lowers the free-energy cost and generally increases the lifetime of subcritical bubbles, with the enhanced persistence potentially feeding back on their abundance. Such overlap can therefore generate collective effects and should be incorporated into kinetic descriptions of subcritical-bubble populations.

hep-ph↗

arXiv2026

Your Unlearning Gives You Away: Identifying Erased Concepts in Diffusion Models

Existing attacks on unlearned diffusion models assume that the erased concepts are known in advance and focus on recovering them. In practice, however, model providers may not disclose which concepts have been removed, and even with access to the original base model, an adversary may still lack a clear target to attack. In this paper, we aim to answer the following critical but overlooked questions: which concepts have been erased from the model, and how many have been erased in total? To this end, we present Tracer, a framework that rapidly and accurately identifies erased concepts and estimates their number. Tracer efficiently identifies erased concepts without generating and classifying images. By combining lightweight spectral analysis of weight footprints, it enables efficient search over large candidate vocabularies. To distinguish multiple erased concepts, we introduce a footprint coverage objective that guides sequential discovery. Tracer estimates the number of erased concepts by detecting a sharp decline in candidate confidence as the selected concepts account for the erasure footprint, without requiring labeled examples for calibration. The framework requires only lightweight linear algebra and limited forward probes, with no prior knowledge of the unlearning algorithm. Experiments across text-to-image and text-to-video backbones and diverse unlearning methods demonstrate that Tracer identifies erased concepts and estimates their number in seconds, achieving 150 to 137,000 times and 133 to 20,000 times speedups over MIA and brute-force search on image and video models, respectively, with substantially higher identification accuracy.

cs.LG↗

arXiv2026

Harnessing Measurement Error as a Thermodynamic Resource in Two-Reservoir Information Engines

In general, measurement error constrains the performance of information engines. However, this may not hold universally. In this work, we propose a class of two-reservoirs information engines (TRIEs) with a two-level system and demonstrate that the monotonic relationships between the work output, the efficiency, as well as the work fluctuations of the TRIEs and measurement error are determined by the demon's control parameters. Utilizing this, we establish the conditions that allow the TRIEs to generate useful work under any level of measurement error, and identify the regimes in which these performance parameters can be optimized simultaneously by the measurement error. Furthermore, we demonstrate that when the demon's energy cost is supplied solely by the cold reservoir, the efficiency that accounts for this cost can surpass the standard Carnot bound without violating the second law. Finally, we design a dual Otto cycles TRIE and provide an experimental scheme for its implementation based on a trapped $^{40}\mathrm{Ca}^+$ ion. Significantly, our results can be applied to the multi-level system information engines.

cond-mat.stat-mech↗

arXiv2026

Learning to Learn from Context: Synthetic Training from Perturbed Public Documents

Real-world tasks often require large language models (LLMs) to learn from complex task-specific context rather than pretrained parametric knowledge. This capability remains a weakness of LLMs, while human annotation for such task contexts is expensive and difficult to scale. Public high-quality documents are an abundant alternative, but much of the public web has already been consumed during pretraining: training on such documents naively would reward memorization rather than context learning. In this work, we attempt to make use of high-quality public documents with small perturbations and empirically find that LLMs can successfully generate context-dependent reasoning traces and answers, which are then used to train a student model. Specifically, we construct a synthesis pipeline that (i) rewrites source documents to reduce memorization risk, (ii) generates questions and rubrics that require reasoning over the document, (iii) answers the questions with the document as context, and (iv) admits only samples that genuinely depend on the document. Without any human annotators, our pipeline generates about 10k samples from 3.5k documents, and the resulting student model substantially improves the performance on CL-bench. SFT raises a Qwen3.6-35B-A3B student from 13.7% to 22.8%, and a subsequent rubric-reward RL stage reaches 24.6%, on CL-bench comparable with a frontier model of over a trillion parameters, Qwen3.8-2.4T (23.9%). We also observe a broad transfer of improvements to long-context understanding, instruction following, and reasoning, while code generation and knowledge remain mostly flat. We hope this work provides a reproducible and scalable way to improve the ability of LLMs to learn from context, and to facilitate further research on context-grounded reasoning.

cs.CL↗

arXiv2026

VoxMem: Benchmarking Multimodal Memory in Large Audio Language Models

Spoken conversational systems must recover information from prior interactions (i.e., memory), yet relevant information in speech extends beyond what was said to who said it, how it was spoken, and what was audible, information that exists only in the audio signal and cannot be recovered from a transcript. Beyond what to remember, memory also demands diverse operations: retrieving a single fact, integrating evidence across turns, tracking an evolving state. Real interactions further unfold across sessions, meaning information accumulates across distinct episodes rather than a single continuous recording. Existing benchmarks fall short on all three dimensions: they focus primarily on lexical content, adopt limited and ad hoc memory operations, and treat memory as a single-session problem. We argue that principled memory evaluation requires jointly characterizing the acoustic evidence to be retained and the operations applied to it, and introduce a taxonomy along these two axes. Building on this taxonomy, we present VoxMem: 3,196 evaluation instances over 34,743 spoken sessions (177 hours) crossing four acoustic evidence types (speech semantics, speaker identity, paralinguistic cues, environmental sound) with four memory operations (information extraction, multi-session reasoning, temporal tracking, and answer refusal), grounded in multi-session histories and stratified across context budgets from 8K to 64K tokens. Evaluating 15 LALMs, no model exceeds 40% at 32K. Models retain what was said far better than who said it, how, or what was audible, a gap that widens for complex operations, grows with history length, and manifests as qualitatively distinct failure modes across evidence types. VoxMem aims to provide a foundation to measure and drive progress on the full scope of spoken conversational memory.

eess.AS↗