arXiv Science⌕ Search

arXiv subjects

Pengfei Zhang

Publications and source records attributed to Pengfei Zhang.

At least 37 records · Page 2Linked to original sources
arXiv2026

AudioLens: Multi-Perspective Speech Clustering with Reasoning Audio-Language Models

Audio clustering is a fundamental task for organizing rapidly growing speech collections, supporting applications such as conversational analysis and speech-driven discovery. However, existing methods rely on fixed acoustic similarity metrics or ASR-based text pipelines, limiting their ability to reorganize the same audio collection under different user-specified perspectives, especially when clustering depends on both linguistic and paralinguistic cues. We introduce audio multi-perspective clustering, where a model directly partitions speech recordings according to a natural-language perspective while inferring both the number of clusters and their assignments. To study this setting, we construct AudioLens-Bench, a benchmark spanning multiple application domains and evaluating both in-perspective and cross-perspective generalization. We further propose AudioLens-R1, an end-to-end large audio-language model trained with reasoning distillation and preference optimization. Experiments show that AudioLens-R1 consistently outperforms all baselines, improving overall ARI by 12.99 points and V-measure by 11.62 points. These results demonstrate the promise of native audio-language models for flexible, perspective-conditioned structure discovery over speech collections.

cs.SD↗
arXiv2026

Multimodal Adaptive Control for Safe Robotic Craniotomy Under Partial Observability

Autonomous robotic craniotomy requires continuous regulation of tool-tissue interactions to mitigate mechanical overload and thermal damage while maintaining surgical efficiency. However, this process is inherently partially observable due to unknown, time-varying tissue properties and the inability to directly measure cutting temperatures under physical occlusion. To address these challenges, we propose RL-MACRO, a cybernetic closed-loop intelligence framework that couples multimodal perception, adaptive decision-making, and robotic execution. This framework empowers the surgical robot to autonomously perceive inaccessible states from partial sensory feedback and dynamically optimize its behaviors under uncertain environment. A CNN-LSTM observer first fuses force and sound feedback to reconstruct the hidden temperature state (R^2=0.939, MAE = 1.717 deg C). This reconstructed temperature, alongside multi-sensor features, forms the belief state for an offline Implicit Q-Learning (IQL) policy. A novel dual-head Actor dynamically coordinates the feed rate, spindle speed, and cutting depth to optimize efficiency within strict safety bounds. These decisions are seamlessly translated into spatial motions via online trajectory re-planning and velocity servoing. Experiments on bovine ribs and six ex vivo goat skulls validate the system's robust perception, adaptive recovery from force/temperature excursions, and smooth execution on irregular surfaces, establishing a data-driven cybernetic paradigm for safe and efficient autonomous bone cutting.

cs.RO↗
arXiv2026

DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation

We present \textbf{DreamX-Phi 1.0}, an action-conditioned video world model for robotic manipulation that, given an observed frame, a language instruction, and a prescribed action sequence comprising end-effector poses and gripper states, predicts the resulting future observations. Yet realism alone does not guarantee faithfulness: a convincing rollout can still move the wrong arm or lose the manipulated object. To ensure the prediction respects each arm's commanded path, we inject per-arm $\mathrm{SE}(3)$ transformations into attention via \textbf{PRoPE-style geometric encoding}, preserving arm identity and rigid-motion structure. Action control alone does not fully constrain scene geometry or the evolution of small manipulated objects. We therefore add a lightweight \textbf{depth branch} for scene-level geometry and use \textbf{SAM3 masks} with a frozen \textbf{V-JEPA teacher} to maintain object consistency throughout grasping. We further distill the multi-step generator into a few-step student via distribution-matching distillation for efficient deployment. At the time of writing, \model{} achieves first place on Track~1 and second place on Track~2 of the WorldArena~2.0 Challenge. Our model and code will be publicly available.

cs.CV↗
arXiv2026

Evaluation-Verification Reward for Consistent Multi-Reference Image Editing

While recent image editing models have made rapid progress, multi-reference editing remains challenging, particularly in maintaining visual consistency across references and ensuring overall visual harmony. Reinforcement learning has proven highly effective for text-to-image generation and single-image editing, but its extension to multi-reference editing is hindered by the absence of suitable reward models that capture multi-image relational constraints. Moreover, naively using multimodal large language models(MLLMs) as zero-shot evaluators faces a key tension between hallucination-prone long-form reasoning and the limited deductive power of short-form judgments. We address these issues with a Multi-dimensional Evaluation-Verification Reward(EVR). EVR decomposes evaluation into distinct visual criteria; for each criterion, an MLLM Evaluator generates multiple candidate hypotheses, and a Verifier grounds each claim in concrete visual evidence to accept or reject it, producing reliable and fine-grained reward signals. Together with a scalable data pipeline, our method enables RL fine-tuning of off-the-shelf editors without architectural changes. Extensive experiments show substantial gains over the base Qwen-Image-Edit, improving consistency and harmony to match or surpass NanoBanana.

cs.CV↗
arXiv2026

Robust Estimation of Sparse Numerical Vectors under Local Differential Privacy

Local differential privacy (LDP) protocols are vulnerable to poisoning attacks. Existing research have proposed efficient defense strategies for single-item users. However, in practice, a user may possess multiple items. The defense against poisoning attacks for multi-item users is challenging, because due to larger output spaces, the adversary can conduct more powerful attacks without being detected. In this paper, we address the robust sparse vector mean estimation problem, in which each user has a vector with $m$ nonzero coordinates. We propose Randomized Projection with Clipping (RPC). Firstly, the server sends a random binary vector to each user. The user then projects its local data on the vector, and clip the value to restrict the attacker's capability. To handle clipping bias, we propose a correction method based on a careful analysis that gives an exact expression of the bias. As a result, bias-variance tradeoff is no longer needed, thus the clipping threshold can be further reduced to shrink the output space and enhance robustness. We provide a rigorous theoretical guarantee of the estimation error under all possible attacks. Numerical experiments show that under trusted environments, our new method achieves comparable or better performance than existing methods, indicating that our method is already an efficient estimator in its own right. Under untrusted environments, our method is also significantly more robust to poisoning attacks.

stat.ML↗
arXiv2026

Listen, Do Not Copy: Internalizing Audio-Grounded Scaffold Context for Robust Omni-Model Speech Understanding

Omni models transcribe clean, single-speaker speech well, but their accuracy drops sharply when speakers overlap and the scene is noisy, exactly where knowing who said what matters most. A natural fix is a short scene description. We show why this is risky: answer-bearing text lets the model copy instead of listen, so the score rises although nothing has been heard; a silent test exposes this shortcut at once. We call this failure mode perception bypass and address it with Audio-Grounded Scaffold Context (AGSC). AGSC links three steps: first, we build clues from audio to guide listening without giving the answer; second, answer-overlap and silence tests probe them for leakage and audio dependence; finally, those clues scaffold training but vanish at test time, yielding no-clue capability. Across three heterogeneous Omni models, training on AGSC lowers no-clue capped mean permutation word error rate (mpWER) on overlapping, noisy speech from 25%-71% to 9%-15%. For streaming control, we formulate a joint GDPO task in which the model learns when to use a clue and how to produce a speaker-attributed transcript from separately normalized format, gate, and transcript rewards. After internalization, AGSC adds almost no inference overhead.

cs.SD↗
arXiv2026

AI Empowered Communication and Radar Modulation Recognition: A Survey

Automatic modulation recognition (AMR) is of vital importance for ensuring communication and radar reliability, efficient spectrum utilization and resistance to electronic interference. The development of artificial intelligence (AI) technology is reshaping the technological paradigm of AMR, promoting its transition from traditional modes relying on manual features to data-driven intelligent recognition. This change is not only reflected in the significant improvement of recognition accuracy, but also injects strong momentum into the intelligent evolution of both communication and radar systems through algorithm innovation, architecture optimization, and scenario expansion. In order to clarify the current development status and bottlenecks of AMR, and to find breakthrough directions, we make a comprehensive survey of recent AI-based technologies for AMR in this paper, including model-based machine learning (ML) methods and data-driven deep learning (DL) methods. We first investigate the modulation types used in current communication and radar systems. Next, we summarize the typically used features in the field of AMR, and discuss their inherent advantages and disadvantages. Then, we introduce the basic AI models for AMR and conduct a hierarchical investigation of AMR methods for communication and radar. Finally, based on existing research works, we highlight open issues and propose future research directions for AMR.

eess.SP↗
arXiv2026

AG-REPA: Causal Layer Selection for Representation Alignment in Audio Flow Matching

REPresentation Alignment (REPA) improves the training of generative flow models by aligning intermediate hidden states with pretrained teacher features, but its effectiveness in token-conditioned audio Flow Matching critically depends on the choice of supervised layers, which is typically made heuristically based on the depth. In this work, we introduce Attribution-Guided REPresentation Alignment (AG-REPA), a novel causal layer selection strategy for representation alignment in audio Flow Matching. Firstly, we find that layers that best store semantic/acoustic information (high teacher-space similarity) are not necessarily the layers that contribute most to the velocity field that drives generation, and we call it Store-Contribute Dissociation (SCD). To turn this insight into an actionable training guidance, we propose a forward-only gate ablation (FoG-A) that quantifies each layer's causal contribution via the induced change in the predicted velocity field, enabling sparse layer selection and adaptive weighting for alignment. Across unified speech and general-audio training (LibriSpeech + AudioSet) under different token-conditioning topologies, AG-REPA consistently outperforms REPA baselines. Overall, our results show that alignment is most effective when applied to the causally dominant layers that drive the velocity field, rather than to layers that are representationally rich but functionally passive.

cs.SD↗
arXiv2026

Human-Inspired Framework for Robotic Craniotomy: Integrating Multimodal Fusion and Adaptive Trajectory Adjustment

Manual craniotomy is a high-risk, skill-dependent procedure associated with surgeon fatigue and potential dural injury. While robotic approaches have improved safety, existing open-loop systems rely solely on preoperative images and cannot compensate for intraoperative registration errors or tissue deformation. To address this, we propose a human-inspired closed-loop robotic craniotomy framework that intelligently integrates preoperative planning with intraoperative execution. An adaptive dual-contour fusion algorithm is employed to generate trajectories that conform to complex cranial geometries while maintaining a consistent tool-bone relative pose. For intraoperative perception, a multimodal two-stage cross-modal attention block (CMA)-temporal convolutional network (TCN)-Transformer network combined with an adaptive Bayesian filter fuses force and acoustic signals to achieve robust breakthrough detection under varying bone conditions. Upon detection, an in-situ projection-based trajectory adjustment strategy dynamically compensates for depth deviations, enabling safe residual bone isolation. Experiments on bovine ribs show a breakthrough prediction accuracy of 97%, a detection latency of 0.048 +/- 0.097 s, and a maximum overshoot of 0.29 mm. All four ex vivo cranial experiments were successfully completed without dural injury. These results demonstrate that the proposed cybernetic framework enables safe and autonomous craniotomy with highly effective closed-loop control.

cs.RO↗
arXiv2026

Detector-level simulation closure of radio air-shower reconstruction with native RF-chain inversion and out-of-fold endpoint interpolation

Autonomous radio arrays reconstruct air showers from trigger-selected digitized voltage traces rather than ideal electric-field footprints. We present a detector-level simulation-closure test linking RF-chain-triggered ZHAireS event packages to reconstructed direction, energy and quality diagnostics. Voltage amplitudes and station timing determine geometry through a robust joint timing--amplitude axis fit. Native-grid RF-chain inversion recovers 50--200 MHz electric-field peaks along the shower-plane v cross B axis. Symmetric four-arm iron and proton templates generated with 2 ns time bins provide endpoint estimates that are combined by a nested five-fold out-of-fold interpolation estimator. One estimator is used over the full angular range without a fitted multiplicative energy scale. Of 972 triggered event packages, 725 pass common quality selection in raw-noisy weighted, hard-gated denoised equal-weight and clean equal-weight branches. In the primary reconstructed-zenith range 60--85 degrees, 693 common events have mean energy residuals of -0.05, -0.30 and -0.66 percent with standard deviations of 11.04, 10.90 and 10.75 percent. The hard-gated denoised branch has a median angular separation of 0.052 degrees. Boundary zenith ranges are reported separately; the upper boundary has a mean energy residual of +14.2 percent and a 19.9 percent standard deviation. These results describe cross-fitted closure within a matched simulation framework, not deployed-array resolution or independent energy calibration.

astro-ph.IM↗
arXiv2026

Discovery of $γ$-Ray Pulsations from the Extreme-Spin-Down Millisecond Pulsar PSR J0435+3233

Motivated by the recent discovery of PSR~J0435+3233, a millisecond pulsar with an exceptionally large period derivative of $\dot{P}=4.9\times10^{-17}\ {\rm s\,s^{-1}}$ and a high spin-down luminosity of $\dot{E}=5.89\times10^{37}\ {\rm erg\,s^{-1}}$, we analyze $\sim$17~yr of observations obtained with the \textit{Fermi} Large Area Telescope for the pulsar. We identify the cataloged source 4FGL~J0435.5+3232, located only $0.01^{\circ}$ from the radio timing position, as the $γ$-ray counterpart of PSR~J0435+3233. Using $γ$-ray events collected within the validity interval of the radio timing ephemeris, we detect its $γ$-ray pulsations at a $\sim6.8σ$ confidence level. In this interval, the phase-resolved analysis shows that the pulsed emission is concentrated predominantly within the rotational-phase of $ϕ\sim0.44$--$0.69$. We also derive its $γ$-ray luminosity of $L_γ=6.26\times10^{32}\ {\rm erg\,s^{-1}}$, assuming a distance of 1.2~kpc and isotropic emission. This luminosity corresponds to an apparent $γ$-ray efficiency of $η_γ\sim1.1\times10^{-5}$, revealing an exceptionally low $γ$-ray output despite the pulsar's young-pulsar-like rotational-energy budget. Our detection establishes PSR~J0435+3233 as a $γ$-ray MSP, and the striking combination of its high spin-down power and low apparent $γ$-ray efficiency provides a new probe of particle acceleration, radiation beaming, and viewing geometry in the magnetospheres of millisecond pulsars with extreme rotational properties.

astro-ph.HE↗
arXiv2026

Emergence of the Scrooge Ensemble in the Sachdev-Ye-Kitaev Model

The probabilistic nature of quantum measurement provides a direct window into the structure and complexity of many-body wave functions. When only part of a system is measured, the remaining degrees of freedom form an ensemble of post-measurement states whose statistical structure can reveal a stronger form of thermalization, known as deep thermalization. Recent numerical evidence suggests that this phenomenon is characterized by convergence of the projected ensemble to the Scrooge ensemble, a maximally random ensemble compatible with a given density matrix. In this Letter, we use the solvable Sachdev-Ye-Kitaev (SYK) model to unveil the mechanism by which the Scrooge ensemble emerges in many-body systems. By formulating measurement probabilities and post-measurement states in terms of path integrals, we analytically characterize all moments of the projected ensemble and show that they exactly match those of the Scrooge ensemble, even at short evolution times. We further connect this result to the saddle-point structure of the measurement path integral, which naturally generates the replica permutations underlying Scrooge statistics. Our results establish the solvable SYK model as a tractable setting for exploring universal statistics of quantum measurements in chaotic many-body dynamics.

quant-ph↗
arXiv2026

Exact Hilbert-space ergodicity from continuous monitoring

Quantum evolution is generally expected to drive a quantum many-body system toward equilibrium. This expectation is often justified by the Hilbert-space ergodicity of generic quantum dynamics, namely, the idea that pure-state evolution explores Hilbert space uniformly up to physical constraints. Such a statement can be made rigorous by requiring the associated state ensemble to form the Haar-random ensemble, or its more structured generalization, the Scrooge ensemble. In this Letter, we report the emergence of exact Hilbert-space ergodicity in a continuously monitored quantum many-body system. For any target density matrix $σ$, we construct a continuously monitored system for which we rigorously prove that the Scrooge ensemble of $σ$ is the unique late-time equilibrium distribution of quantum trajectories. Remarkably, this requires only that the jump operators in the monitoring form a deformed unitary 1-design, a seemingly much weaker condition than full ergodicity. We numerically demonstrate our predictions by simulating continuously monitored systems whose equilibrium states are thermal states. Our results establish a rigorous mechanism for the emergence of Hilbert-space ergodicity and provide a practical route for its investigation on quantum devices.

quant-ph↗
arXiv2026

Anomalous Air Showers and What They Reveal About Hadronic Interactions and Cosmic-ray Masses

The identification of the sources and acceleration mechanisms of cosmic rays require precise measurements of their mass composition. Currently, the most reliable method is to measure the atmospheric depth at which cosmic ray air showers in our atmosphere reach their maximum (\Xmax). However, the hadronic interaction properties that govern the longitudinal development of air showers are not precisely known, which is a major source of systematic uncertainty on the mass composition. SKA-Low will observe cosmic rays in the 10$^{16}$ - 10$^{18}$ eV energy range with unprecedented resolution and bandwidth. This allows for a much more detailed reconstruction of the longitudinal shower evolution, which can be used to gain better understanding of the hadronic interactions, as well as the primary mass composition. After the first interaction of the cosmic ray with an atom in an air molecule, the secondary particles still carry a significant fraction of the total energy. When one of these particle travels very far before interacting again, it produces a sub-shower that can be recognized as a secondary bump in the longitudinal profile. Simulations have demonstrated that SKA-Low can resolve such double bump profiles by virtue of its high antenna density and broad bandwidth. In this chapter, we demonstrate how double-bump showers and other anomalous longitudinal developments can be used to constrain hadronic interaction properties, and to determine the mass composition of cosmic rays in the Galactic-to-extragalactic transition region.

astro-ph.HE↗
arXiv2026

Measuring High-Energy Cosmic Particles with the SKA

The origin of high-energy cosmic rays remain one of astrophysics' greatest unsolved mysteries. SKA-Low will be able to measure air showers initiated by cosmic rays with unprecedented precision in the PeV - EeV energy range, covering the critical transition region between Galactic and extragalactic sources. SKA-Low's densely instrumented core and broad bandwidth will allow for measurements of individual air showers with a level of detail unmatched by any existing or planned detector. The depth of shower maximum, the primary mass-sensitive observable, will be reconstructed with a resolution of better than 8~g/cm$^2$, a significant improvement over existing methods. Additionally, new reconstruction methods are expected to enable full air shower reconstruction across a wide energy range, down to PeV levels. At these energies, efficient photon/hadron separation may offer an opportunity to measure PeV gamma-ray air showers. Furthermore, SKA-Low opens a window into studying high-energy hadronic interactions, including via the unique channel of anomalous air showers. This combination of measurements provides a unique opportunity to investigate the origins and physics of high-energy cosmic rays. A dedicated particle detector array will provide triggered readout of raw antenna-level voltage buffers, enabling fully commensal cosmic-ray observations alongside regular operations. We outline our science case and discuss the observational strategy, signal properties and detector design underpinning these measurements. We also summarize the accompanying book chapters, which address composition measurements in the Galactic-to-extragalactic transition region, next-generation interferometric reconstruction techniques, hadronic interaction physics through anomalous air showers, the prospects for detecting PeV gamma-rays from Galactic sources, and the related project of imaging lightning using SKA-Low.

astro-ph.HE↗
arXiv2026

Using SKA-Low to Detect PeV Gamma-rays from Galactic Sources

Detecting so called PeVatrons is considered one of the prime goals of $γ$-ray astronomy. PeVatrons are astrophysical objects in the Galaxy that are sources of cosmic rays exceeding PeV ($10^{15}$ eV) energies, the highest in our Galaxy. Their nature is unknown as of now, with some candidates reaching barely above PeV energies just having been identified. Serendipitously, the energy threshold of air shower detection using radio emission, has been proven at 50 PeV. There is a case to be made that SKA-Low with its unprecedented number of antennas, can reach lower in energy, while the size of the core is sufficiently large provide a significant effective area to measure PeV fluxes. While this promises a novel angle towards understanding the cosmic ray accelerators in our Galaxy, it also would be the first detection of $γ$-ray air showers using radio emission.

astro-ph.HE↗
arXiv2026

Interferometric Analysis of Air-shower Radio Emission in the Near Field with an Information Field Theory Approach

Current reconstruction techniques for air-shower radio emission generated by cosmic rays have shown great success, having been applied to several radio detectors over the last decade. Nevertheless, they are limited by their high computational cost, simplified approximations, and signal information used for reconstruction. As such, advanced analyses are required to not only be able to perform a holistic reconstruction of all parameters, but also to conduct near-field interferometry of the air shower. This can be achieved through Information Field Theory (IFT), an imaging reconstruction framework based on Bayesian inference that can extract all available information within the signal to infer distributions of field-like quantities. In this chapter, we highlight current novel approaches that use IFT for air shower reconstruction, and the potential of their applicability towards SKA-Low.

astro-ph.IM↗
arXiv2026

From Sounds to Scenes: A Benchmark for Evaluating Context-Aware Auditory Scene Understanding in Large Audio Language Models

Recent Large Audio Language Models (LALMs) have achieved remarkable progress in audio perceptual tasks across individual acoustic layers, including speech, sound, and music. However, existing benchmarks predominantly evaluate these layers in isolation, overlooking the complex contextual relationships that arise when multiple acoustic sources co-occur in real-world auditory scenes. Real-world auditory interpretation requires Context-Aware Auditory Scene Understanding (CASU): the ability to comprehend the holistic scene by integrating sound layers. To evaluate this capability, we introduce the CASU benchmark, which assesses whether Audio LLMs can interpret auditory scenes composed of speech, acoustic events (e.g., announcements), and background environments (e.g., traffic), and reason about the logical relationships between these layers. We propose a scalable pipeline for constructing time-accurate, semi-synthetic audio streams by composing real-world scene sounds with synthetic speech. Building on this data, we design four tasks that probe scene understanding: contextual question answering, entity extraction from the scene, speaker role inference, and counterfactual reasoning where scene is manipulated. Experiments across multiple LALMs demonstrate that effective auditory scene understanding requires integration over all auditory layers, rather than reliance on speech or sound alone, underscoring the necessity of CASU for advancing complex audio understanding in LALMs.

cs.SD↗