arXiv Science⌕ Search

arXiv subjects

Dongfu Song

Publications and source records attributed to Dongfu Song.

3 recordsLinked to original sources

Speech Tokenizers are Vulnerable: Transferable Semantic Attack and Robust Tokenizer

Speech tokenizers serve as speech front ends, encoding input speech signals into representations for downstream models, such as automatic speech recognition (ASR) systems and large audio-language models (LALMs). In this paper, we find that speech tokenizers are fragile at the semantic level: small perturbations can disrupt their semantic encoding process and consequently cause severe degradation in downstream ASR and LALM performance. To study this vulnerability, we propose T-SemAttack, a transferable semantic attack based on a semantic encoder ensemble. By jointly drifting the representation spaces of multiple semantic encoders, T-SemAttack effectively disrupts the semantic content of speech while preserving perceptual quality, thereby inducing error features. We further analyze layer-wise representation drift and cross-model gradient alignment. Our findings show that perturbations can induce substantial shifts in deep semantic representations and that the input gradients of different surrogate encoders exhibit directional alignment. These observations suggest that shared adversarially sensitive directions in the input space may be a key factor underlying cross-model attack transferability. Building on these, we introduce ROSETok, a robust speech tokenizer that combines noisy training with robust semantic distillation to improve reconstruction fidelity and downstream SpeechLLM robustness. Extensive experiments on multiple datasets, 9 open-source and black-box ASR systems, and 4 LALMs demonstrate that T-SemAttack achieves strong transferable attack performance, while the proposed Robust Speech Tokenizer exhibits robustness under high-fidelity reconstruction and downstream tasks. Our code and demo are available at https://wxzyd123.github.io/t-semattack.

eess.AS↗

Averaging Collusion Breaks Traceability in Personalized Neural Audio Watermarking

Personalized neural audio watermarking systems embed user-specific payloads into audio to trace the user associated with a leaked or misused copy. Existing evaluations mainly assume access to a single personalized copy, but real-world distribution may expose multiple copies of the same recording. We find that simple sample-wise averaging breaks traceability: averaging only two copies produces tracing-failure rates of 87.7-99.7% across the five systems while largely preserving audio quality. Decoder outputs show distinct responses to coalition payload composition across systems, with high majority agreement in TimbreWM but substantially lower agreement in WMCodec. In a more sophisticated payload-aware setting, mixture weighting can further steer the decoder toward a selected nonmember, achieving a target success rate of 92.3% in TimbreWM. Preliminary confidence screening rejects many collusion-induced assignments while retaining most valid single-copy outputs. Code and results are available at https://github.com/Silwan5z/neural-audio-watermark-collusion-attack. This work highlights multi-copy traceability as an additional evaluation dimension for personalized neural audio watermarking alongside conventional single-copy robustness.

cs.SD↗

3D characterization of ultrasonic melt processing on the microstructural refinement of Al-Cu alloys by synchrotron X-ray tomography

The effect of ultrasonic melting processing on three-dimensional architecture of intermetallic phases and pores in two multicomponent cast Al-5.0Cu-0.6Mn-0.5 Fe alloys is characterized using conventional microscopy and synchrotron X-ray microtomography. The two alloys are found to contain intermetallic phases such as Al15(FeMn)3Cu2, Al7Cu2Fe, Al3(FeMn), Al6(FeMn), and Al2Cu that have complex networked morphology in 3D. The application of USP in alloys can obtained refined and equiaxed microstructures. The grain size of 0.5Fe and 1.0 Fe alloys is greatly decreased from 16.9 m, 15.8 m without USP to 13.3 m, 12.2 m with USP, respectively. The results show that USP significantly reduce the volume fraction, grain size, interconnectivity, and equivalent diameter of the intermetallic phases in both alloys. The volume fraction of pores in both alloys is reduced due to the USP degassing effect. The refinement mechanism of USP induced fragmentation of primary and secondary dendrites via acoustic bubbles and acoustic streaming flow were discussed.

cond-mat.mtrl-sci↗