arXiv Science⌕ Search

arXiv subjects

Xiaoxue Yang

Publications and source records attributed to Xiaoxue Yang.

9 recordsLinked to original sources

Heads of Security: Learned Attention Gates Improve Prompt Injection Robustness

We introduce Heads of Security (HoS), a prompt injection defense that enforces instruction-data separation via a small set of learned per-head attention gates. HoS learns how each head should redistribute attention between trusted and untrusted tokens, enabling models to reason over untrusted content without following injected instructions. We evaluate HoS on Llama-3.3-70B-Instruct and GPT-OSS-20B. We compare it against SecAlign++, a state-of-the-art finetuning-based defense, and ASIDE, a defense that, like ours, builds instruction-data separation into the model architecture. We show that HoS offers greater robustness to adaptive attacks, better performance on standard utility benchmarks, and matches top performance on standard agentic prompt injection benchmarks. More specifically, the black-box RL-Hammer attack reaches 97% ASR against GPT-OSS-20B and 85% against SecAlign, but only 10% against HoS. Claudini, a state-of-the-art white-box attack, strengthened against HoS through autoresearch, requires 3 times more FLOPs to reach the same ASR on HoS as it does on GPT-OSS-20B or SecAlign. HoS preserves base-model utility across standard multiple-choice benchmarks and prompting setups, whereas SecAlign and ASIDE degrade in few-shot settings. On agentic benchmarks with static attacks, HoS and SecAlign perform similarly and substantially improve the security-utility trade-off over the base model. ASIDE struggles with tool use, achieving only 10% utility. These results show that prompt injection robustness can be achieved and improved through targeted attention interventions.

cs.LG↗

Auditing Prompt Injection Defenses Before They Reach Users: What Strong Adversaries Reveal

Large language models are increasingly deployed in user-facing products that handle sensitive personal data while interacting with untrusted external content. This makes them a prime target for prompt injection attacks, in which an adversary injects malicious instructions in that content to hijack the model. Fine-tuning-based defenses have been proposed to mitigate these attacks by training models to follow benign user instructions and ignore injected ones. Lacking formal guarantees, these defenses are evaluated empirically against the most effective realistic attacks available at the time, often reporting near-zero attack success rates -- giving developers, and the users who depend on them, a false sense of security and leaving open the possibility that future, more capable attacks could circumvent them and cause severe consequences in widely deployed systems. In this paper, we argue that developers should stress-test their defenses before release, and we introduce an auditing framework that does so without requiring defenders to invent the next state-of-the-art attack. Our key insight is that the fine-tuning process itself yields useful artifacts: intermediate checkpoints that serve as stepping stones for optimization-based attacks. Although these artifacts are unavailable to real attackers, we show that the vulnerabilities they expose are genuine and can be exploited by realistic adversaries. Instantiating our framework with optimization-based attacks such as GCG and BEAST, we raise attack success rates against state-of-the-art defenses from near zero to as high as 96\%, revealing weaknesses missed by prior evaluations. Our results show that current evaluation practices can substantially overestimate robustness, and that auditing defenses under strong adversaries before deployment shortens the feedback loop and helps prevent attacks from causing real-world harm to users.

cs.CR↗

Multi-Turn Jailbreaks Are Simpler Than They Seem

While defenses against single-turn jailbreak attacks on Large Language Models (LLMs) have improved significantly, multi-turn jailbreaks remain a persistent vulnerability, often achieving success rates exceeding 70% against models optimized for single-turn protection. This work presents an empirical analysis of automated multi-turn jailbreak attacks across state-of-the-art models including GPT-4, Claude, and Gemini variants, using the StrongREJECT benchmark. Our findings challenge the perceived sophistication of multi-turn attacks: when accounting for the attacker's ability to learn from how models refuse harmful requests, multi-turn jailbreaking approaches are approximately equivalent to simply resampling single-turn attacks multiple times. Moreover, attack success is correlated among similar models, making it easier to jailbreak newly released ones. Additionally, for reasoning models, we find surprisingly that higher reasoning effort often leads to higher attack success rates. Our results have important implications for AI safety evaluation and the design of jailbreak-resistant systems. We release the source code at https://github.com/diogo-cruz/multi_turn_simpler

cs.LG↗

Balanced Mixed-Type Tabular Data Synthesis with Diffusion Models

Diffusion models have emerged as a robust framework for various generative tasks, including tabular data synthesis. However, current tabular diffusion models tend to inherit bias in the training dataset and generate biased synthetic data, which may influence discriminatory actions. In this research, we introduce a novel tabular diffusion model that incorporates sensitive guidance to generate fair synthetic data with balanced joint distributions of the target label and sensitive attributes, such as sex and race. The empirical results demonstrate that our method effectively mitigates bias in training data while maintaining the quality of the generated samples. Furthermore, we provide evidence that our approach outperforms existing methods for synthesizing tabular data on fairness metrics such as demographic parity ratio and equalized odds ratio, achieving improvements of over $10\%$. Our implementation is available at https://github.com/comp-well-org/fair-tab-diffusion.

cs.LG↗

Analog of photon-assisted tunneling originated from dark Floquet state in periodically modulated waveguide arrays

We theoretically report an analog of photon-assisted tunneling (PAT) in a periodically driven lattice array without a static biased potential by studying a three-channel waveguide system. This analog of PAT can be achieved by only periodically modulating the top waveguide and adjusting the distance between the bottom and its adjacent waveguide. It is numerically shown that the PAT resonances also exist in the five-channel waveguide system and probably exist in the waveguide arrays with other odd numbers of waveguides, but they will become weak as the number of waveguides increases. With origin different from traditional PAT, this type of PAT found in our work is closely linked to the existence of the zero-energy (dark) Floquet states. It is readily observable under currently accessible experimental conditions and may be useful for controlling light propagation in waveguide arrays.

quant-ph↗

Coherent destruction of tunneling in a lattice array with controllable boundary

We have investigated how the dynamics of a quantum particle initially localized in the left boundary site under periodic driving can be manipulated via control of the right boundary site of a lattice array. Because of the adjustable coupling between the right boundary site and its nearest-neighbor, we can realize either coherent destruction of tunneling to coherent tunneling (CDT-CT) transition or coherent tunneling to coherent destruction of tunneling (CT-CDT) transition, by driving or moving the right boundary site while keeping the left boundary site driven by a periodically oscillating field with a fixed driving parameter. In particular, the transition direction shows odd-even sensitivity to the number of lattice sites. We have also revealed that our proposed CDT-CT transition is robust against the second order coupling (SOC) between next-nearest-neighbor sites in odd-$N$-site systems, whereas localization can be significantly enhanced by SOC in even-$N$-site systems. More interestingly, it is found destruction and revival of CDT observable in non-high-frequency regimes. Our results can be readily verified within the capacity of current experiments.

quant-ph↗

Correlation and entanglement of two-component Bose-Einstein condensates in a double well

We consider a novel system of two-component atomic Bose-Einstein condensate in a double-well potential. Based on the well-known two-mode approximation, we demonstrate that there are obvious avoided level-crossings when both interspecies and intraspecies interactions of two species are increased. The quantum dynamics of the system exhibits revised oscillating behaviors compared with a single component condensate. We also examine the entanglement of two species. Our numerical calculations show the onset of entanglement can be signed as a violation of Cauchy-Schwarz inequality of second-order cross correlation function. Consequently, we use Von Neumann entropy to quantity the degree of entanglement.

cond-mat.other↗

Deformed Two-Mode Quadrature Operators in Noncommutative Space

Starting from noncommutative quantum mechanics algebra, we investigate the variances of the deformed two-mode quadrature operators under the evolution of three types of two-mode squeezed states in noncommutative space. A novel conclusion can be found and it may associate the checking of the variances in noncommutative space with homodyne detecting technology. Moreover, we analyze the influence of the scaling parameter on the degree of squeezing for the deformed level and the corresponding consequences.

hep-th↗

Many-body dynamics of a Bose system with attractive interactions on a ring

We investigate the many-body dynamics of an effectively attractive one-dimensional Bose system confined in a toroidal trap. The mean-field theory predicts that a bright-soliton state will be formed when increasing the interparticle interaction over a critical point. The study of quantum many-body dynamics in this paper reveals that there is a modulation instability in a finite Bose system correspondingly. We show that Shannon entropy becomes irregular near and above the critical point due to quantum correlations. We also study the dynamical behavior of the instability by exploring the momentum distribution and the fringe visibility, which can be verified experimentally by releasing the trap

cond-mat.other↗