arXiv Science⌕ Search

arXiv subjects

Heng Xu

Publications and source records attributed to Heng Xu.

At least 19 recordsLinked to original sources

Hijacking a Trusted LLM in Real-World Quantized Deployments Only Requires a Disguised Adapter

Third-party low-rank adaptation (LoRA) adapters are tailored to perform decision tasks such as content moderation and function selection. However, in the real world, quantized deployments carry a potential threat in that an adapter can pass an audit with the unquantized base, yet hijack decisions when the same base is quantized for deployment. Demonstrating this threat requires an adapter that preserves benign behavior before quantization, but hijacks decisions afterward. Further, this must hold without modifying the trusted base or knowing the victim's quantization configuration. We therefore present QHijack-LoRA, an adapter-only attack that uses the base model's natural quantization residual to activate decision hijacking. The attacker modifies neither the trusted base model nor the victim's quantization configuration. With QHijack-LoRA, a four-objective training procedure separates full-precision dormancy from quantized target activation, while preserving clean-input behavior. The adapter is trained across several different quantization methods, while adaptive reweighting and residual-direction augmentation extend the attack to unseen configurations. Our results show that auditing performed exclusively under full-precision conditions does not provide assurance of decision integrity in quantized deployment environments. Thus, we also propose a cross-precision paired audit that checks the candidate adapter in its intended deployment configuration. This work shows the critical need to audit third-party adapters in any potential quantized deployment.

cs.CR↗

Class Machine Unlearning for Complex Data via Concepts Inference and Data Poisoning

Machine unlearning aims to remove the influence of specified training data or knowledge from a trained model without requiring full retraining. This capability is particularly important for modern image classifiers and large language models (LLMs), where retraining can be computationally expensive. However, machine unlearning on complex data remains difficult because the target information is often distributed across multiple semantic elements. Existing methods mainly remove samples, modify labels, or edit model parameters to reduce the influence of the forgetting target. These approaches usually do not explicitly identify which semantic concepts connect the forgetting target to the model's prediction or generated response. As a result, it is difficult to determine which information to modify. This uncertainty may leave residual target information or unnecessarily affect knowledge that should be retained. To address this gap, we propose a concept-guided poisoning unlearning framework that explicitly identifies the concepts that contribute most strongly to the target class or knowledge and uses them to guide the model update. For image classification, our method first identifies class-relevant concepts with a Post-hoc Concept Bottleneck Model, localizes the image regions that express these concepts, and constructs replacement-based poisoned samples. For LLMs, it elicits the target knowledge through multiple questions, aggregates Integrated Gradients across the resulting responses to identify consistently important content, and masks this content to construct poisoned training targets. Experiments on multiple datasets show that the proposed framework achieves effective unlearning across different tasks while largely preserving retained model utility.

cs.LG↗

RailWave: Adaptive Spatial and Temporal Scheduling for Expert-Parallel Communication

Irregular All-to-All communication is a major bottleneck in expert-parallel Mixture-of-Experts (MoE) models. Even with fixed expert routing and placement, uneven utilization of parallel network Rails and incast can limit communication performance. We present RailWave, a phase-adaptive communication layer built on DeepEP that addresses these bottlenecks below the routing layer through spatial and temporal traffic shaping. RailBalance redistributes source traffic across eligible Rails using source-local information, while a reusable, topology-derived permutation schedule limits concurrent senders per receiver without rebuilding demand-dependent schedules for each communication phase. A lightweight calibrated selector chooses an execution path according to each phase's traffic characteristics and offline profiling results. On training-derived communication workloads from the 106B GLM-4.5-Air model, RailWave delivers up to 5.84x speedup on H800 and 4.36x on H20 over Native. Code is available at https://github.com/CyberSecurityErial/RailWave-EP.

cs.DC↗

Pressure-induced Structural Phase Transition, Metallization, and Superconductivity in layered metalloid dichalcogenide 1T-SiTe$_2$

Layered transition-metal dichalcogenides (TMDs) have attracted considerable attention as promising platforms for exploring emergent physics and potential device applications. In contrast, metalloid-based dichalcogenide counterparts remain largely underexplored. Here, we report the pressure-induced structural phase transition, metallization, and superconductivity in the layered metalloid dichalcogenide 1T-SiTe$_2$. At ambient pressure, 1T-SiTe$_2$ crystallizes in a trigonal crystal structure (space group: $P\bar{3}m1$) and exhibits intrinsic semiconducting transport characteristics. Upon pressurization, in concomitant with the suppression of semiconducting behavior in resistance, superconductivity emerges at around 6.7 GPa. The superconducting transition temperature (T$_c$) rises continuously with increasing pressure and finally saturates at approximately 5.5 K for pressures above 30 GPa. During the compression, 1T-SiTe$_2$ experiences three structural phase transitions, and the phase transition pressures are highly consistent with the anomalous transport responses observed experimentally, indicating that the changes of transport behavior of 1T-SiTe$_2$ under pressure are structurally-driven. Our work extends TMD superconductors into the realm of metalloid systems and provides a new platform for exploring novel physics in quasi two-dimensional materials without transition-metal elements.

cond-mat.supr-con↗

Random Polarization Position Angle Behaviors across Bursts of Repeating Fast Radio Bursts

Fast radio bursts (FRBs), highly polarized, mostly have a nearly constant polarization position angle (PA) during each burst. Their PAs are observed to vary from burst to burst, with the statistical properties remaining stable across different observation sessions. We found that the intrinsic PAs of repeating FRBs are approximately Gaussian distributed, suggesting that the emission likely originates from a localized region within the neutron star's magnetosphere. A periodicity search of the PA time series using the Lomb-Scargle periodogram reveals no credible periodic signal in the period range from 10 ms to $10^7$ ms, and similar analyses of several active observations also yield null detections. We interpret these properties by extending the rotating vector model to include a dynamically evolving magnetosphere, in which the effective magnetic axis varies from burst to burst due to stochastic perturbations. In this framework, the observed PA distributions can naturally arise from geometric projection effects, and the absence of periodicity reflects the random wandering of the magnetic axis within a confined region. This scenario provides a natural explanation for both repeating and apparently non-repeating FRBs.

astro-ph.HE↗

SMI: Statistical Membership Inference for Reliable Unlearned Model Auditing

Machine unlearning (MU) is essential for enforcing the right to be forgotten in machine learning systems. A key challenge of MU is how to reliably audit whether a model has truly forgotten specified training data. Membership Inference Attacks (MIAs) are widely used for unlearned model auditing, where samples that evade membership detection are regarded as successfully forgotten. We show this assumption is fundamentally flawed: failed membership inference does not imply true forgetting. We prove that unlearned samples occupy fundamentally different positions in the feature space than non-member samples, making this alignment bias unavoidable and unobservable, which leads to systematically optimistic evaluations of unlearning performance. Meanwhile, training shadow models for MIA incurs substantial computational overhead. To address both limitations, we propose Statistical Membership Inference (SMI), a training-free auditing framework that reformulates auditing as estimating the non-member mixture proportion in the unlearned feature distribution. Beyond estimating the forgetting rate, SMI also provides bootstrap reference ranges for quantified auditing reliability. Extensive experiments show that SMI consistently outperforms all MIA-based baselines, with no shadow model training required. Overall, SMI establishes a principled and efficient alternative to MIA-based auditing methods, with both theoretical guarantees and strong empirical performance.

cs.LG↗

FAST Polarization Catalog of FRB 20240114A

Polarization measurements of fast radio bursts (FRBs) probe the magnetized plasma surrounding their central engines. FRB~20240114A is an exceptionally active repeating source, with 17,356 bursts detected between 2024 January 28 and 2025 May 30 by FAST, enabling time-resolved polarimetric studies. In this work, we present a polarimetric catalog of 6,131 bright bursts (with a signal-to-noise ratio S/N $\geq$ 20, 35.3% of the total sample), including arrival time (MJD$_{\text{topo}}$), dispersion measure (DM), burst width (W$_{\text{eff}}$), bandwidth, Faraday rotation measure (RM), linear and circular polarization degrees (DOL, DOC), and intrinsic polarization angle (PA$_0$). We detect a clear temporal evolution of RM: after an initial stable phase, it decreases linearly by $\sim$200 $\rm rad\ m^{-2}$ over 200 days, forming a bimodal distribution, whereas DM remains stable at 528.9 $\rm pc\ cm^{-3}$. The linear polarization fraction is generally high, with the 3$σ$ lower bound around 76%, while circular polarization is low, with 1,157 of 17,356 bursts (6.67%) having DOC $\geq$10%. We perform a power-law fit between $|\textrm{V}|$/I and $|\textrm{RM}|$, which yields an index of $-2.98 \pm 0.80$. It is found that the combined 2D distribution of L/I versus V/I remains stable, implying that the emission mechanism is largely invariant. Our PA$_0$ measurements show a broad, non-uniform distribution, implying a complex emission geometry. These results suggest that FRB~20240114A resides in a dynamically evolving magneto-ionic environment. This catalog provides a foundation for studies of repeating FRB progenitors and their environments.

astro-ph.HE↗

To understand the radiative processes of pulsars and fast radio bursts with the FAST

The radiative mechanism of coherent radio emission has remained an enigma since the discovery of pulsars, even the emergence of fast radio bursts (FRBs), which exhibit similarities to the single-pulse behavior of pulsars and have opened a new view for deciphering the long-standing mystery. Besides tremendous efforts in modelling, advanced facilities matter for solving the problem. The authors review the observational breakthroughs from the Five-hundred-meter Aperture Spherical radio Telescope (FAST), which are providing pivotal insights to unravel the underlying physics of pulsars and FRBs. This study offers a novel perspective in the era when pulsars meet FRBs, and further investigations are encouraged to utilize the highly sensitive telescope, the FAST.

astro-ph.HE↗

Joint Observation of SGR J1935+2154 with \textit{Insight}-HXMT and KM40m during the active episode of October 2022

SGR J1935+2154 is the unique magnetar so far from which fast radio bursts have been detected. In October 2022, it resumed its burst activity, and we implemented a dedicated target-of-opportunity (ToO) observation on it from Oct. 13th to Nov. 1st, 2022 (about 940 ks in total) with \textit{Insight}-HXMT, while the KM40m radio telescope observed this source for about 1400 hours since Oct. 15th. We searched the LE, ME, and HE data of \textit{Insight}-HXMT in the overlapping observation time windows with the KM40m radio telescope and revealed 60 magnetar X-ray bursts (MXBs), while KM40m only detected 1 radio burst. In particular, we find that there is an X-ray burst on October 21 (denoted as MXB 221021) temporally associated with this radio burst. Interestingly, this association event shows very different morphology from those X-ray and radio association events from this source reported before (e.g., MXB/FRB 200428). Moreover, we systematically analyzed the temporal and spectral properties of the sample of MXBs during this observation and found that % the (radio-associated) MXB 221021 shows some different properties from other MXBs without associated radio bursts. These findings shed new light on the physical mechanisms of X-ray bursts and radio burst emission in magnetars.

astro-ph.HE↗

GECAM discovery of a peculiar magnetar X-ray burst (MXB 221120) from SGR J1935+2154 associated with a fast radio burst

Fast radio bursts (FRBs) are enigmatic cosmic transients of millisecond duration observed in the radio band. The identification of FRB-associated magnetar X-ray bursts (MXBs) from galactic magnetar SGR J1935+2154 suggests that at least a fraction of FRBs can be produced from magnetar activity. However, the sample size of FRB-associated MXBs is still very small. Here we report a bright and peculiar FRB-associated MXB from SGR J1935+2154 detected by GECAM on November 20, 2022, dubbed MXB 221120. We find that both temporal and spectral properties of MXB 221120 exhibit distinctive features. Its light curve could be generally described by a single FRED function with superposition of several narrow pulses. Interestingly, we identify a possible QPO feature with center frequency of ~18 Hz in this MXB. The time-integrated spectrum is best fitted by a blackbody model with temperature (kT ) of 18.6 keV, rendering it the first thermal spectrum FRB-associated MXB from SGR J1935+2154. Compared to other MXBs with single emission episode, MXB 221120 has longer duration and higher blackbody temperature, making it an outlier in the burst sample. These results indicate that MXB 221120 may be produced by a special mechanism with extreme physical conditions.

astro-ph.HE↗

HAWC J0630+186 Could Not Be Powered by PSR J0630+19

3HWC J0630+186 is one of the very-high-energy gamma-ray sources in the third High-Altitude Water Cherenkov (HAWC) catalog, its origin and source are, however, not clearly identified. The only possible associated source is PSR J0630+19 depart from the center of 3HWC J0630+186. A few TeV halos of pulsars are currently believed the most dominant TeV-PeV gamma-ray sources, and PSR J0630+19 was firstly discovered by Arecibo survey with normal pulsar period, but its age and spin-down luminosity are not available. It is then difficult to determine if 3HWC J0630+186 and PSR J0630+19 are associated or not. With the awarded telescope time in five-hundred-meter aperture spherical radio telescope (FAST) observing cycle, we have obtained the follow-up timing observations of PSR J0630+19 with observed duration more than one year. From our pulsar data analysis, we determined a more precise position and derived parameters via pulsar timing. The parameters indicate that it is an old pulsar with energy loss too low to power the very-high-energy emissions from 3HWC J0630+186.

astro-ph.HE↗

Osmosis Distillation: Model Hijacking with the Fewest Samples

Transfer learning is devised to leverage knowledge from pre-trained models to solve new tasks with limited data and computational resources. Meanwhile, dataset distillation has emerged to synthesize a compact dataset that preserves critical information from the original large dataset. Therefore, a combination of transfer learning and dataset distillation offers promising performance in evaluations. However, a non-negligible security threat remains undiscovered in transfer learning using synthetic datasets generated by dataset distillation methods, where an adversary can perform a model hijacking attack with only a few poisoned samples in the synthetic dataset. To reveal this threat, we propose Osmosis Distillation (OD) attack, a novel model hijacking strategy that targets deep learning models using the fewest samples. Comprehensive evaluations on various datasets demonstrate that the OD attack attains high attack success rates in hidden tasks while preserving high model utility in original tasks. Furthermore, the distilled osmosis set enables model hijacking across diverse model architectures, allowing model hijacking in transfer learning with considerable attack performance and model utility. We argue that awareness of using third-party synthetic datasets in transfer learning must be raised.

cs.CR↗

Hide&Seek: Remove Image Watermarks with Negligible Cost via Pixel-wise Reconstruction

Watermarking has emerged as a key defense against the misuse of machine-generated images (MGIs). Yet the robustness of these protections remains underexplored. To reveal the limits of SOTA proactive image watermarking defenses, we propose HIDE&SEEK (HS), a suite of versatile and cost-effective attacks that reliably remove embedded watermarks while preserving high visual fidelity.

cs.CR↗

Forgetting Similar Samples: Can Machine Unlearning Do it Better?

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. Although extensive research has focused on developing efficient machine unlearning strategies, we argue that these methods mainly aim at removing samples rather than removing samples' influence on the model, thus overlooking the fundamental definition of machine unlearning. In this paper, we first conduct a comprehensive study to evaluate the effectiveness of existing unlearning schemes when the training dataset includes many samples similar to those targeted for unlearning. Specifically, we evaluate: Do existing unlearning methods truly adhere to the original definition of machine unlearning and effectively eliminate all influence of target samples when similar samples are present in the training dataset? Our extensive experiments, conducted on four carefully constructed datasets with thorough analysis, reveal a notable gap between the expected and actual performance of most existing unlearning methods for image and language models, even for the retraining-from-scratch baseline. Additionally, we also explore potential solutions to enhance current unlearning approaches.

cs.LG↗

Investigating FRB 20240114A with FAST: Morphological Classification and Drifting Rate Measurements in a Burst-Cluster Framework

This study investigates the morphological classification and drifting rate measurement of the repeating fast radio burst (FRB) source FRB 20240114A using the Five-hundred-meter Aperture Spherical Telescope (FAST). Detected on January 14, 2024, FRB 20240114A exhibited an exceptionally high burst rate, revealing unique properties. Through observational campaigns over several months, we selected a dataset comprising 3,203 bursts (2,109 burst-clusters) during a continuous monitoring session (15,780 seconds) on March 12, 2024. Improving upon previous work, we clarify the definitions of sub-bursts, bursts and burst-clusters. Using an average dispersion measures (DM) of 529.2 pc cm$^{-3}$, we classified the burst-clusters into Downward Drifting, Upward Drifting, No Drifting, No Evidence for Drifting, Not-Clear, and Complex burst-clusters. Among the 978 burst-clusters that exhibit drifting behavior, 233 (23.82%) show upward drifting. Additionally, if 142 upward drifting single-component burst-clusters are excluded, upward drifting double- and multi-component burst-clusters still account for 10.89% of the 836 burst-clusters exhibiting drifting behavior, equating to 91 burst-clusters. Furthermore, if only upward drifting burst-clusters with consecutive time intervals (or upward drifting bursts) are considered, only 9 bursts remain. Drifting rate comparisons with other physical quantities reveal that the drifting rate increases with peak frequency for single-component burst-clusters with drifting behavior. Moreover, in single-component burst-clusters, those with upward drifting exhibit smaller effective widths, bandwidths, and fluxes than their downward drifting counterparts. A Kolmogorov-Smirnov test further indicates that upward drifting burst-clusters possess longer consecutive time intervals than downward drifting ones, suggesting distinct underlying physical mechanisms.

astro-ph.HE↗

PLATONT: Learning a Platonic Representation for Unified Network Tomography

Network tomography aims to infer hidden network states, such as link performance, traffic load, and topology, from external observations. Most existing methods solve these problems separately and depend on limited task-specific signals, which limits generalization and interpretability. We present PLATONT, a unified framework that models different network indicators (e.g., delay, loss, bandwidth) as projections of a shared latent network state. Guided by the Platonic Representation Hypothesis, PLATONT learns this latent state through multimodal alignment and contrastive learning. By training multiple tomography tasks within a shared latent space, it builds compact and structured representations that improve cross-task generalization. Experiments on synthetic and real-world datasets show that PLATONT consistently outperforms existing methods in link estimation, topology inference, and traffic prediction, achieving higher accuracy and stronger robustness under varying network conditions.

cs.LG↗

A comprehensive search for Long and Short Periodic Features from an Extremely Active Cycle of FRB 20240114A

Possible periodic features in fast radio bursts (FRBs) may provide insights into their astrophysical origins. Using extensive observations from the Five-hundred-meter Aperture Spherical radio Telescope (FAST), we conduct a multi-timescale periodicity search for the exceptionally active repeater FRB~20240114A. Our analysis is based on different datasets for different timescales: for short-timescale periodicity in Time of Arrivals (TOAs), we use 57 observations from January to August 2024; for long-timescale periodicity, we employ an extended TOA dataset comprising 111 observations spanning from January 2024 to October 2025; and for burst time series analysis, we utilize individual burst data from the 57 FAST observations. We identify three candidate short-timescale periodic signals (0.673~s, 0.635~s, and 0.536~s) with significances of $3.2σ$--$6σ$, each detected in two independent observations. On longer timescales, we detect a significant $143.40\pm7.19$-day periodicity with $5.2σ$ significance, establishing FRB~20240114A as a periodic repeater. In burst time series, we find quasi-periodic oscillations in the few hundred Hz range ($3.4σ$ and $3.7σ$) and periodic burst trains with periods of several to tens of milliseconds ($3σ$--$3.9σ$), though these periodic features appear transient and short-lived. The detection of periodic signals at these different time scales indicates that FRB 20240114A exhibits intriguing periodic self-similar characteristics. Despite the comprehensive dataset, no definitive periodicity linked to the source's rotation is confirmed, placing stringent constraints on the intrinsic source properties and the modulation mechanisms. All data are available via the Science Data Bank.

astro-ph.HE↗

RailS: Load Balancing for All-to-All Communication in Distributed Mixture-of-Experts Training

Training Mixture-of-Experts (MoE) models introduces sparse and highly imbalanced all-to-all communication that dominates iteration time. Conventional load-balancing methods fail to exploit the deterministic topology of Rail architectures, leaving multi-NIC bandwidth underutilized. We present RailS, a distributed load-balancing framework that minimizes all-to-all completion time in MoE training. RailS leverages the Rail topology's symmetry to prove that uniform sending ensures uniform receiving, transforming global coordination into local scheduling. Each node independently executes a Longest Processing Time First (LPT) spraying scheduler to proactively balance traffic using local information. RailS activates N parallel rails for fine-grained, topology-aware multipath transmission. Across synthetic and real-world MoE workloads, RailS improves bus bandwidth by 20%--78% and reduces completion time by 17%--78%. For Mixtral workloads, it shortens iteration time by 18%--40% and achieves near-optimal load balance, fully exploiting architectural parallelism in distributed training.

cs.DC↗