arXiv Science⌕ Search

arXiv subjects

Xin Zhang

Publications and source records attributed to Xin Zhang.

At least 307 records · Page 17Linked to original sources

Focus-LIME: Surgical Interpretation of Long-Context Large Language Models via Proxy-Based Neighborhood Selection

As Large Language Models (LLMs) scale to handle massive context windows, achieving surgical feature-level interpretation is essential for high-stakes tasks like legal auditing and code debugging. However, existing local model-agnostic explanation methods face a critical dilemma in these scenarios: feature-based methods suffer from attribution dilution due to high feature dimensionality, thus failing to provide faithful explanations. In this paper, we propose Focus-LIME, a coarse-to-fine framework designed to restore the tractability of surgical interpretation. Focus-LIME utilizes a proxy model to curate the perturbation neighborhood, allowing the target model to perform fine-grained attribution exclusively within the optimized context. Empirical evaluations on long-context benchmarks demonstrate that our method makes surgical explanations practicable and provides faithful explanations to users.

cs.CL↗

Integrable Stochastic Processes Associated with the $D_2$ Algebra

We introduce an integrable stochastic process associated with the $D_2$ quantum group, which can be decomposed into two symmetric simple exclusion processes. We establish the integrability of the model under three types of boundary conditions (periodic, twisted, and open boundaries), and present its exact solution, including the spectrum, eigenstates, and some observables. This integrable model can be generalized to the asymmetric case, decomposing into two asymmetric simple exclusion processes, and its exact solutions are also studied.

math-ph↗

Closing the Loop: Universal Repository Representation with RPG-Encoder

Current repository agents encounter a reasoning disconnect due to fragmented representations, as existing methods rely on isolated API documentation or dependency graphs that lack semantic depth. We consider repository comprehension and generation to be inverse processes within a unified cycle: generation expands intent into implementation, while comprehension compresses implementation back into intent. To address this, we propose RPG-Encoder, a framework that generalizes the Repository Planning Graph (RPG) from a static generative blueprint into a unified, high-fidelity representation. RPG-Encoder closes the reasoning loop through three mechanisms: (1) Encoding raw code into the RPG that combines lifted semantic features with code dependencies; (2) Evolving the topology incrementally to decouple maintenance costs from repository scale, reducing overhead by 95.7%; and (3) Operating as a unified interface for structure-aware navigation. In evaluations, RPG-Encoder establishes state-of-the-art localization performance on SWE-bench Verified with 93.7% Acc@5 and exceeds the best baseline by over 10% in localization accuracy on SWE-bench Live Lite. These results highlight our superior fine-grained precision in complex codebases. Furthermore, it achieves 98.5% reconstruction coverage on RepoCraft, confirming RPG's high-fidelity capacity to mirror the original codebase and closing the loop between intent and implementation.

cs.CL↗

Point2RBox-v3: Self-Bootstrapping from Point Annotations via Integrated Pseudo-Label Refinement and Utilization

Driven by the growing need for Oriented Object Detection (OOD), learning from point annotations under a weakly-supervised framework has emerged as a promising alternative to costly and laborious manual labeling. In this paper, we discuss two deficiencies in existing point-supervised methods: inefficient utilization and poor quality of pseudo labels. Therefore, we present Point2RBox-v3. At the core are two principles: 1) Progressive Label Assignment (PLA). It dynamically estimates instance sizes in a coarse yet intelligent manner at different stages of the training process, enabling the use of label assignment methods. 2) Prior-Guided Dynamic Mask Loss (PGDM-Loss). It is an enhancement of the Voronoi Watershed Loss from Point2RBox-v2, which overcomes the shortcomings of Watershed in its poor performance in sparse scenes and SAM's poor performance in dense scenes. To our knowledge, Point2RBox-v3 is the first model to employ dynamic pseudo labels for label assignment, and it creatively complements the advantages of SAM model with the watershed algorithm, which achieves excellent performance in both sparse and dense scenes. Our solution gives competitive performance, especially in scenarios with large variations in object size or sparse object occurrences: 66.09%/56.86%/41.28%/46.40%/19.60%/45.96% on DOTA-v1.0/DOTA-v1.5/DOTA-v2.0/DIOR/STAR/RSAR.

cs.CV↗

Beyond Imprecise Distance Metrics: Trace-Guided Directed Greybox Fuzzing via LLM-Predicted Call Stacks

Directed greybox fuzzing (DGF) aims to efficiently trigger bugs at specific target locations by prioritizing seeds whose execution paths are more likely to reach the targets. However, existing DGF approaches suffer from imprecise potential estimation due to their reliance on static-analysis-based distance metrics. The over-approximation inherent in static analysis causes many seeds with execution paths irrelevant to vulnerability triggering to be mistakenly prioritized, significantly reducing fuzzing efficiency. To address this issue, we propose trace-guided directed greybox fuzzing (TDGF). TDGF replaces static-analysis-based distance metrics with vulnerability-oriented execution information (referred to as guidance traces) to steer directed fuzzing: seeds whose execution paths overlap more with the guidance traces are scheduled earlier for mutation. We empirically study two representative types of guidance traces: the control-flow trace and the call-stack trace of vulnerability-triggering executions. We find that the fine-grained control-flow traces offer nearly the same guidance capability as the coarse-grained call-stack traces, while call-stack traces are also easier for large language models (LLMs) to predict. Based on this insight, we further propose a framework that leverages LLMs to predict the call stack at vulnerability-triggering time and uses it to guide DGF. We implement our approach and evaluate it against several state-of-the-art fuzzers with experiments totaling 58.4 CPU-years. On a suite of real-world programs, our approach triggers vulnerabilities 2.13$\times$ to 3.14$\times$ faster than the baselines. Moreover, through directed patch testing on the latest program versions used in our controlled experiments, our approach discovers 10 new vulnerabilities and 2 incomplete fixes, with 10 assigned CVE IDs.

cs.CR↗

PSGS: Text-driven Panorama Sliding Scene Generation via Gaussian Splatting

Generating realistic 3D scenes from text is crucial for immersive applications like VR, AR, and gaming. While text-driven approaches promise efficiency, existing methods suffer from limited 3D-text data and inconsistent multi-view stitching, resulting in overly simplistic scenes. To address this, we propose PSGS, a two-stage framework for high-fidelity panoramic scene generation. First, a novel two-layer optimization architecture generates semantically coherent panoramas: a layout reasoning layer parses text into structured spatial relationships, while a self-optimization layer refines visual details via iterative MLLM feedback. Second, our panorama sliding mechanism initializes globally consistent 3D Gaussian Splatting point clouds by strategically sampling overlapping perspectives. By incorporating depth and semantic coherence losses during training, we greatly improve the quality and detail fidelity of rendered scenes. Our experiments demonstrate that PSGS outperforms existing methods in panorama generation and produces more appealing 3D scenes, offering a robust solution for scalable immersive content creation.

cs.CV↗

Spectra: Rethinking Optimizers for LLMs Under Spectral Anisotropy

Gradient signals in LLM training are highly anisotropic: recurrent linguistic structure concentrates energy into a small set of dominant spectral directions, while context specific information resides in a long tail. We show that this spike tail separation persists throughout training, with the spike occupying only about 1.5% of directions yet dominating optimizer statistics. This dominance suppresses tail learning by contracting tail updates through second moment normalization and tightening the globally stable learning rate bound. Motivated by this analysis, we propose Spectra, a spike aware optimizer that suppresses the dominant low rank spike subspace without amplifying the noise sensitive spectral tail. Spectra tracks the spike subspace via cached, warm started power iteration and applies low rank spectral shaping with negligible overhead and substantially reduced optimizer state memory. On LLaMA3 8B trained on 50B tokens, Spectra reaches the same target loss 30% faster than AdamW, reduces per step end to end overhead by 0.7%, cuts optimizer state memory by 49.25%, and improves average downstream accuracy by 1.62%. Compared to Muon, Spectra is 5.1x faster in optimizer processing time, achieves a lower final loss, and improves average accuracy by 0.66%.

cs.LG↗

SemBind: Binding Diffusion Watermarks to Semantics Against Black-Box Forgery Attacks

Latent-based watermarks, integrated into the generation process of latent diffusion models (LDMs), simplify detection and attribution of generated images. However, recent black-box forgery attacks, where an attacker needs at least one watermarked image and black-box access to the provider's model, can embed the provider's watermark into images not produced by the provider, posing outsized risk to provenance and trust. We propose SemBind, the first defense framework for latent-based watermarks that resists black-box forgery by binding latent signals to image semantics via a learned semantic masker. Trained with contrastive learning, the masker yields near-invariant codes for the same prompt and near-orthogonal codes across prompts; these codes are reshaped and permuted to modulate the target latent before any standard latent-based watermark. SemBind is generally compatible with existing latent-based watermarking schemes and keeps image quality essentially unchanged, while a simple mask-ratio parameter offers a tunable trade-off between anti-forgery strength and robustness. Across four mainstream latent-based watermark methods, our SemBind-enabled anti-forgery variants markedly reduce false acceptance under black-box forgery while providing a controllable robustness-security balance.

cs.CR↗

Speaking Clearly: A Simplified Whisper-Based Codec for Low-Bitrate Speech Coding

Speech codecs serve as bridges between continuous speech signals and large language models, yet face an inherent conflict between acoustic fidelity and semantic preservation. To mitigate this conflict, prevailing methods augment acoustic codecs with complex semantic supervision. We explore the opposite direction: a semantic-first approach that starts from a semantically-capable model and adapts it for high-fidelity acoustic reconstruction. Through empirical analysis, we discover that targeted architectural simplification can unlock the acoustic modeling potential of Whisper, a text-aligned Automatic Speech Recognition (ASR) model. Based on this finding, we propose SimWhisper-Codec, a novel codec that balances the semantic and acoustic preservation by leveraging a frozen, simplified Whisper encoder without requiring external supervision. Experimental results demonstrate that SimWhisper-Codec achieves superior performance in both semantic preservation and acoustic quality compared to semantically-supervised codecs such as Mimi Codec and SpeechTokenizer at similar bitrates, validating the effectiveness of our semantic-first approach. Code is available at https://github.com/ZhangXinWhut/SimWhisper-Codec.

cs.SD↗

Circularly polarized metamaterial cage for homogeneous signal-to-noise ratio enhancement in magnetic resonance imaging

The signal-to-noise ratio (SNR) in magnetic resonance imaging (MRI) governs the quality of signal detection and directly impacts the clarity and reliability of the acquired images. Recent advances in metamaterials have enabled lightweight solutions with selective magnetic responses, offering a route to locally boost SNR in targeted anatomical regions but often with compromised field homogeneity. Here, a wireless metamaterial cage constructed from coaxial cables is engineered for homogeneous SNR enhancement at 3.0 T. With its cylindrical geometry and electromagnetic architecture, the device supports circularly polarized resonance through engineered phase-shifted currents, enabling selective and omnidirectional interaction with the rotating B_1^- field to achieve uniform magnetic field distribution. Integrated with the body coil, the device yields a 32-fold SNR enhancement while maintaining comparable homogeneity to the body coil alone, exhibiting only 12.07% variation within the region of interest (ROI). Benchmarking against a state-of-the-art 16-channel extremity coil further shows that the metacage achieves at least 1.94-fold and 2.24-fold higher SNR in axial and coronal planes, respectively, and exhibits substantially lower SNR variation (12.07% compared to 54.83% for the extremity coil). The results establish the metacage as a compelling platform for next-generation wireless MRI technologies.

physics.med-ph↗

21 cm forest one-dimensional power spectrum as an indirect probe of dark matter particles and primordial black holes

Understanding the nature of dark matter (DM) particles remains a pivotal challenge in modern cosmology. Current cosmological research on these phenomena primarily utilizes cosmic microwave background (CMB) observations and other late-time probes, which predominantly focus on large scales. We introduce a novel probe, the 21 cm forest signal, which can be used to investigate DM properties on small scales during the epoch of reionization, thereby addressing the gap left by other cosmological probes. Annihilation and decay of DM particles, as well as Hawking radiation from PBHs, can heat the intergalactic medium (IGM). This heating suppresses the amplitude of the 21 cm forest 1D power spectrum. Therefore, the 1D power spectrum provides an effective method for constraining DM properties. However, astrophysical heating processes in the early universe can also affect the 21 cm forest 1D power spectrum. In this work, we assess the potential of using the SKA to observe the 21 cm forest 1D power spectrum for constraining DM properties, under the assumption that astrophysical heating can be constrained reliably by other independent probes. Under low astrophysical heating conditions, the 1D power spectrum could constrain the DM annihilation cross section and decay lifetime to $\langleσv\rangle \sim {10^{-31}}\,{\rm cm^{3}\,s^{-1}}$ and $τ\sim {10^{30}}\,{\rm s}$ for ${10}\,{\rm GeV}$ DM particles, and probe PBHs with masses $\sim {10^{15}}\,{\rm\,g}$ at abundances $f_{\mathrm{PBH}} \simeq 10^{-13}$. These constraints represent improvements of 5-6 orders of magnitude over current limits. Furthermore, the 21 cm forest 1D power spectrum has the potential to exceed existing bounds on sub-GeV DM and to probe PBHs with masses above $10^{18}\,{\rm g}$, which are otherwise inaccessible by conventional cosmological probes.

astro-ph.CO↗

AgriPINN: A Process-Informed Neural Network for Interpretable and Scalable Crop Biomass Prediction Under Water Stress

Accurate prediction of crop above-ground biomass (AGB) under water stress is critical for monitoring crop productivity, guiding irrigation, and supporting climate-resilient agriculture. Data-driven models scale well but often lack interpretability and degrade under distribution shift, whereas process-based crop models (e.g. DSSAT, APSIM, LINTUL5) require extensive calibration and are difficult to deploy over large spatial domains. To address these limitations, we propose AgriPINN, a process-informed neural network that integrates a biophysical crop-growth differential equation as a differentiable constraint within a deep learning backbone. This design encourages physiologically consistent biomass dynamics under water-stress conditions while preserving model scalability for spatially distributed AGB prediction. AgriPINN recovers latent physiological variables, including leaf area index (LAI), absorbed photosynthetically active radiation (PAR), radiation use efficiency (RUE), and water-stress factors, without requiring direct supervision. We pretrain AgriPINN on 60 years of historical data across 397 regions in Germany and fine-tune it on three years of field experiments under controlled water treatments. Results show that AgriPINN consistently outperforms state-of-the-art deep-learning baselines (ConvLSTM-ViT, SLTF, CNN-Transformer) and the process-based LINTUL5 model in terms of accuracy (RMSE reductions up to $43\%$) and computational efficiency. By combining the scalability of deep learning with the biophysical rigor of process-based modeling, AgriPINN provides a robust and interpretable framework for spatio-temporal AGB prediction, offering practical value for planning of irrigation infrastructure, yield forecasting, and climate-adaptation planning.

cs.AI↗

A Practical Framework for Estimating the Repetition Likelihood of Fast Radio Bursts from Spectral Morphology

The repeating behavior of fast radio bursts (FRBs) is regarded as a key clue to understanding their physical origin, yet reliably distinguishing repeaters from apparent non-repeaters with current observations remains challenging. Here we propose a physically interpretable and practically quantifiable classification framework based on spectral morphology. Using dimensionality reduction, clustering, and feature-importance analysis, we identify the spectral running $r$ and spectral index $γ$ as the most critical parameters for distinguishing repeaters from apparent non-repeaters in the CHIME/FRB sample. In the $γ$-$r$ space, repeaters preferentially occupy regions with steeper, narrower-band spectra, whereas non-repeaters cluster in flatter, broader-band regions, resulting in a clear density separation. We further construct an empirical probability map in the $γ$-$r$ space, showing a clear gradient of repetition likelihood, from $\sim 65\%$ in the high-repetition region to $\sim 5\%$ in the low-repetition region. Combining this with Gaussian Mixture Model posterior analysis, we identify several apparent non-repeaters with high inferred repetition probability, recommending them as priority targets for future monitoring. This framework provides a simple and generalizable tool for assessing repeatability in the CHIME/FRB sample and highlights the diagnostic power of spectral morphology in unveiling FRB origins.

astro-ph.HE↗

EVOREFUSE: Evolutionary Prompt Optimization for Evaluation and Mitigation of LLM Over-Refusal to Pseudo-Malicious Instructions

Large language models (LLMs) frequently refuse to respond to pseudo-malicious instructions: semantically harmless input queries triggering unnecessary LLM refusals due to conservative safety alignment, significantly impairing user experience. Collecting such instructions is crucial for evaluating and mitigating over-refusals, but existing instruction curation methods, like manual creation or instruction rewriting, either lack scalability or fail to produce sufficiently diverse and effective refusal-inducing prompts. To address these limitations, we introduce EVOREFUSE, a prompt optimization approach that generates diverse pseudo-malicious instructions consistently eliciting confident refusals across LLMs. EVOREFUSE employs an evolutionary algorithm exploring the instruction space in more diverse directions than existing methods via mutation strategies and recombination, and iteratively evolves seed instructions to maximize evidence lower bound on LLM refusal probability. Using EVOREFUSE, we create two novel datasets: EVOREFUSE-TEST, a benchmark of 582 pseudo-malicious instructions that outperforms the next-best benchmark with 85.34% higher average refusal triggering rate across 9 LLMs without a safety-prior system prompt, 34.86% greater lexical diversity, and 40.03% improved LLM response confidence scores; and EVOREFUSE-ALIGN, which provides 3,000 pseudo-malicious instructions with responses for supervised and preference-based alignment training. With supervised fine-tuning on EVOREFUSE-ALIGN, LLAMA3.1-8B-INSTRUCT achieves up to 29.85% fewer over-refusals than models trained on the second-best alignment dataset, without compromising safety. Our analysis with EVOREFUSE-TEST reveals models trigger over-refusals by overly focusing on sensitive keywords while ignoring broader context. Our code and datasets are available at https://github.com/FishT0ucher/EVOREFUSE.

cs.AI↗

LSSF: Safety Alignment for Large Language Models through Low-Rank Safety Subspace Fusion

The safety mechanisms of large language models (LLMs) exhibit notable fragility, as even fine-tuning on datasets without harmful content may still undermine their safety capabilities. Meanwhile, existing safety alignment methods predominantly rely on the fine-tuning process, which inadvertently leads to the increased complexity and computational resources required. To address these issues, we introduce LSSF, a novel safety re-alignment framework with \underline{L}ow-Rank \underline{S}afety \underline{S}ubspace \underline{F}usion. Our proposed method exploits the low-rank characteristics of safety information in LLMs by constructing a low-rank projection matrix to extract the principal components of safety vectors. Notably, this projection matrix represents the low-rank safety subspace of the LLMs, which we have observed to remain stable during fine-tuning process and is isolated from the model's general capabilities. These principal components are used to effectively restore safety alignment when combined with fine-tuned LLMs through linear arithmetic. Additionally, to account for the varying encoding densities of safety information across different layers of LLMs, we propose a novel metric called safety singular value entropy. This metric quantifies the encoding density and allows for the dynamic computation of the safety-critical rank for each safety vector. Extensive experiments demonstrate that our proposed post-hoc alignment method can effectively restore the safety alignment of fine-tuned models with minimal impact on their performance in downstream tasks.

cs.CY↗

RCDN: Real-Centered Detection Network for Robust Face Forgery Identification

Image forgery has become a critical threat with the rapid proliferation of AI-based generation tools, which make it increasingly easy to synthesize realistic but fraudulent facial content. Existing detection methods achieve near-perfect performance when training and testing are conducted within the same domain, yet their effectiveness deteriorates substantially in crossdomain scenarios. This limitation is problematic, as new forgery techniques continuously emerge and detectors must remain reliable against unseen manipulations. To address this challenge, we propose the Real-Centered Detection Network (RCDN), a frequency spatial convolutional neural networks(CNN) framework with an Xception backbone that anchors its representation space around authentic facial images. Instead of modeling the diverse and evolving patterns of forgeries, RCDN emphasizes the consistency of real images, leveraging a dual-branch architecture and a real centered loss design to enhance robustness under distribution shifts. Extensive experiments on the DiFF dataset, focusing on three representative forgery types (FE, I2I, T2I), demonstrate that RCDN achieves both state-of-the-art in-domain accuracy and significantly stronger cross-domain generalization. Notably, RCDN reduces the generalization gap compared to leading baselines and achieves the highest cross/in-domain stability ratio, highlighting its potential as a practical solution for defending against evolving and unseen image forgery techniques.

cs.CV↗

Multi-messenger standard-siren cosmology for third-generation gravitational-wave detectors: forecasts considering observations of gamma-ray bursts and kilonovae

In the third-generation (3G) gravitational-wave (GW) detector era, GW multi-messenger observations for binary neutron star merger events can exert great impacts on exploring the cosmic expansion history. Extending the previous work, we explore the potential of 3G GW standard siren observations in cosmological parameter estimation by considering their associated electromagnetic (EM) counterparts, including $γ$-ray burst (GRB) coincidence observations by the Gravitational wave high-energy Electromagnetic Counterpart All-sky Monitor and GW-triggered target-of-opportunity observations of kilonovae by different optical survey projects. During an assumed 10-year observation, we predict that the number of detectable GW-kilonova events is $\sim 4900$ with redshifts below $\sim 0.4$ under GW network and Large Synoptic Survey Telescope in the $i$ band, which is three times more than that of GW-GRB detections. For the cosmological analysis, we find that with the inclusion of GW-kilonova detections, the constraints on cosmological parameters from GW-EM detections are significantly improved compared to those from GW-GRB detections. In particular, GW-EM detections can tightly constrain the Hubble constant with a precision ranging from $0.076\%$ to $0.034\%$. Moreover, GW multi-messenger observations could effectively break the cosmological parameter degeneracies generated by the mainstream EM observations, CMB+BAO+SN (CBS). The combination of CBS and GW-EM can tightly constrain the equation of state parameters of dark energy $w$ in the $w$CDM model and $w_0$ in the $w_0w_a$CDM model with precisions of $0.72\%$ and $0.99\%$, respectively, meeting the standard of precision cosmology. In conclusion, GW multi-messenger observations could play a crucial role in helping solve the Hubble tension and probing the fundamental nature of dark energy.

astro-ph.CO↗

Implicit Graph, Explicit Retrieval: Towards Efficient and Interpretable Long-horizon Memory for Large Language Models

Long-horizon applications increasingly require large language models (LLMs) to answer queries when relevant evidence is sparse and dispersed across very long contexts. Existing memory systems largely follow two paradigms: explicit structured memories offer interpretability but often become brittle under long-context overload, while latent memory mechanisms are efficient and stable yet difficult to inspect. We propose LatentGraphMem, a memory framework that combines implicit graph memory with explicit subgraph retrieval. LatentGraphMem stores a graph-structured memory in latent space for stability and efficiency, and exposes a task-specific subgraph retrieval interface that returns a compact symbolic subgraph under a fixed budget for downstream reasoning and human inspection. During training, an explicit graph view is materialized to interface with a frozen reasoner for question-answering supervision. At inference time, retrieval is performed in latent space and only the retrieved subgraph is externalized. Experiments on long-horizon benchmarks across multiple model scales show that LatentGraphMem consistently outperforms representative explicit-graph and latent-memory baselines, while enabling parameter-efficient adaptation and flexible scaling to larger reasoners without introducing large symbolic artifacts.

cs.CL↗