arXiv subjects

Zhen Zhang

Publications and source records attributed to Zhen Zhang.

At least 163 records · Page 9Linked to original sources

arXiv2026

Efficient Multimodal Planning Agent for Visual Question-Answering

Visual Question-Answering (VQA) is a challenging multimodal task that requires integrating visual and textual information to generate accurate responses. While multimodal Retrieval-Augmented Generation (mRAG) has shown promise in enhancing VQA systems by providing more evidence on both image and text sides, the default procedure that addresses VQA queries, especially the knowledge-intensive ones, often relies on multi-stage pipelines of mRAG with inherent dependencies. To mitigate the inefficiency limitations while maintaining VQA task performance, this paper proposes a method that trains a multimodal planning agent, dynamically decomposing the mRAG pipeline to solve the VQA task. Our method optimizes the trade-off between efficiency and effectiveness by training the agent to intelligently determine the necessity of each mRAG step. In our experiments, the agent can help reduce redundant computations, cutting search time by over 60\% compared to existing methods and decreasing costly tool calls. Meanwhile, experiments demonstrate that our method outperforms all baselines, including a Deep Research agent and a carefully designed prompt-based method, on average over six various datasets. Code will be released.

cs.CL↗

arXiv2026

Self-Supervised Path Planning in Unstructured Environments via Global-Guided Differentiable Hard Constraint Projection

Deploying deep learning agents for autonomous navigation in unstructured environments faces critical challenges regarding safety, data scarcity, and limited computational resources. Traditional solvers often suffer from high latency, while emerging learning-based approaches struggle to ensure deterministic feasibility. To bridge the gap from embodied to embedded intelligence, we propose a self-supervised framework incorporating a differentiable hard constraint projection layer for runtime assurance. To mitigate data scarcity, we construct a Global-Guided Artificial Potential Field (G-APF), which provides dense supervision signals without manual labeling. To enforce actuator limitations and geometric constraints efficiently, we employ an adaptive neural projection layer, which iteratively rectifies the coarse network output onto the feasible manifold. Extensive benchmarks on a test set of 20,000 scenarios demonstrate an 88.75\% success rate, substantiating the enhanced operational safety. Closed-loop experiments in CARLA further validate the physical realizability of the planned paths under dynamic constraints. Furthermore, deployment verification on an NVIDIA Jetson Orin NX confirms an inference latency of 94 ms, showing real-time feasibility on resource-constrained embedded hardware. This framework offers a generalized paradigm for embedding physical laws into neural architectures, providing a viable direction for solving constrained optimization in mechatronics. Source code is available at: https://github.com/wzq-13/SSHC.git.

cs.RO↗

arXiv2026

Brightest GRB flare observed in GRB 221009A: bridge the last gap between flare and prompt emission in GRB

Flares are usually observed during the afterglow phase of Gamma-Ray Bursts (GRBs) in soft X-ray, optical and radio bands, but rarely in gamma-ray band. Despite the extraordinary brightness, GECAM-C has accurately measured both the bright prompt emission and flare emission of GRB 221009A without instrumental effects, offering a good opportunity to study the relation between them. In this work, we present a comprehensive analysis of flare emission of GRB 221009A, which is composed of a series of flares. Among them, we identify an exceptionally bright flare with a record-breaking isotropic energy $E_{\rm iso} = 1.82 \times 10^{53}$ erg of GRB flares. It exhibits the highest peak energy ever detected in GRB flares, $E_{\rm peak} \sim 300$ keV, making it a genuine gamma-ray flare. It also shows rapid rise and decay timescales, significantly shorter than those of typical X-ray flares observed in soft X-ray or optical band, but comparable to those observed in prompt emissions. Despite these exceptional properties, the flare shares several common properties with typical GRB flares. We note that this is the first observation of a GRB flare in the keV-MeV band with sufficiently high temporal resolution and high statistics, which bridges the last gap between prompt emission and flare.

astro-ph.HE↗

arXiv2026

Communication-Efficient Federated Learning by Exploiting Spatio-Temporal Correlations of Gradients

Communication overhead is a critical challenge in federated learning, particularly in bandwidth-constrained networks. Although many methods have been proposed to reduce communication overhead, most focus solely on compressing individual gradients, overlooking the temporal correlations among them. Prior studies have shown that gradients exhibit spatial correlations, typically reflected in low-rank structures. Through empirical analysis, we further observe a strong temporal correlation between client gradients across adjacent rounds. Based on these observations, we propose GradESTC, a compression technique that exploits both spatial and temporal gradient correlations. GradESTC exploits spatial correlations to decompose each full gradient into a compact set of basis vectors and corresponding combination coefficients. By exploiting temporal correlations, only a small portion of the basis vectors need to be dynamically updated in each round. GradESTC significantly reduces communication overhead by transmitting lightweight combination coefficients and a limited number of updated basis vectors instead of the full gradients. Extensive experiments show that, upon reaching a target accuracy level near convergence, GradESTC reduces uplink communication by an average of 39.79% compared to the strongest baseline, while maintaining comparable convergence speed and final accuracy to uncompressed FedAvg. By effectively leveraging spatio-temporal gradient structures, GradESTC offers a practical and scalable solution for communication-efficient federated learning.

cs.LG↗

arXiv2026

GI-Bench: A Panoramic Benchmark Revealing the Knowledge-Experience Dissociation of Multimodal Large Language Models in Gastrointestinal Endoscopy Against Clinical Standards

Multimodal Large Language Models (MLLMs) show promise in gastroenterology, yet their performance against comprehensive clinical workflows and human benchmarks remains unverified. To systematically evaluate state-of-the-art MLLMs across a panoramic gastrointestinal endoscopy workflow and determine their clinical utility compared with human endoscopists. We constructed GI-Bench, a benchmark encompassing 20 fine-grained lesion categories. Twelve MLLMs were evaluated across a five-stage clinical workflow: anatomical localization, lesion identification, diagnosis, findings description, and management. Model performance was benchmarked against three junior endoscopists and three residency trainees using Macro-F1, mean Intersection-over-Union (mIoU), and multi-dimensional Likert scale. Gemini-3-Pro achieved state-of-the-art performance. In diagnostic reasoning, top-tier models (Macro-F1 0.641) outperformed trainees (0.492) and rivaled junior endoscopists (0.727; p>0.05). However, a critical "spatial grounding bottleneck" persisted; human lesion localization (mIoU >0.506) significantly outperformed the best model (0.345; p<0.05). Furthermore, qualitative analysis revealed a "fluency-accuracy paradox": models generated reports with superior linguistic readability compared with humans (p<0.05) but exhibited significantly lower factual correctness (p<0.05) due to "over-interpretation" and hallucination of visual features. GI-Bench maintains a dynamic leaderboard that tracks the evolving performance of MLLMs in clinical endoscopy. The current rankings and benchmark results are available at https://roterdl.github.io/GIBench/.

cs.CV↗

arXiv2026

Evidence for strong isovector nuclear spin-orbit interaction

The nucleon spin-orbit interaction is a cornerstone of nuclear structure theory, yet its isospin dependence remains elusive owing to the lack of clean experimental probes. Here we show that the charge-weak form factor difference in $^{48}$Ca, recently extracted in a model-independent manner by the CREX experiment, exhibits strong sensitivity to the isovector spin-orbit interaction. Using Skyrme-like energy density functionals, we demonstrate that a significantly enhanced isovector spin-orbit interaction, about four times stronger than conventional parametrizations, can resolve the PREX-CREX puzzle, which has challenged modern nuclear theories and our understanding of nuclear symmetry energy, while maintaining a good description of nuclear bulk properties and well-established shell structure of finite nuclei. This enhanced isovector spin-orbit interaction also provides a novel mechanism for the emergence of the $N = 14$, $16$, $32$ and $34$ magic numbers in neutron-rich nuclei on the mean-field level. These findings point to a strong isospin dependence of the nucleon spin-orbit interaction, which is expected to have important implications for nuclear structures, electroweak nuclear processes, and related problems in nuclear astrophysics.

nucl-th↗

arXiv2026

Upstream Laser-based Longitudinal Enhancement of Relativistic Photoelectrons

Controlling the longitudinal phase space of high-brightness relativistic electron beams is crucial for advancing a broad spectrum of charged-particle-based instrumentation and scientific frontiers. A generalized method for achieving this control involves manipulating the photoemission laser's temporal distribution at the picosecond level, a long-standing technical challenge. Recent developments in laser shaping have enabled the creation of high-power, picosecond-scale symmetrical and asymmetrical temporal profiles, capable of fine-tuning complex space-charge dynamics and external field effects in relativistic charged-particle beams. Here, we demonstrate that rather than deviations from theorized, idealized laser distributions, a controlled asymmetry can be harnessed to counteract accelerator-induced distortions. By implementing spatiotemporal shaping of the ultraviolet photocathode laser at the LCLS-II superconducting injector, we achieve deterministic control over the longitudinal phase space without downstream corrections. We find that this optical asymmetry induces a self-linearizing effect across both low (40 pC) and high (80 pC) charge regimes, effectively suppressing nonlinear compression and energy chirp. Consequently, this approach is expected to preserve a low emittance comparable to that of ideal flattop or regular Gaussian profiles, while delivering superior current uniformity and shot-to-shot stability. These results establish spatiotemporal laser shaping as a compact, generalizable tool for directly optimizing beam brightness at the source.

physics.optics↗

arXiv2026

TTrace: Lightweight Error Checking and Diagnosis for Distributed Training

Distributed training is essential for scaling the training of large neural network models, such as large language models (LLMs), across thousands of GPUs. However, the complexity of distributed training programs makes them particularly prone to silent bugs, which do not produce explicit error signals but lead to incorrect training outcomes. Effectively detecting and localizing such silent bugs in distributed training is challenging. Common debugging practices based on monitoring training loss or gradient norm curves are indirect, inefficient, and provide no way to localize bugs. To address those challenges, we design and implement TTrace, the first systematic differential testing system for detecting and localizing silent bugs in distributed training. TTrace aligns intermediate tensors from distributed training with those from a trusted reference implementation. To properly compare the floating-point values in the corresponding tensors, we propose a novel mathematical analysis that provides a guideline for setting tolerances, enabling TTrace to distinguish bug-induced errors from numerical errors. Experimental results demonstrate that TTrace effectively detects 11 existing bugs and 3 new bugs in the widely used Megatron-LM framework, while requiring fewer than 10 lines of code changes. TTrace is effective in various training recipes, including low-precision recipes involving BF16 and FP8. Notably, a popular open-source training framework has already adopted the method proposed by TTrace in its development workflow.

cs.DC↗

arXiv2026

MMFormalizer: Multimodal Autoformalization in the Wild

Autoformalization, which translates natural language mathematics into formal statements to enable machine reasoning, faces fundamental challenges in the wild due to the multimodal nature of the physical world, where physics requires inferring hidden constraints (e.g., mass or energy) from visual elements. To address this, we propose MMFormalizer, which extends autoformalization beyond text by integrating adaptive grounding with entities from real-world mathematical and physical domains. MMFormalizer recursively constructs formal propositions from perceptually grounded primitives through recursive grounding and axiom composition, with adaptive recursive termination ensuring that every abstraction is supported by visual evidence and anchored in dimensional or axiomatic grounding. We evaluate MMFormalizer on a new benchmark, PhyX-AF, comprising 115 curated samples from MathVerse, PhyX, Synthetic Geometry, and Analytic Geometry, covering diverse multimodal autoformalization tasks. Results show that frontier models such as GPT-5 and Gemini-3-Pro achieve the highest compile and semantic accuracy, with GPT-5 excelling in physical reasoning, while geometry remains the most challenging domain. Overall, MMFormalizer provides a scalable framework for unified multimodal autoformalization, bridging perception and formal reasoning. To the best of our knowledge, this is the first multimodal autoformalization method capable of handling classical mechanics (derived from the Hamiltonian), as well as relativity, quantum mechanics, and thermodynamics. More details are available on our project page: MMFormalizer.github.io

cs.CL↗

arXiv2025

AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learning

Conducting reinforcement learning (RL) in simulated environments offers a cost-effective and highly scalable way to enhance language-based agents. However, previous work has been limited to semi-automated environment synthesis or tasks lacking sufficient difficulty, offering little breadth or depth. In addition, the instability of simulated users integrated into these environments, along with the heterogeneity across simulated environments, poses further challenges for agentic RL. In this work, we propose: (1) a unified pipeline for automated and scalable synthesis of simulated environments associated with high-difficulty but easily verifiable tasks; and (2) an environment level RL algorithm that not only effectively mitigates user instability but also performs advantage estimation at the environment level, thereby improving training efficiency and stability. Comprehensive evaluations on agentic benchmarks, including tau-bench, tau2-Bench, and VitaBench, validate the effectiveness of our proposed method. Further in-depth analyses underscore its out-of-domain generalization.

cs.CL↗

arXiv2025

The Quest for Winning Tickets in Low-Rank Adapters

The Lottery Ticket Hypothesis (LTH) suggests that over-parameterized neural networks contain sparse subnetworks ("winning tickets") capable of matching full model performance when trained from scratch. With the growing reliance on fine-tuning large pretrained models, we investigate whether LTH extends to parameter-efficient fine-tuning (PEFT), specifically focusing on Low-Rank Adaptation (LoRA) methods. Our key finding is that LTH holds within LoRAs, revealing sparse subnetworks that can match the performance of dense adapters. In particular, we find that the effectiveness of sparse subnetworks depends more on how much sparsity is applied in each layer than on the exact weights included in the subnetwork. Building on this insight, we propose Partial-LoRA, a method that systematically identifies said subnetworks and trains sparse low-rank adapters aligned with task-relevant subspaces of the pre-trained model. Experiments across 8 vision and 12 language tasks in both single-task and multi-task settings show that Partial-LoRA reduces the number of trainable parameters by up to 87\%, while maintaining or improving accuracy. Our results not only deepen our theoretical understanding of transfer learning and the interplay between pretraining and fine-tuning but also open new avenues for developing more efficient adaptation strategies.

cs.LG↗

arXiv2025

Decomposing Task Vectors for Refined Model Editing

Large pre-trained models have transformed machine learning, yet adapting these models effectively to exhibit precise, concept-specific behaviors remains a significant challenge. Task vectors, defined as the difference between fine-tuned and pre-trained model parameters, provide a mechanism for steering neural networks toward desired behaviors. This has given rise to large repositories dedicated to task vectors tailored for specific behaviors. The arithmetic operation of these task vectors allows for the seamless combination of desired behaviors without the need for large datasets. However, these vectors often contain overlapping concepts that can interfere with each other during arithmetic operations, leading to unpredictable outcomes. We propose a principled decomposition method that separates each task vector into two components: one capturing shared knowledge across multiple task vectors, and another isolating information unique to each specific task. By identifying invariant subspaces across projections, our approach enables more precise control over concept manipulation without unintended amplification or diminution of other behaviors. We demonstrate the effectiveness of our decomposition method across three domains: improving multi-task merging in image classification by 5% using shared components as additional task vectors, enabling clean style mixing in diffusion models without generation degradation by mixing only the unique components, and achieving 47% toxicity reduction in language models while preserving performance on general knowledge tasks by negating the toxic information isolated to the unique component. Our approach provides a new framework for understanding and controlling task vector arithmetic, addressing fundamental limitations in model editing operations.

cs.LG↗

arXiv2025

Data-Driven Nonconvex Reachability Analysis using Exact Multiplication

This paper addresses a fundamental challenge in data-driven reachability analysis: accurately representing and propagating non-convex reachable sets. We propose a novel approach using constrained polynomial zonotopes to describe reachable sets for unknown LTI systems. Unlike constrained zonotopes commonly used in existing literature, constrained polynomial zonotopes are closed under multiplication with constrained matrix zonotopes. We leverage this property to develop an exact multiplication method that preserves the non-convex geometry of reachable sets without resorting to approximations. We demonstrate that our approach provides tighter over-approximations of reachable sets for LTI systems compared to conventional methods.

eess.SY↗

arXiv2025

A nanopore-gated sub-attoliter silicon nanocavity for single-molecule trapping and analysis

Biomolecules exhibit dynamic conformations critical to their functions, yet observing these processes at the single-molecule level under native conditions remains a formidable challenge. While surface immobilization has been widely used to extend observation times, it could disrupt molecular dynamics and impede biological function. Moreover, the study of weak molecular interactions requires high local concentrations, often leading to problems with signal saturation in fluorescence-based approaches. Recent advancements in single-molecule trapping techniques have addressed some limitations, but achieving precise, controllable, long-term trapping in a molecularly crowded environment without external forces remains difficult. Here, we introduce a nanopore-gated sub-attoliter silicon nanocavity that enables precise, non-perturbative trapping of individual biomolecules for extended observation times, eliminating the need for external forces. Using nucleosomes as model systems, we demonstrate single-molecule Förster resonance energy transfer (smFRET) to monitor relative distances. Our data also show that an applied electric field can modulate the conformational properties of macromolecules, emphasizing a key advantage of our device: it does not require an electric field to retain trapped molecules. We envision this nanocavity platform as a powerful tool for interrogating molecular dynamics in physiologically relevant environments, offering unperturbed access to weak and transient interactions that are central to biological regulation.

physics.ins-det↗

arXiv2025

Prefix Trees Improve Memory Consumption in Large-Scale Continuous-Time Stochastic Models

Highly-concurrent system models with vast state spaces like Chemical Reaction Networks (CRNs) that model biological and chemical systems pose a formidable challenge to cutting-edge formal analysis tools. Although many symbolic approaches have been presented, transient probability analysis of CRNs, modeled as Continuous-Time Markov Chains (CTMCs), requires explicit state representation. For that purpose, current cutting-edge methods use hash maps, which boast constant average time complexity and linear memory complexity. However, hash maps often suffer from severe memory limitations on models with immense state spaces. To address this, we propose using prefix trees to store states for large, highly concurrent models (particularly CRNs) for memory savings. We present theoretical analyses and benchmarks demonstrating the favorability of prefix trees over hash maps for very large state spaces. Additionally, we propose using a Bounded Model Checking (BMC) pre-processing step to impose a variable ordering to further improve memory usage along with preliminary evaluations suggesting its effectiveness. We remark that while our work is motivated primarily by the challenges posed by CRNs, it is generalizable to all CTMC models.

cs.DS↗

arXiv2025

Revisit the periodicity of SGR J1935+2154 bursts with updated sample

Since FRB 200428 has been found to be associated with an X-ray burst from the Galactic magnetar SGR J1935+2154, it is interesting to explore whether the magnetar bursts also follow the similar active periodic behavior as some repeating FRBs. Previous studies show that there is possible period about 230 day in SGR J1935+2154 bursts. Here, we collected an updated burst sample from SGR J1935+2154, including all bursts reported by Fermi/GBM and GECAM till 2022 January. We also developed a targeted search pipeline to reveal more bursts from SGR J1935+2154 in the Fermi/GBM data from 2008 August to 2014 December (i.e. before the first burst detected by Swift/BAT). With this burst sample, we re-analyzed the possible periodicity of SGR J1935+2154 bursts using the Period Folding and Lomb-Scargle Periodogram methods. Our results show that the periodicity $\sim$238 day reported in literature is probably fake and the observation effects may introduce false periods (i.e. 55 day) according to simulation tests. We find that, for the current burst sample, the most probable period is 126.88$\pm$2.05 day, which could be interpreted as the precession of the magnetar. However, we note that the whole burst history is very complicated and difficult to be perfectly accommodated with any period reported thus far, therefore more monitoring observations of SGR J1935+2154 are required to test any periodicity hypothesis.

astro-ph.HE↗

arXiv2025

Probing formation and epitaxy of ultrathin Titanium Silicide using low and medium energy ion scattering

Titanium silicide is a key contact material in advanced three-dimensional semiconductor device architectures. Here, we examine the formation of ultrathin Ti-silicide on Si(100) using a combination of non-destructive in-situ and ex-situ ion scattering techniques capable of resolving composition and structure at the nanoscale. In-situ Time-of-Flight Low-Energy Ion Scattering (ToF-LEIS) indicates intermixing after annealing at 350 °C, with further compositional changes after annealing at 500 °C, including the emergence of a Si terminating layer at the surface. Consecutive ex-situ Time-of-Flight Medium-Energy Ion Scattering (ToF-MEIS) reveals a Ti-rich polycrystalline surface layer and a Si-rich interface layer exhibiting strong ordering along the Si [100] axis. High-Resolution Transmission Electron Microscopy (HR-TEM) images confirm these findings, revealing a $\approx$1.5 nm thick epitaxial silicide layer at the interface. The presence of an epitaxial interface is particularly promising for minimizing contact resistivity in ultrathin contact layers, where interfacial order can dominate electronic performance. In addition, both ToF-MEIS and HR-TEM unveil significant variations in the thickness of the silicide layer, with a substantial interface roughness but no translation of this roughness to the surface.

cond-mat.mtrl-sci↗

arXiv2025

Effects of mean-field momentum dependence on pion production in intermediate-energy heavy-ion collisions

Pion production in heavy-ion collisions at intermediate energies provides an important probe of the collision dynamics and nuclear matter equation of state, especially the high-density behavior of the symmetry energy. Using the lattice Boltzmann-Uehling-Uhlenbeck transport model with a recently developed nuclear effective interaction based on the so-called N$5$LO Skyrme pseudopotential, we investigate the effects of the momentum dependence of nucleon mean-field potentials on the pion production in Au+Au collisions at a beam energy of $1.23$~GeV/nucleon. We find that a stronger momentum dependence, for which the nucleon mean-field potentials increase faster with momentum, generally suppresses pion production. This feature can be understood in terms of the mean-field-induced modification of nucleon high-momentum phase space during the compression stage: a stronger momentum dependence can reduce the relative fraction of high-momentum nucleons in heavy-ion collisions, thereby suppressing the production of $Δ$ resonances and pions.

nucl-th↗