arXiv subjects

Hui Li

Publications and source records attributed to Hui Li.

At least 199 records · Page 11Linked to original sources

arXiv2025

PeriodNet: Boosting the Potential of Attention Mechanism for Time Series Forecasting

The attention mechanism has demonstrated remarkable potential in sequence modeling, exemplified by its successful application in natural language processing with models such as Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-trained Transformer (GPT). Despite these advancements, its utilization in time series forecasting (TSF) has yet to meet expectations. Exploring a better network structure for attention in TSF holds immense significance across various domains. In this paper, we present PeriodNet with a brand new structure to forecast univariate and multivariate time series. PeriodNet incorporates period attention and sparse period attention mechanism for analyzing adjacent periods. It enhances the mining of local characteristics, periodic patterns, and global dependencies. For efficient cross-variable modeling, we introduce an iterative grouping mechanism which can directly reduce the cross-variable redundancy. To fully leverage the extracted features on the encoder side, we redesign the entire architecture of the vanilla Transformer and propose a period diffuser for precise multi-period prediction. Through comprehensive experiments conducted on eight datasets, we demonstrate that PeriodNet outperforms six state-of-the-art models in both univariate and multivariate TSF scenarios in terms of mean square error and mean absolute error. In particular, PeriodNet achieves a relative improvement of 22% when forecasting time series with a length of 720, in comparison to other models based on the conventional encoder-decoder Transformer architecture.

cs.LG↗

arXiv2025

One Latent Space to Rule All Degradations: Unifying Restoration Knowledge for Image Fusion

All-in-One Degradation-Aware Fusion Models (ADFMs) as one of multi-modal image fusion models, which aims to address complex scenes by mitigating degradations from source images and generating high-quality fused images. Mainstream ADFMs rely on end-to-end learning and heavily synthesized datasets to achieve degradation awareness and fusion. This rough learning strategy and non-real world scenario dataset dependence often limit their upper-bound performance, leading to low-quality results. To address these limitations, we present LURE, a Learning-driven Unified REpresentation model for infrared and visible image fusion, which is degradation-aware. LURE learns a Unified Latent Feature Space (ULFS) to avoid the dependency on complex data formats inherent in previous end-to-end learning pipelines. It further improves image fusion quality by leveraging the intrinsic relationships between multi-modalities. A novel loss function is also proposed to drive the learning of unified latent representations more stable.More importantly, LURE seamlessly incorporates existing high-quality real-world image restoration datasets. To further enhance the model's representation capability, we design a simple yet effective structure, termed internal residual block, to facilitate the learning of latent features. Experiments show our method outperforms state-of-the-art (SOTA) methods across general fusion, degradation-aware fusion, and downstream tasks. The code is available in the supplementary materials.

cs.CV↗

arXiv2025

Transferring Data from a Voronoi Mesh to an Adaptive Cartesian Grid in Pursuit of Self-consistent Top-down Star Formation

Unstructured Voronoi mesh simulations offer many advantages for simulating self-gravitating gas dynamics on galactic scales. Adaptive mesh refinement (AMR) can be a powerful tool for simulating the details of star cluster formation and gas dispersal by stellar feedback. Zooming in from galactic to local scales using the star cluster formation simulation package Torch requires transferring simulation data from one scale to the other. Therefore, we introduce VorAMR, a novel computational tool that interpolates data from an unstructured Voronoi mesh to an AMR Cartesian grid. VorAMR is integrated into the Torch package, which integrates the FLASH AMR magnetohydrodynamics code into the Astrophysical Multipurpose Software Environment. VorAMR interpolates data from an AREPO simulation to a FLASH AMR grid using a nearest-neighbor particle scheme, which can then be evolved within the Torch package, representing the first ever transfer of data from a Voronoi mesh to an AMR Cartesian grid. Interpolation from one numerical representation to another results in an error of a few percent in global mass and energy conservation, which could be reduced with higher-order interpolation of the Voronoi cells. We show that the postinterpolation Torch simulation evolves without numerical abnormalities. A preliminary Torch simulation is evolved for 3.22 Myr and compared to the original AREPO simulation over the same time period. We observe similarly distributed star cluster formation between the two simulations. More compact clusters are produced in the Torch simulation as well as 2.3 times as much stellar material as in AREPO, likely due to the differences in resolution.

astro-ph.GA↗

arXiv2025

HCC-3D: Hierarchical Compensatory Compression for 98% 3D Token Reduction in Vision-Language Models

3D understanding has drawn significant attention recently, leveraging Vision-Language Models (VLMs) to enable multi-modal reasoning between point cloud and text data. Current 3D-VLMs directly embed the 3D point clouds into 3D tokens, following large 2D-VLMs with powerful reasoning capabilities. However, this framework has a great computational cost limiting its application, where we identify that the bottleneck lies in processing all 3D tokens in the Large Language Model (LLM) part. This raises the question: how can we reduce the computational overhead introduced by 3D tokens while preserving the integrity of their essential information? To address this question, we introduce Hierarchical Compensatory Compression (HCC-3D) to efficiently compress 3D tokens while maintaining critical detail retention. Specifically, we first propose a global structure compression (GSC), in which we design global queries to compress all 3D tokens into a few key tokens while keeping overall structural information. Then, to compensate for the information loss in GSC, we further propose an adaptive detail mining (ADM) module that selectively recompresses salient but under-attended features through complementary scoring. Extensive experiments demonstrate that HCC-3D not only achieves extreme compression ratios (approximately 98%) compared to previous 3D-VLMs, but also achieves new state-of-the-art performance, showing the great improvements on both efficiency and performance.

cs.CV↗

arXiv2025

CSST Strong Lensing Preparation: Cosmological Constraints Forecast from CSST Galaxy-Scale Strong Lensing

Strong gravitational lensing by galaxies is a powerful tool for studying cosmology and galaxy structure. The China Space Station Telescope (CSST) will revolutionize this field by discovering up to $\sim$100,000 galaxy-scale strong lenses, a huge increase over current samples. To harness the statistical power of this vast dataset, we forecast its cosmological constraining power using the gravitational-dynamical mass combination method. We create a realistic simulated lens sample and test how uncertainties in redshift and velocity dispersion measurements affect results under ideal, optimistic, and pessimistic scenarios. We find that increasing the sample size from 100 to 10,000 systems dramatically improves precision: in the $Λ$CDM model, the uncertainty on the matter density parameter, $Ω_m$, drops from 0.2 to 0.01; in the $w$CDM model, the uncertainty on the dark energy equation of state, $w$, decreases from 0.3 to 0.04. With 10,000 lenses, our constraints on dark energy are twice as tight as those from the latest DESI BAO measurements. We also compare two parameter estimation techniques -- MultiNest sampling and Bayesian Hierarchical Modeling (BHM). While both achieve similar precision, BHM provides more robust estimates of intrinsic lens parameters, whereas MultiNest is about twice as fast. This work establishes an efficient and scalable framework for cosmological analysis with next-generation strong lensing surveys.

astro-ph.CO↗

arXiv2025

Diffusion Transformer meets Multi-level Wavelet Spectrum for Single Image Super-Resolution

Discrete Wavelet Transform (DWT) has been widely explored to enhance the performance of image superresolution (SR). Despite some DWT-based methods improving SR by capturing fine-grained frequency signals, most existing approaches neglect the interrelations among multiscale frequency sub-bands, resulting in inconsistencies and unnatural artifacts in the reconstructed images. To address this challenge, we propose a Diffusion Transformer model based on image Wavelet spectra for SR (DTWSR). DTWSR incorporates the superiority of diffusion models and transformers to capture the interrelations among multiscale frequency sub-bands, leading to a more consistence and realistic SR image. Specifically, we use a Multi-level Discrete Wavelet Transform to decompose images into wavelet spectra. A pyramid tokenization method is proposed which embeds the spectra into a sequence of tokens for transformer model, facilitating to capture features from both spatial and frequency domain. A dual-decoder is designed elaborately to handle the distinct variances in low-frequency and high-frequency sub-bands, without omitting their alignment in image generation. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of our method, with high performance on both perception quality and fidelity.

cs.CV↗

arXiv2025

Benchmarking Non-perturbative Many-Body Approaches in the Exactly Solvable Hatsugai-Kohmoto Model

The accurate simulation of strongly correlated electron systems remains a central challenge in condensed matter physics, motivating the development of various non-perturbative many-body methods. Such methods are typically benchmarked against the numerical exact determinant quantum Monte Carlo (DQMC) in the Hubbard model; however, DQMC is limited by the fermionic sign problem and the uncertainties of numerical analytic continuation. To address these issues, we use the exactly solvable Hatsugai-Kohmoto (HK) model as a benchmarking platform to evaluate three many-body approximations: $GW$, $HGW$, and $SGW$. We compare the Green's functions, spectral functions, and response functions obtained from these approximations with the exact solutions. Our analysis shows that the $GW$ approximation, often considered insufficient for describing strong correlation, exhibits a previously unreported solution branch that accurately reproduces Mott physics in the HK model. In addition, using a covariant formalism, we find that $HGW$ provides an accurate description of charge response, while $SGW$ performs well for spin correlations. Overall, our work demonstrates that the HK model can effectively benchmark many-body approximations and helps refine the understanding of $GW$ methods in strongly correlated regimes.

cond-mat.str-el↗

arXiv2025

Unveiling the Mixing and Transport Processes of Solar Wind and Planetary Ions in the Magnetopause Boundary Layer

Kelvin-Helmholtz (KH) vortices are widely observed in astrophysics and heliophysics, including at Jovian and terrestrial magnetopauses, the Martian sheath-ionosphere boundary, the heliopause, and within stellar accretion disks. These vortices play a critical role in transporting mass, momentum, and energy across boundary layers. Magnetized planets such as Earth exhibit a higher incidence of fully rolled-up, nonlinear KH vortices compared to non-magnetized planets like Mars. In contrast to previous magnetohydrodynamic (MHD) studies, this work adopts a kinetic point of view to quantify ion mixing rates using three-dimensional global hybrid simulations, with Earth as a representative case. This approach enables automated identification of the KH-modulated, corrugated magnetopause. For the first time, we provide a quantitative assessment of how solar wind conditions control solar wind entry and subsequent mixing with magnetospheric ions via KH waves. We find that under northward interplanetary magnetic field (IMF) conditions, the flux of particles crossing the dayside magnetopause increases with solar wind dynamic pressure and peaks in the KH region. Notably, the KH-modulated low-latitude boundary layer thins as the dynamic pressure increases. Under southward IMF conditions, coupled reconnection and KH structures further enhance solar wind injection and boost magnetospheric ion escape in the dayside, especially near the subsolar point where reconnection intensifies this exchange. These results also shed light on the evolution of space environments and mass transport at magnetized planets in the heliosphere and beyond.

physics.space-ph↗

arXiv2025

Learning an Efficient Optimizer via Hybrid-Policy Sub-Trajectory Balance

Recent advances in generative modeling enable neural networks to generate weights without relying on gradient-based optimization. However, current methods are limited by issues of over-coupling and long-horizon. The former tightly binds weight generation with task-specific objectives, thereby limiting the flexibility of the learned optimizer. The latter leads to inefficiency and low accuracy during inference, caused by the lack of local constraints. In this paper, we propose Lo-Hp, a decoupled two-stage weight generation framework that enhances flexibility through learning various optimization policies. It adopts a hybrid-policy sub-trajectory balance objective, which integrates on-policy and off-policy learning to capture local optimization policies. Theoretically, we demonstrate that learning solely local optimization policies can address the long-horizon issue while enhancing the generation of global optimal weights. In addition, we validate Lo-Hp's superior accuracy and inference efficiency in tasks that require frequent weight updates, such as transfer learning, few-shot learning, domain generalization, and large language model adaptation.

cs.LG↗

arXiv2025

Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws

Existing infrared and visible image fusion methods often face the dilemma of balancing modal information. Generative fusion methods reconstruct fused images by learning from data distributions, but their generative capabilities remain limited. Moreover, the lack of interpretability in modal information selection further affects the reliability and consistency of fusion results in complex scenarios. This manuscript revisits the essence of generative image fusion under the inspiration of human cognitive laws and proposes a novel infrared and visible image fusion method, termed HCLFuse. First, HCLFuse investigates the quantification theory of information mapping in unsupervised fusion networks, which leads to the design of a multi-scale mask-regulated variational bottleneck encoder. This encoder applies posterior probability modeling and information decomposition to extract accurate and concise low-level modal information, thereby supporting the generation of high-fidelity structural details. Furthermore, the probabilistic generative capability of the diffusion model is integrated with physical laws, forming a time-varying physical guidance mechanism that adaptively regulates the generation process at different stages, thereby enhancing the ability of the model to perceive the intrinsic structure of data and reducing dependence on data quality. Experimental results show that the proposed method achieves state-of-the-art fusion performance in qualitative and quantitative evaluations across multiple datasets and significantly improves semantic segmentation metrics. This fully demonstrates the advantages of this generative image fusion method, drawing inspiration from human cognition, in enhancing structural consistency and detail quality.

cs.CV↗

arXiv2025

Pentest-R1: Towards Autonomous Penetration Testing Reasoning Optimized via Two-Stage Reinforcement Learning

Automating penetration testing is crucial for enhancing cybersecurity, yet current Large Language Models (LLMs) face significant limitations in this domain, including poor error handling, inefficient reasoning, and an inability to perform complex end-to-end tasks autonomously. To address these challenges, we introduce Pentest-R1, a novel framework designed to optimize LLM reasoning capabilities for this task through a two-stage reinforcement learning pipeline. We first construct a dataset of over 500 real-world, multi-step walkthroughs, which Pentest-R1 leverages for offline reinforcement learning (RL) to instill foundational attack logic. Subsequently, the LLM is fine-tuned via online RL in an interactive Capture The Flag (CTF) environment, where it learns directly from environmental feedback to develop robust error self-correction and adaptive strategies. Our extensive experiments on the Cybench and AutoPenBench benchmarks demonstrate the framework's effectiveness. On AutoPenBench, Pentest-R1 achieves a 24.2\% success rate, surpassing most state-of-the-art models and ranking second only to Gemini 2.5 Flash. On Cybench, it attains a 15.0\% success rate in unguided tasks, establishing a new state-of-the-art for open-source LLMs and matching the performance of top proprietary models. Ablation studies confirm that the synergy of both training stages is critical to its success.

cs.AI↗

arXiv2025

MCPGuard : Automatically Detecting Vulnerabilities in MCP Servers

The Model Context Protocol (MCP) has emerged as a standardized interface enabling seamless integration between Large Language Models (LLMs) and external data sources and tools. While MCP significantly reduces development complexity and enhances agent capabilities, its openness and extensibility introduce critical security vulnerabilities that threaten system trustworthiness and user data protection. This paper systematically analyzes the security landscape of MCP-based systems, identifying three principal threat categories: (1) agent hijacking attacks stemming from protocol design deficiencies; (2) traditional web vulnerabilities in MCP servers; and (3) supply chain security. To address these challenges, we comprehensively survey existing defense strategies, examining both proactive server-side scanning approaches, ranging from layered detection pipelines and agentic auditing frameworks to zero-trust registry systems, and runtime interaction monitoring solutions that provide continuous oversight and policy enforcement. Our analysis reveals that MCP security fundamentally represents a paradigm shift where the attack surface extends from traditional code execution to semantic interpretation of natural language metadata, necessitating novel defense mechanisms tailored to this unique threat model.

cs.CR↗

arXiv2025

RefleXGen:The unexamined code is not worth using

Security in code generation remains a pivotal challenge when applying large language models (LLMs). This paper introduces RefleXGen, an innovative method that significantly enhances code security by integrating Retrieval-Augmented Generation (RAG) techniques with guided self-reflection mechanisms inherent in LLMs. Unlike traditional approaches that rely on fine-tuning LLMs or developing specialized secure code datasets - processes that can be resource-intensive - RefleXGen iteratively optimizes the code generation process through self-assessment and reflection without the need for extensive resources. Within this framework, the model continuously accumulates and refines its knowledge base, thereby progressively improving the security of the generated code. Experimental results demonstrate that RefleXGen substantially enhances code security across multiple models, achieving a 13.6% improvement with GPT-3.5 Turbo, a 6.7% improvement with GPT-4o, a 4.5% improvement with CodeQwen, and a 5.8% improvement with Gemini. Our findings highlight that improving the quality of model self-reflection constitutes an effective and practical strategy for strengthening the security of AI-generated code.

cs.SE↗

arXiv2025

PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis

Interactive world models that simulate object dynamics are crucial for robotics, VR, and AR. However, it remains a significant challenge to learn physics-consistent dynamics models from limited real-world video data, especially for deformable objects with spatially-varying physical properties. To overcome the challenge of data scarcity, we propose PhysWorld, a novel framework that utilizes a simulator to synthesize physically plausible and diverse demonstrations to learn efficient world models. Specifically, we first construct a physics-consistent digital twin within MPM simulator via constitutive model selection and global-to-local optimization of physical properties. Subsequently, we apply part-aware perturbations to the physical properties and generate various motion patterns for the digital twin, synthesizing extensive and diverse demonstrations. Finally, using these demonstrations, we train a lightweight GNN-based world model that is embedded with physical properties. The real video can be used to further refine the physical properties. PhysWorld achieves accurate and fast future predictions for various deformable objects, and also generalizes well to novel interactions. Experiments show that PhysWorld has competitive performance while enabling inference speeds 47 times faster than the recent state-of-the-art method, i.e., PhysTwin.

cs.CV↗

arXiv2025

Scalable protocol to coherence estimation from scarce data: Theory and experiment

Key quantum features like coherence are the fundamental resources enabling quantum advantages and ascertaining their presence in quantum systems is crucial for developing quantum technologies. This task, however, faces severe challenges in the noisy intermediate-scale quantum era. On one hand, experimental data are typically scarce, rendering full state reconstruction infeasible. On the other hand, these features are usually quantified by highly nonlinear functionals that elude efficient estimations via existing methods. In this work, we propose a scalable protocol for estimating coherence from scarce data and further experimentally demonstrate its practical utility. The key innovation here is to relax the potentially NP-hard coherence estimation problem into a computationally efficient optimization. This renders the computational cost in our protocol insensitive to the system size, in sharp contrast to the exponential growth in traditional methods. This work opens a novel route toward estimating coherence of large-scale quantum systems under data-scarce conditions.

quant-ph↗

arXiv2025

Significant Amplification of Turbulent Energy Dissipation through the Shock Transition at Mars

Turbulence is fundamental to energy transfer across scales in space and astrophysical plasmas. Bow shock interactions have long been hypothesized to significantly modify turbulence in planetary environments, yet the quantification of such effects and their parametric dependencies remain largely unaddressed. Using in situ long-term high-time resolution measurements from NASA's MAVEN mission, we report the first observational characterization of the evolution and parametric dependence of the turbulence energy cascade rate $\varepsilon_C$ at magnetohydrodynamic (MHD) scales. Key findings reveal an averaged three-order-of-magnitude enhancement in $\varepsilon_C$ when transitioning from the solar wind to the magnetosheath. Notably, downstream measurements of oblique and quasi-perpendicular shocks exhibit higher energy dissipation rates than those of quasi-parallel configurations. These results provide the first direct evidence linking shock obliquity to turbulence amplification, offering key insights into shock-mediated turbulence in similar but inaccessible systems.

physics.plasm-ph↗

arXiv2025

RIGEL: Feedback-regulated cloud-scale star formation efficiency in a simulated dwarf galaxy merger

Major mergers of galaxies are likely to trigger bursty star formation activities. The accumulation of dense gas and the boost of star formation efficiency (SFE) are considered to be the two main drivers of starbursts. However, it remains unclear how each process operates on the scale of individual star-forming clouds. Here, we present a high-resolution (2 Msun) RHD simulation of a gas-rich dwarf galaxy merger using the RIGEL model to investigate how mergers affect the properties of the structure of dense star-forming gas and the cloud-scale SFE. We tracked the evolution of sub-virial dense clouds in the simulation by mapping them across successive snapshots taken at intervals of 0.2 Myr. We find that the merger triggers a 130 fold increase in the SFR and shortens the galaxy-wide gas-depletion time by two orders of magnitude compared to those in two isolated galaxies. However, the depletion time of individual clouds and their lifetime distribution remained unchanged over the simulation period. The cloud life cycles and cloud-scale SFE are determined by the local stellar feedback rather than such environmental factors as tidal fields regardless of the merger process, and the integrated SFE ($ε_{\rm int}$) of clouds in complex environments remains well-described by an $ε_{\rm int}-Σ_{\rm tot}$ relation found in idealized isolated-cloud experiments. During the peak of the starburst, the media SFE was lower by only 0.17-0.33 dex compared to the value when the galaxies were not interacting. The merger boosts the SFR through the accumulation and compression of dense gas fueling star formation. Strong tidal torques assemble $>10^5$ Msun clouds, which seed massive star clusters. The average separation between star-forming clouds decreases during the merger, which in turn decreases the cloud--cluster spatial de-correlation from >1 kpc to 0.1 kpc depicted in tuning fork diagrams.

astro-ph.GA↗

arXiv2025

Pixel-level modelling of group-scale strong lens CASSOWARY 19

We present the first high-precision model for the group-scale strong lensing system CASSOWARY 19 (CSWA19), utilising images from the Hubble Space Telescope (HST). Sixteen member galaxies identified via the red-sequence method, and the main halo, all modelled as the dual Pseudo Isothermal Elliptical profile (dPIE), are incorporated into a parametric lens model alongside an external shear field. To model the system, we adopt the PyAutoLens software package, employing a progressive search chain strategy for realizing the transition of source model from multiple Sérsic profiles to a brightness-adaptive pixelization, which uses 1000 pixels in the source plane to reconstruct the background source corresponding to 177,144 image pixels in the image plane. Our results indicate that the total mass within the Einstein radius is $M_{θ_\mathrm{E}}$ $\approx 1.41\times10^{13}$M$_{\odot}$ and the average slope of the total mass density $ρ(r)\propto r^{-γ}$ is $\tildeγ=1.33$ within the effective radius. This slope is shallower than those measured in galaxies and groups but is closer to those of galaxy clusters. In addition, our approach successfully resolves the two merging galaxies in the background source and yields a total magnification of $μ=103.18^{+0.23}_{-0.19}$, which is significantly higher than the outcomes from previous studies of CSWA19. In summary, our research demonstrates the effectiveness of the brightness-adaptive pixelization source reconstruction technique for modelling group-scale strong lensing systems. It can serve as a technical reference for future investigations into pixel-level modelling of the group- and cluster-scale strong lensing systems.

astro-ph.GA↗