arXiv subjects

Jun Li

Publications and source records attributed to Jun Li.

At least 199 records · Page 11Linked to original sources

arXiv2025

Towards Communication-efficient Federated Learning via Sparse and Aligned Adaptive Optimization

Adaptive moment estimation (Adam), as a Stochastic Gradient Descent (SGD) variant, has gained widespread popularity in federated learning (FL) due to its fast convergence. However, federated Adam (FedAdam) algorithms suffer from a threefold increase in uplink communication overhead compared to federated SGD (FedSGD) algorithms, which arises from the necessity to transmit both local model updates and first and second moment estimates from distributed devices to the centralized server for aggregation. Driven by this issue, we propose a novel sparse FedAdam algorithm called FedAdam-SSM, wherein distributed devices sparsify the updates of local model parameters and moment estimates and subsequently upload the sparse representations to the centralized server. To further reduce the communication overhead, the updates of local model parameters and moment estimates incorporate a shared sparse mask (SSM) into the sparsification process, eliminating the need for three separate sparse masks. Theoretically, we develop an upper bound on the divergence between the local model trained by FedAdam-SSM and the desired model trained by centralized Adam, which is related to sparsification error and imbalanced data distribution. By minimizing the divergence bound between the model trained by FedAdam-SSM and centralized Adam, we optimize the SSM to mitigate the learning performance degradation caused by sparsification error. Additionally, we provide convergence bounds for FedAdam-SSM in both convex and non-convex objective function settings, and investigate the impact of local epoch, learning rate and sparsification ratio on the convergence rate of FedAdam-SSM. Experimental results show that FedAdam-SSM outperforms baselines in terms of convergence rate (over 1.1$\times$ faster than the sparse FedAdam baselines) and test accuracy (over 14.5\% ahead of the quantized FedAdam baselines).

cs.LG↗

arXiv2025

Towards robust variational quantum simulation of Lindblad dynamics via stochastic Magnus expansion

In this paper, we introduce a novel and general framework for the variational quantum simulation of Lindblad equations. Building on the close relationship between the unraveled Lindblad dynamics, stochastic Magnus integrators, and variational quantum simulation, we propose a high-order scheme for solving the quantum state diffusion equation using exponential integrators. This formulation facilitates the simulation of wavefunction trajectories within the established framework of variational quantum algorithms for time evolution. Our algorithm significantly enhances robustness in two key aspects: the stability of the simulation with large time steps, and the reduction in the number of quantum trajectories required to accurately simulate the Lindblad dynamics in terms of the ensemble average. We demonstrate the effectiveness of our algorithm through numerical examples in both classical and quantum implementations, including the transverse-field Ising model (TFIM) with damping, the Fenna-Matthews-Olson (FMO) complex, and the radical pair model (RPM). The simulation accuracy can be systematically improved, and the algorithm remains reliable even in highly oscillatory regimes. These methods are expected to be applicable to a broader class of open quantum systems beyond the specific models considered in this study.

quant-ph↗

arXiv2025

Plane Detection and Ranking via Model Information Optimization

Plane detection from depth images is a crucial subtask with broad robotic applications, often accomplished by iterative methods such as Random Sample Consensus (RANSAC). While RANSAC is a robust strategy with strong probabilistic guarantees, the ambiguity of its inlier threshold criterion makes it susceptible to false positive plane detections. This issue is particularly prevalent in complex real-world scenes, where the true number of planes is unknown and multiple planes coexist. In this paper, we aim to address this limitation by proposing a generalised framework for plane detection based on model information optimization. Building on previous works, we treat the observed depth readings as discrete random variables, with their probability distributions constrained by the ground truth planes. Various models containing different candidate plane constraints are then generated through repeated random sub-sampling to explain our observations. By incorporating the physics and noise model of the depth sensor, we can calculate the information for each model, and the model with the least information is accepted as the most likely ground truth. This information optimization process serves as an objective mechanism for determining the true number of planes and preventing false positive detections. Additionally, the quality of each detected plane can be ranked by summing the information reduction of inlier points for each plane. We validate these properties through experiments with synthetic data and find that our algorithm estimates plane parameters more accurately compared to the default Open3D RANSAC plane segmentation. Furthermore, we accelerate our algorithm by partitioning the depth map using neural network segmentation, which enhances its ability to generate more realistic plane parameters in real-world data.

cs.CV↗

arXiv2025

When MoE Meets Blockchain: A Trustworthy Distributed Framework of Large Models

As an enabling architecture of Large Models (LMs), Mixture of Experts (MoE) has become prevalent thanks to its sparsely-gated mechanism, which lowers computational overhead while maintaining learning performance comparable to dense LMs. The essence of MoE lies in utilizing a group of neural networks (called experts) with each specializing in different types of tasks, along with a trainable gating network that selectively activates a subset of these experts to handle specific tasks. Traditional cloud-based MoE encounters challenges such as prolonged response latency, high bandwidth consumption, and data privacy leakage. To address these issues, researchers have proposed to deploy MoE over distributed edge networks. However, a key concern of distributed MoE frameworks is the lack of trust in data interactions among distributed experts without the surveillance of any trusted authority, and thereby prone to potential attacks such as data manipulation. In response to the security issues of traditional distributed MoE, we propose a blockchain-aided trustworthy MoE (B-MoE) framework that consists of three layers: the edge layer, the blockchain layer, and the storage layer. In this framework, the edge layer employs the activated experts downloaded from the storage layer to process the learning tasks, while the blockchain layer functions as a decentralized trustworthy network to trace, verify, and record the computational results of the experts from the edge layer. The experimental results demonstrate that B-MoE is more robust to data manipulation attacks than traditional distributed MoE during both the training and inference processes.

cs.DC↗

arXiv2025

Analysis and Optimization of Wireless Multimodal Federated Learning on Modal Heterogeneity

Multimodal federated learning (MFL) is a distributed framework for training multimodal models without uploading local multimodal data of clients, thereby effectively protecting client privacy. However, multimodal data is commonly heterogeneous across diverse clients, where each client possesses only a subset of all modalities, renders conventional analysis results and optimization methods in unimodal federated learning inapplicable. In addition, fixed latency demand and limited communication bandwidth pose significant challenges for deploying MFL in wireless scenarios. To optimize the wireless MFL performance on modal heterogeneity, this paper proposes a joint client scheduling and bandwidth allocation (JCSBA) algorithm based on a decision-level fusion architecture with adding a unimodal loss function. Specifically, with the decision results, the unimodal loss functions are added to both the training objective and local update loss functions to accelerate multimodal convergence and improve unimodal performance. To characterize MFL performance, we derive a closed-form upper bound related to client and modality scheduling and minimize the derived bound under the latency, energy, and bandwidth constraints through JCSBA. Experimental results on multimodal datasets demonstrate that the JCSBA algorithm improves the multimodal accuracy and the unimodal accuracy by 4.06% and 2.73%, respectively, compared to conventional algorithms.

cs.DC↗

arXiv2025

IRDFusion: Iterative Relation-Map Difference guided Feature Fusion for Multispectral Object Detection

Current multispectral object detection methods often retain extraneous background or noise during feature fusion, limiting perceptual performance. To address this, we propose an innovative feature fusion framework based on cross-modal feature contrastive and screening strategy, diverging from conventional approaches. The proposed method adaptively enhances salient structures by fusing object-aware complementary cross-modal features while suppressing shared background interference. Our solution centers on two novel, specially designed modules: the Mutual Feature Refinement Module (MFRM) and the Differential Feature Feedback Module (DFFM). The MFRM enhances intra- and inter-modal feature representations by modeling their relationships, thereby improving cross-modal alignment and discriminative power. Inspired by feedback differential amplifiers, the DFFM dynamically computes inter-modal differential features as guidance signals and feeds them back to the MFRM, enabling adaptive fusion of complementary information while suppressing common-mode noise across modalities. To enable robust feature learning, the MFRM and DFFM are integrated into a unified framework, which is formally formulated as an Iterative Relation-Map Differential Guided Feature Fusion mechanism, termed IRDFusion. IRDFusion enables high-quality cross-modal fusion by progressively amplifying salient relational signals through iterative feedback, while suppressing feature noise, leading to significant performance gains. In extensive experiments on FLIR, LLVIP and M$^3$FD datasets, IRDFusion achieves state-of-the-art performance and consistently outperforms existing methods across diverse challenging scenarios, demonstrating its robustness and effectiveness. Code will be available at https://github.com/61s61min/IRDFusion.git.

cs.CV↗

arXiv2025

Observational Evidence of Dust Evolution in Supernova Remnants: Size Redistribution Toward Larger Grains in Early Sedov Phase

Recent observations have revealed that dust is widespread and abundant in galaxies up to $z\,{\backsimeq}\,8$, significantly influencing their appearance and spectral properties. In the early Universe, dust is thought to form primarily in supernova (SN) ejecta, but also undergoes destruction by the reverse shock. Studying dust in local supernova remnants (SNRs) of different sizes and ages thus provides key constraints on dust formation and evolution during cosmic dawn. Using the newly released 3D $R_{\rm V}$ map, we derived local $R_{\rm V} \equiv A_{\rm V}/E(B-V)$ values for dust in 14 Galactic SNRs in the early Sedov phase and their surrounding interstellar medium (ISM). For the first time, we detect a moderately strong positive correlation between the difference in SNR and ISM $R_{\rm V}$ ($ΔR_{\rm V}$) and SNR radius ($R_{\rm SNR}$), with a Spearman coefficient of $r_{\rm s}\,{=}\,0.62\,{\pm}\,0.14$. This trend offers direct observational evidence for a redistribution of dust grain sizes toward larger grains during SN shock processing, consistent with theoretical models. Our findings provide essential observational constraints on dust size evolution in SNRs and important implications for understanding the rapid enrichment and survival of dust in the early Universe.

astro-ph.GA↗

arXiv2025

Genus Two Stable Maps, Local Equations and Modular Resolutions

We provide a geometric construction of a sequence of modular blowups of the Artin stack parameterizing pre-stable pairs consisting of a genus-two nodal curve and a smooth divisor. The resulting stack locally diagonalizes the tautological derived objects associated with the moduli of stable maps from genus-two curves to projective space. As a consequence, the singularities of the main component of the moduli space of stable maps are resolved, and the entire space admits only normal crossing singularities. Our approach is expected to generalize to higher genera.

math.AG↗

arXiv2025

A biologically inspired separable learning vision model for real-time traffic object perception in Dark

Fast and accurate object perception in low-light traffic scenes has attracted increasing attention. However, due to severe illumination degradation and the lack of reliable visual cues, existing perception models and methods struggle to quickly adapt to and accurately predict in low-light environments. Moreover, there is the absence of available large-scale benchmark specifically focused on low-light traffic scenes. To bridge this gap, we introduce a physically grounded illumination degradation method tailored to real-world low-light settings and construct Dark-traffic, the largest densely annotated dataset to date for low-light traffic scenes, supporting object detection, instance segmentation, and optical flow estimation. We further propose the Separable Learning Vision Model (SLVM), a biologically inspired framework designed to enhance perception under adverse lighting. SLVM integrates four key components: a light-adaptive pupillary mechanism for illumination-sensitive feature extraction, a feature-level separable learning strategy for efficient representation, task-specific decoupled branches for multi-task separable learning, and a spatial misalignment-aware fusion module for precise multi-feature alignment. Extensive experiments demonstrate that SLVM achieves state-of-the-art performance with reduced computational overhead. Notably, it outperforms RT-DETR by 11.2 percentage points in detection, YOLOv12 by 6.1 percentage points in instance segmentation, and reduces endpoint error (EPE) of baseline by 12.37% on Dark-traffic. On the LIS benchmark, the end-to-end trained SLVM surpasses Swin Transformer+EnlightenGAN and ConvNeXt-T+EnlightenGAN by an average of 11 percentage points across key metrics, and exceeds Mask RCNN (with light enhancement) by 3.1 percentage points. The Dark-traffic dataset and complete code is released at https://github.com/alanli1997/slvm.

cs.CV↗

arXiv2025

FlashRecovery: Fast and Low-Cost Recovery from Failures for Large-Scale Training of LLMs

Large language models (LLMs) have made a profound impact across various fields due to their advanced capabilities. However, training these models at unprecedented scales requires extensive AI accelerator clusters and sophisticated parallelism strategies, which pose significant challenges in maintaining system reliability over prolonged training periods. A major concern is the substantial loss of training time caused by inevitable hardware and software failures. To address these challenges, we present FlashRecovery, a fast and low-cost failure recovery system comprising three core modules: (1) Active and real-time failure detection. This module performs continuous training state monitoring, enabling immediate identification of hardware and software failures within seconds, thus ensuring rapid incident response; (2) Scale-independent task restart. By employing different recovery strategies for normal and faulty nodes, combined with an optimized communication group reconstruction protocol, our approach ensures that the recovery time remains nearly constant, regardless of cluster scale; (3) Checkpoint-free recovery within one step. Our novel recovery mechanism enables single-step restoration, completely eliminating dependence on traditional checkpointing methods and their associated overhead. Collectively, these innovations enable FlashRecovery to achieve optimal Recovery Time Objective (RTO) and Recovery Point Objective (RPO), substantially improving the reliability and efficiency of long-duration LLM training. Experimental results demonstrate that FlashRecovery system can achieve training restoration on training cluster with 4, 800 devices in 150 seconds. We also verify that the time required for failure recovery is nearly consistent for different scales of training tasks.

cs.DC↗

arXiv2025

Category-Aware 3D Object Composition with Disentangled Texture and Shape Multi-view Diffusion

In this paper, we tackle a new task of 3D object synthesis, where a 3D model is composited with another object category to create a novel 3D model. However, most existing text/image/3D-to-3D methods struggle to effectively integrate multiple content sources, often resulting in inconsistent textures and inaccurate shapes. To overcome these challenges, we propose a straightforward yet powerful approach, category+3D-to-3D (C33D), for generating novel and structurally coherent 3D models. Our method begins by rendering multi-view images and normal maps from the input 3D model, then generating a novel 2D object using adaptive text-image harmony (ATIH) with the front-view image and a text description from another object category as inputs. To ensure texture consistency, we introduce texture multi-view diffusion, which refines the textures of the remaining multi-view RGB images based on the novel 2D object. For enhanced shape accuracy, we propose shape multi-view diffusion to improve the 2D shapes of both the multi-view RGB images and the normal maps, also conditioned on the novel 2D object. Finally, these outputs are used to reconstruct a complete and novel 3D model. Extensive experiments demonstrate the effectiveness of our method, yielding impressive 3D creations, such as shark(3D)-crocodile(text) in the first row of Fig. 1. A project page is available at: https://xzr52.github.io/C33D/

cs.CV↗

arXiv2025

Adaptive CUSUM Chart for Simultaneous Monitoring of Mean and Variance

Simultaneously monitoring changes in both the mean and variance is a fundamental problem in Statistical Process Control, and numerous methods have been developed to address it. However, many existing approaches face notable limitations: some rely on tuning parameters that can significantly affect performance; others are biased toward detecting increases in variance while performing poorly for decreases; and some are computationally burdensome. To address these limitations, we propose a novel adaptive CUSUM chart for jointly monitoring the mean and variance of a Gaussian process. The proposed method is free of tuning parameters, efficient in detecting a broad range of shifts in both mean and variance, and well-suited for real-time monitoring due to its recursive structure. It also has a built-in post-signal diagnostics function that can identify what kind of distributional changes have occurred after an alarm. Simulation results show that, compared to existing methods, the proposed chart achieves the most favorable balance between detection power and computational efficiency, delivering the best overall performance.

stat.ME↗

arXiv2025

Adaptive CUSUM Chart for Real-Time Monitoring of Bivariate Event Data

Monitoring time-between-events (TBE) data, where the goal is to track the time between consecutive events, has important applications across various fields. Many existing schemes for monitoring multivariate TBE data suffer from inherent delays, as they require waiting until all components of the observation vector are available before making inferences about the process state. In practice, however, these components are rarely recorded simultaneously. To address this issue, Zwetsloot et al. proposed a Shewhart chart for bivariate TBE data that updates the process status as individual observations arrive. However, like most Shewhart-type charts, their method evaluates the process based solely on the most recent observation and does not incorporate historical information. As a result, it is ineffective in detecting small to moderate changes. To overcome this limitation, we develop an adaptive CUSUM chart that updates with each incoming observation while also accumulating information over time. Simulation studies and real-data applications demonstrate that our method substantially outperforms the Shewhart chart of Zwetsloot et al., offering a robust and effective tool for real-time monitoring of bivariate TBE data.

stat.ME↗

arXiv2025

DuCos: Duality Constrained Depth Super-Resolution via Foundation Model

We introduce DuCos, a novel depth super-resolution framework grounded in Lagrangian duality theory, offering a flexible integration of multiple constraints and reconstruction objectives to enhance accuracy and robustness. Our DuCos is the first to significantly improve generalization across diverse scenarios with foundation models as prompts. The prompt design consists of two key components: Correlative Fusion (CF) and Gradient Regulation (GR). CF facilitates precise geometric alignment and effective fusion between prompt and depth features, while GR refines depth predictions by enforcing consistency with sharp-edged depth maps derived from foundation models. Crucially, these prompts are seamlessly embedded into the Lagrangian constraint term, forming a synergistic and principled framework. Extensive experiments demonstrate that DuCos outperforms existing state-of-the-art methods, achieving superior accuracy, robustness, and generalization.

cs.CV↗

arXiv2025

Structural contribution to light-induced gap suppression in Ta$_2$NiSe$_5$

An excitonic insulator is a material that hosts an exotic ground state, where an energy gap opens due to spontaneous condensation of bound electron-hole pairs. Ta$_2$NiSe$_5$ is a promising candidate for this type of material, but the coexistence of a structural phase transition with the gap opening has led to a long-standing debate regarding the origin of the insulating gap. Here we employ MeV ultrafast electron diffraction to obtain quantitative insights into the atomic displacements in Ta$_2$NiSe$_5$ following photoexcitation, which has been overlooked in previous time-resolved spectroscopy studies. In conjunction with first-principles calculations using the measured atomic displacements, we find that the structural change can largely account for the photoinduced reduction in the energy gap without considering excitonic effects. Our work illustrates the importance of a quantitative reconstruction of individual atomic pathways during nonequilibrium phase transitions, paving the way for a mechanistic understanding of a diverse array of phase transitions in correlated materials where lattice dynamics can play a pivotal role.

cond-mat.mtrl-sci↗

arXiv2025

Task Offloading and Resource Allocation for MEC-assisted Consumer Internet of Vehicle Systems

Mobile edge computing (MEC)-assisted internet of vehicle (IoV) is emerging as a promising paradigm to provide computing services for vehicles. However, meeting the computing-sensitive and computation-intensive demands of vehicles poses several challenges, including the discrepancy between the limited resource provision and stringent computing requirement, the difficulty in capturing and integrating the intricate features of the MEC-assisted IoV system into the problem formulation, and the need for real-time processing and efficient resource management in the dynamic environment. In this work, we explore the AI-enabled task offloading and resource allocation for MEC-assisted consumer IoV systems. Specifically, we first present a multi-MEC-assisted consumer IoV architecture that leverages the computational resources of MEC servers to provide offloading services close to vehicles. Subsequently, we formulate a system cost minimization optimization problem (SCMOP) by integrating the service delay and energy consumption. To efficiently solve this problem, we design a joint task offloading and computing resource allocation approach (JTOCRA) by applying the multi-agent deep deterministic policy gradient (MADDPG) algorithm. Finally, simulation results demonstrate that the proposed JTOCRA can achieve superior system performances and exhibits better scalability compared to other alternative approaches.

cs.NI↗

arXiv2025

RSVLM-QA: A Benchmark Dataset for Remote Sensing Vision Language Model-based Question Answering

Visual Question Answering (VQA) in remote sensing (RS) is pivotal for interpreting Earth observation data. However, existing RS VQA datasets are constrained by limitations in annotation richness, question diversity, and the assessment of specific reasoning capabilities. This paper introduces RSVLM-QA dataset, a new large-scale, content-rich VQA dataset for the RS domain. RSVLM-QA is constructed by integrating data from several prominent RS segmentation and detection datasets: WHU, LoveDA, INRIA, and iSAID. We employ an innovative dual-track annotation generation pipeline. Firstly, we leverage Large Language Models (LLMs), specifically GPT-4.1, with meticulously designed prompts to automatically generate a suite of detailed annotations including image captions, spatial relations, and semantic tags, alongside complex caption-based VQA pairs. Secondly, to address the challenging task of object counting in RS imagery, we have developed a specialized automated process that extracts object counts directly from the original segmentation data; GPT-4.1 then formulates natural language answers from these counts, which are paired with preset question templates to create counting QA pairs. RSVLM-QA comprises 13,820 images and 162,373 VQA pairs, featuring extensive annotations and diverse question types. We provide a detailed statistical analysis of the dataset and a comparison with existing RS VQA benchmarks, highlighting the superior depth and breadth of RSVLM-QA's annotations. Furthermore, we conduct benchmark experiments on Six mainstream Vision Language Models (VLMs), demonstrating that RSVLM-QA effectively evaluates and challenges the understanding and reasoning abilities of current VLMs in the RS domain. We believe RSVLM-QA will serve as a pivotal resource for the RS VQA and VLM research communities, poised to catalyze advancements in the field.

cs.CV↗

arXiv2025

A Spin Glass Characterization of Neural Networks

This work presents a statistical mechanics characterization of neural networks, motivated by the replica symmetry breaking (RSB) phenomenon in spin glasses. A Hopfield-type spin glass model is constructed from a given feedforward neural network (FNN). Overlaps between simulated replica samples serve as a characteristic descriptor of the FNN. The connection between the spin-glass description and commonly studied properties of the FNN -- such as data fitting, capacity, generalization, and robustness -- has been investigated and empirically demonstrated. Unlike prior analytical studies that focus on model ensembles, this method provides a computable descriptor for individual network instances, which reveals nontrivial structural properties that are not captured by conventional metrics such as loss or accuracy. Preliminary results suggests its potential for practical applications such as model inspection, safety verification, and detection of hidden vulnerabilities.

cond-mat.dis-nn↗