arXiv Science⌕ Search

arXiv subjects

Zhe Wang

Publications and source records attributed to Zhe Wang.

At least 181 records · Page 10Linked to original sources

When MoE Meets Blockchain: A Trustworthy Distributed Framework of Large Models

As an enabling architecture of Large Models (LMs), Mixture of Experts (MoE) has become prevalent thanks to its sparsely-gated mechanism, which lowers computational overhead while maintaining learning performance comparable to dense LMs. The essence of MoE lies in utilizing a group of neural networks (called experts) with each specializing in different types of tasks, along with a trainable gating network that selectively activates a subset of these experts to handle specific tasks. Traditional cloud-based MoE encounters challenges such as prolonged response latency, high bandwidth consumption, and data privacy leakage. To address these issues, researchers have proposed to deploy MoE over distributed edge networks. However, a key concern of distributed MoE frameworks is the lack of trust in data interactions among distributed experts without the surveillance of any trusted authority, and thereby prone to potential attacks such as data manipulation. In response to the security issues of traditional distributed MoE, we propose a blockchain-aided trustworthy MoE (B-MoE) framework that consists of three layers: the edge layer, the blockchain layer, and the storage layer. In this framework, the edge layer employs the activated experts downloaded from the storage layer to process the learning tasks, while the blockchain layer functions as a decentralized trustworthy network to trace, verify, and record the computational results of the experts from the edge layer. The experimental results demonstrate that B-MoE is more robust to data manipulation attacks than traditional distributed MoE during both the training and inference processes.

cs.DC↗

BAPFL: Exploring Backdoor Attacks Against Prototype-based Federated Learning

Prototype-based federated learning (PFL) has emerged as a promising paradigm to address data heterogeneity problems in federated learning, as it leverages mean feature vectors as prototypes to enhance model generalization. However, its robustness against backdoor attacks remains largely unexplored. In this paper, we identify that PFL is inherently resistant to existing backdoor attacks due to its unique prototype learning mechanism and local data heterogeneity. To further explore the security of PFL, we propose BAPFL, the first backdoor attack method specifically designed for PFL frameworks. BAPFL integrates a prototype poisoning strategy with a trigger optimization mechanism. The prototype poisoning strategy manipulates the trajectories of global prototypes to mislead the prototype training of benign clients, pushing their local prototypes of clean samples away from the prototypes of trigger-embedded samples. Meanwhile, the trigger optimization mechanism learns a unique and stealthy trigger for each potential target label, and guides the prototypes of trigger-embedded samples to align closely with the global prototype of the target label. Experimental results across multiple datasets and PFL variants demonstrate that BAPFL achieves a 35\%-75\% improvement in attack success rate compared to traditional backdoor attacks, while preserving main task accuracy. These results highlight the effectiveness, stealthiness, and adaptability of BAPFL in PFL.

cs.LG↗

Weakly and Self-Supervised Class-Agnostic Motion Prediction for Autonomous Driving

Understanding motion in dynamic environments is critical for autonomous driving, thereby motivating research on class-agnostic motion prediction. In this work, we investigate weakly and self-supervised class-agnostic motion prediction from LiDAR point clouds. Outdoor scenes typically consist of mobile foregrounds and static backgrounds, allowing motion understanding to be associated with scene parsing. Based on this observation, we propose a novel weakly supervised paradigm that replaces motion annotations with fully or partially annotated (1%, 0.1%) foreground/background masks for supervision. To this end, we develop a weakly supervised approach utilizing foreground/background cues to guide the self-supervised learning of motion prediction models. Since foreground motion generally occurs in non-ground regions, non-ground/ground masks can serve as an alternative to foreground/background masks, further reducing annotation effort. Leveraging non-ground/ground cues, we propose two additional approaches: a weakly supervised method requiring fewer (0.01%) foreground/background annotations, and a self-supervised method without annotations. Furthermore, we design a Robust Consistency-aware Chamfer Distance loss that incorporates multi-frame information and robust penalty functions to suppress outliers in self-supervised learning. Experiments show that our weakly and self-supervised models outperform existing self-supervised counterparts, and our weakly supervised models even rival some supervised ones. This demonstrates that our approaches effectively balance annotation effort and performance.

cs.CV↗

Confusion is the Final Barrier: Rethinking Jailbreak Evaluation and Investigating the Real Misuse Threat of LLMs

With the development of Large Language Models (LLMs), numerous efforts have revealed their vulnerabilities to jailbreak attacks. Although these studies have driven the progress in LLMs' safety alignment, it remains unclear whether LLMs have internalized authentic knowledge to deal with real-world crimes, or are merely forced to simulate toxic language patterns. This ambiguity raises concerns that jailbreak success is often attributable to a hallucination loop between jailbroken LLM and judger LLM. By decoupling the use of jailbreak techniques, we construct knowledge-intensive Q\&A to investigate the misuse threats of LLMs in terms of dangerous knowledge possession, harmful task planning utility, and harmfulness judgment robustness. Experiments reveal a mismatch between jailbreak success rates and harmful knowledge possession in LLMs, and existing LLM-as-a-judge frameworks tend to anchor harmfulness judgments on toxic language patterns. Our study reveals a gap between existing LLM safety assessments and real-world threat potential.

cs.CR↗

Intermittent chaos in an optomechanical resonator

Chaos is a fundamental phenomenon in nonlinear dynamics, manifesting as irregular and unpredictable behavior across various physical systems. Among the diverse routes to chaos, intermittent chaos is a distinct transition pathway, characterized by the temporal or spatial alternation between periodic and chaotic motions. Here, we experimentally demonstrate, for the first time, optomechanically induced intermittent chaos in an optical whispering-gallery-mode microresonator. Specifically, the system evolves from stable periodic oscillation through an intermittent-chaos regime before fully developing into chaotic motion. As system parameters vary, the proportion of chaotic motion in the time-domain increases asymptotically until chaotic dynamics dominates entirely. Moreover, it is counterintuitive that, intermittent chaos can act as noise of a favorable intensity compared with purely periodic or fully chaotic states, and enhance rather than reduce system's responses in nonlinear ultrasonic detection. These findings not only deepen the comprehensive understanding of chaos formation but also broaden its potential applications in high-precision sensing and information processing.

quant-ph↗

The Fast Stochastic Matching Pursuit for Neutrino and Dark Matter Experiments

Photomultiplier tubes (PMTs) are widely deployed at neutrino and dark matter experiments for photon counting. When multiple photons hit a PMT consecutively, their photo-electron (PE) pulses pile up to hinder the precise measurements of the count and timings. We introduce Fast Stochastic Matching Pursuit (FSMP) to analyze the PMT signal waveforms into individual PEs with the strategy of reversible-jump Markov-chain Monte Carlo. We demonstrate that FSMP improves the energy and time resolution of PMT-based experiments and gains acceleration on GPUs. It is suitable for dynode PMTs, and is extensible to microchannel-plate (MCP) PMTs. In the condition of our laboratory characterization of 8-inch MCP-PMTs, FSMP improves the energy resolution by up to 10% from the conventional method of waveform integration.

hep-ex↗

Phase field simulation of dendrite growth in solid-state lithium batteries based on mechanical-thermo-electrochemical coupling

Solid-state lithium batteries possess numerous advantages, such as high energy density, excellent cycle stability, superior mechanical strength, non-flammability, enhanced safety, and extended service life. These characteristics make them highly suitable for applications in aerospace, new energy vehicles, and portable electronic devices. However, the growth of lithium dendrite at the electrode/electrolyte interface remains a critical challenge, limiting both performance and safety. The growth of lithium dendrites in the electrolyte not only reduces the Coulombic efficiency of the battery but also poses a risk of puncturing the electrolyte, leading to internal short circuits between the anode and cathode. This study is to solve the problem of lithium dendrite growth in solid-state lithium batteries by employing phase-field theory for numerical simulations. A phase-field model is developed by coupling the mechanical stress field, thermal field, and electrochemical field, to investigate the morphology and evolution of lithium dendrites under the condition of different ambient temperatures, external pressures, and their combined effects. The results indicate that higher temperature and greater external pressure significantly suppress lithium dendrite growth, leading to fewer side branches, smoother surfaces, and more uniform electrochemical deposition. Increased external pressure inhibits longitudinal dendrite growth, resulting in a compressed morphology with higher compactness, but at the cost of increased mechanical instability. The combined effect of temperature and pressure exhibits a pronounced inhibitory influence on dendrite growth, with stress concentrating at the dendrite roots. This stress distribution promotes lateral growth, facilitating the formation of flatter and denser lithium deposits.

cond-mat.mtrl-sci↗

MCLPD:Multi-view Contrastive Learning for EEG-based PD Detection Across Datasets

Electroencephalography has been validated as an effective technique for detecting Parkinson's disease,particularly in its early stages.However,the high cost of EEG data annotation often results in limited dataset size and considerable discrepancies across datasets,including differences in acquisition protocols and subject demographics,significantly hinder the robustness and generalizability of models in cross-dataset detection scenarios.To address such challenges,this paper proposes a semi-supervised learning framework named MCLPD,which integrates multi-view contrastive pre-training with lightweight supervised fine-tuning to enhance cross-dataset PD detection performance.During pre-training,MCLPD uses self-supervised learning on the unlabeled UNM dataset.To build contrastive pairs,it applies dual augmentations in both time and frequency domains,which enrich the data and naturally fuse time-frequency information.In the fine-tuning phase,only a small proportion of labeled data from another two datasets (UI and UC)is used for supervised optimization.Experimental results show that MCLPD achieves F1 scores of 0.91 on UI and 0.81 on UC using only 1%of labeled data,which further improve to 0.97 and 0.87,respectively,when 5%of labeled data is used.Compared to existing methods,MCLPD substantially improves cross-dataset generalization while reducing the dependency on labeled data,demonstrating the effectiveness of the proposed framework.

cs.LG↗

Understanding Flow Behaviors of Supercooled Liquids by Embodying Solid-Liquid Duality at Particle Level

Understanding the flow behaviors of supercooled liquids presents a major challenge in liquid-state physics due to the strong nonlinearity and rich phenomena. To unravel this complexity, we introduce the concept of local configurational relaxation time $τ_\rm{LC}$, which allows us to embody the solid-liquid duality, proposed by Maxwell for phenomenologically describing materials' response to external load, at the particle level. The spatial distribution of $τ_\rm{LC}$ in flow is heterogeneous. Depending on the comparison between the local mobility measured by $τ_\rm{LC}$ and the external shear rate, the shear response of local regions is either solid-like or liquid-like. In this way, $τ_\rm{LC}$ plays a role similar to the Maxwell time. By applying this microscopic solid-liquid duality to different conditions of shear flow with a wide range of shear rates, we describe the emergence of shear thinning in steady shear, and predict the major characteristics of the transient response to start-up shear. Furthermore, we reveal a clear structural foundation for $τ_\rm{LC}$ and the solid-liquid duality associated with it by introducing an order parameter extracted from local configuration. Thus, we establish a framework that connects microscopic structure, dynamics, local mechanical response, and flow behaviors for supercooled liquids. Finally, we rationalize our framework in terms of activations from energy basins that are facilitated by shear. This model illustrates how local structure, convection and thermal activation collectively determine $τ_\rm{LC}$. Notably, it predicts two distinct response groups, which well correspond to the microscopic solid-liquid duality.

cond-mat.soft↗

Monolithic low-noise erbium-doped thin-film lithium niobate waveguide amplifier with 18 dB fiber to fiber net gain

Erbium-doped waveguide amplifiers have captured great attentions in recent years due to the rapid advance of photonic integration materials and fabrication techniques. In this work, a compact erbium-doped thin-film lithium niobate waveguide amplifier integrated with high-efficiency edge-couplers on the small footprint of 2 mm{\cross}25 mm, achieving >18 dB fiber-to-fiber (off-chip) net gain with bidirectional pumping by ~1480 nm laser diodes, is fabricated by the photolithography assisted chemo-mechanical etching technique. The fiber-to-fiber noise figures of the amplifier are also characterized to be around 5 dB, and the maximum amplified signal powers at the output fiber are above 13 dBm. Theoretical amplifier modeling resolving the erbium absorption and emission spectra predicts the efficient gain scaling with waveguide length for most of the telecom C-band wavelengths. The demonstrated high-external-gain erbium-doped waveguide amplifier will benefit various applications from optical communication and metrology to integrated photonic computing and artificial intelligence

physics.optics↗

P/D-Device: Disaggregated Large Language Model between Cloud and Devices

Serving disaggregated large language models has been widely adopted in industrial practice for enhanced performance. However, too many tokens generated in decoding phase, i.e., occupying the resources for a long time, essentially hamper the cloud from achieving a higher throughput. Meanwhile, due to limited on-device resources, the time to first token (TTFT), i.e., the latency of prefill phase, increases dramatically with the growth on prompt length. In order to concur with such a bottleneck on resources, i.e., long occupation in cloud and limited on-device computing capacity, we propose to separate large language model between cloud and devices. That is, the cloud helps a portion of the content for each device, only in its prefill phase. Specifically, after receiving the first token from the cloud, decoupling with its own prefill, the device responds to the user immediately for a lower TTFT. Then, the following tokens from cloud are presented via a speed controller for smoothed TPOT (the time per output token), until the device catches up with the progress. On-device prefill is then amortized using received tokens while the resource usage in cloud is controlled. Moreover, during cloud prefill, the prompt can be refined, using those intermediate data already generated, to further speed up on-device inference. We implement such a scheme P/D-Device, and confirm its superiority over other alternatives. We further propose an algorithm to decide the best settings. Real-trace experiments show that TTFT decreases at least 60%, maximum TPOT is about tens of milliseconds, and cloud throughput increases by up to 15x.

cs.DC↗

GEPD:GAN-Enhanced Generalizable Model for EEG-Based Detection of Parkinson's Disease

Electroencephalography has been established as an effective method for detecting Parkinson's disease, typically diagnosed early.Current Parkinson's disease detection methods have shown significant success within individual datasets, however, the variability in detection methods across different EEG datasets and the small size of each dataset pose challenges for training a generalizable model for cross-dataset scenarios. To address these issues, this paper proposes a GAN-enhanced generalizable model, named GEPD, specifically for EEG-based cross-dataset classification of Parkinson's disease.First, we design a generative network that creates fusion EEG data by controlling the distribution similarity between generated data and real data.In addition, an EEG signal quality assessment model is designed to ensure the quality of generated data great.Second, we design a classification network that utilizes a combination of multiple convolutional neural networks to effectively capture the time-frequency characteristics of EEG signals, while maintaining a generalizable structure and ensuring easy convergence.This work is dedicated to utilizing intelligent methods to study pathological manifestations, aiming to facilitate the diagnosis and monitoring of neurological diseases.The evaluation results demonstrate that our model performs comparably to state-of-the-art models in cross-dataset settings, achieving an accuracy of 84.3% and an F1-score of 84.0%, showcasing the generalizability of the proposed model.

cs.LG↗

The problem of infinite Spin for parabolic and collision solutions in the planar $n$-body problem

In the planar $n$-body problem, the problem of infinite spin occurs for both parabolic and collision solutions. Recently Moeckel and Montgomery \cite{MM25} showed that there is no infinite spin for total collision solutions, when the reduced and normalized configuration converges to an isolated central configuration. Following their approach, we show it can not happen for both complete and partially parabolic solutions, under similar conditions. Our approach also allows us to generalize Moeckel and Montgomery's result to partial collision solutions under similar conditions.

math.DS↗

MamV2XCalib: V2X-based Target-less Infrastructure Camera Calibration with State Space Model

As cooperative systems that leverage roadside cameras to assist autonomous vehicle perception become increasingly widespread, large-scale precise calibration of infrastructure cameras has become a critical issue. Traditional manual calibration methods are often time-consuming, labor-intensive, and may require road closures. This paper proposes MamV2XCalib, the first V2X-based infrastructure camera calibration method with the assistance of vehicle-side LiDAR. MamV2XCalib only requires autonomous vehicles equipped with LiDAR to drive near the cameras to be calibrated in the infrastructure, without the need for specific reference objects or manual intervention. We also introduce a new targetless LiDAR-camera calibration method, which combines multi-scale features and a 4D correlation volume to estimate the correlation between vehicle-side point clouds and roadside images. We model the temporal information and estimate the rotation angles with Mamba, effectively addressing calibration failures in V2X scenarios caused by defects in the vehicle-side data (such as occlusions) and large differences in viewpoint. We evaluate MamV2XCalib on the V2X-Seq and TUMTraf-V2X real-world datasets, demonstrating the effectiveness and robustness of our V2X-based automatic calibration approach. Compared to previous LiDAR-camera methods designed for calibration on one car, our approach achieves better and more stable calibration performance in V2X scenarios with fewer parameters. The code is available at https://github.com/zhuyaoye/MamV2XCalib.

cs.CV↗

Exploring Nonlinear System with Machine Learning: Chua and Lorenz Circuits Analyzed

Nonlinear circuits serve as crucial carriers and physical models for investigating nonlinear dynamics and chaotic behavior, particularly in the simulation of biological neurons. In this study, Chua's circuit and Lorenz circuit are systematically explored for the first time through machine learning correlation algorithms. Specifically, the upgraded and optimized SINDy-PI model, which is based on neural network and symbolic regression algorithm, is utilized to learn the numerical results of attractors generated by these two nonlinear circuits. Through error analysis, we examine the effects of the precision of input data and the amount of data on the algorithmic model. The findings reveal that when the input data quantity and data precision fall within a certain range, the algorithm model can effectively recognize and restore the differential equation expressions corresponding to the two circuits. Additionally, we test the anti-interference ability of different circuits and the robustness of the algorithm by introducing noise into the test data. The results indicate that under the same noise disturbance, the Lorenz circuit has better noise resistance than Chua's circuit, providing a starting point for further studying the intrinsic properties and characteristics of different nonlinear circuits. The above results will not only offer a reference for the further study of nonlinear circuits and related systems using deep learning algorithms but also lay a preliminary theoretical foundation for the study of related physical problems and applications.

physics.comp-ph↗

Dens3R: A Foundation Model for 3D Geometry Prediction

Recent advances in dense 3D reconstruction have led to significant progress, yet achieving accurate unified geometric prediction remains a major challenge. Most existing methods are limited to predicting a single geometry quantity from input images. However, geometric quantities such as depth, surface normals, and point maps are inherently correlated, and estimating them in isolation often fails to ensure consistency, thereby limiting both accuracy and practical applicability. This motivates us to explore a unified framework that explicitly models the structural coupling among different geometric properties to enable joint regression. In this paper, we present Dens3R, a 3D foundation model designed for joint geometric dense prediction and adaptable to a wide range of downstream tasks. Dens3R adopts a two-stage training framework to progressively build a pointmap representation that is both generalizable and intrinsically invariant. Specifically, we design a lightweight shared encoder-decoder backbone and introduce position-interpolated rotary positional encoding to maintain expressive power while enhancing robustness to high-resolution inputs. By integrating image-pair matching features with intrinsic invariance modeling, Dens3R accurately regresses multiple geometric quantities such as surface normals and depth, achieving consistent geometry perception from single-view to multi-view inputs. Additionally, we propose a post-processing pipeline that supports geometrically consistent multi-view inference. Extensive experiments demonstrate the superior performance of Dens3R across various dense 3D prediction tasks and highlight its potential for broader applications.

cs.CV↗

FreeCus: Free Lunch Subject-driven Customization in Diffusion Transformers

In light of recent breakthroughs in text-to-image (T2I) generation, particularly with diffusion transformers (DiT), subject-driven technologies are increasingly being employed for high-fidelity customized production that preserves subject identity from reference inputs, enabling thrilling design workflows and engaging entertainment. Existing alternatives typically require either per-subject optimization via trainable text embeddings or training specialized encoders for subject feature extraction on large-scale datasets. Such dependencies on training procedures fundamentally constrain their practical applications. More importantly, current methodologies fail to fully leverage the inherent zero-shot potential of modern diffusion transformers (e.g., the Flux series) for authentic subject-driven synthesis. To bridge this gap, we propose FreeCus, a genuinely training-free framework that activates DiT's capabilities through three key innovations: 1) We introduce a pivotal attention sharing mechanism that captures the subject's layout integrity while preserving crucial editing flexibility. 2) Through a straightforward analysis of DiT's dynamic shifting, we propose an upgraded variant that significantly improves fine-grained feature extraction. 3) We further integrate advanced Multimodal Large Language Models (MLLMs) to enrich cross-modal semantic representations. Extensive experiments reflect that our method successfully unlocks DiT's zero-shot ability for consistent subject synthesis across diverse contexts, achieving state-of-the-art or comparable results compared to approaches that require additional training. Notably, our framework demonstrates seamless compatibility with existing inpainting pipelines and control modules, facilitating more compelling experiences. Our code is available at: https://github.com/Monalissaa/FreeCus.

cs.CV↗

Development and characterization of the JNE concentrator

The Jinping Neutrino Experiment (JNE) will utilize approximately 3000 8-inch MCP-PMTs identified as GDB-6082 from North Night Vision Technology to detect neutrinos. To enhance the effective coverage of the JNE detector, mounting a custom-designed light concentrator on each PMT is a practical and economical approach. We measured angular responses of the concentration factor at four wavelengths in air medium for the concentrator with the selected cutoff angle of 70°. The measurements align with the Monte Carlo simulations. Furthermore, our results indicate that these concentrators can improve the efficiency of light collection by 40 % under parallel illumination conditions. This enhancement results in a slight increase in transit-time spread, with the full width at half maximum (FWHM) increasing by less than 0.3 ns. We conclude that the developed light concentrators are highly suitable for the JNE.

hep-ex↗