arXiv subjects

Lei Wu

Publications and source records attributed to Lei Wu.

At least 127 records · Page 7Linked to original sources

arXiv2025

Multi-Transmission Node DER Aggregation: Chance-Constrained Unit Commitment with Bounded Hetero-Dimensional Mixture Model for Uncertain Distribution Factors

To facilitate the integration of distributed energy resources (DERs) into the wholesale market while maintaining the tractability of associated market operation tools such as unit commitment (UC), existing DER aggregation (DERA) studies usually consider that each DERA is presented on a single node of the transmission network. Nevertheless, the increasing scale and geographical distribution of DERs spur the emergence of DERAs covering multiple transmission nodes, posing new challenges in modeling such multi-transmission-node DERAs (M-DERAs). Indeed, assessing the aggregated impact of an M-DERA on power flows is a non-trivial task, because the sensitivities of each transmission line to DERs at different transmission nodes are not identical. Inspired by the distribution factor (DF) based shift factor (SF) aggregation strategy in industry practice, this paper proposes a novel DF-based chance-constrained UC (CCUC) model to determine system optimal operation plans with M-DERAs. DFs, treated as uncertain parameters to describe possible responses of DERs against aggregated dispatch instructions from regional transmission organizations, are modeled via a bounded hetero-dimensional mixture model (BHMM) by leveraging historical DF records distributed on multiple hyperplanes in a bounded space. With this, power flow limits are modeled as chance constraints in CCUC, which is reformulated into a scenarios-based stochastic form and solved by Benders decomposition. The proposed method is tested on an IEEE 24-bus system to illustrate its effectiveness in managing M-DERA integration while ensuring operational economics and mitigating the overloading of transmission lines.

eess.SY↗

arXiv2025

Adaptive GSIS for rarefied gas flow simulations

The parallel solver of the general synthetic iterative scheme (GSIS), as recently developed by Zhang \textit{et. al.} in Comput. Fluids 281 (2024) 106374, is an efficient method to find the solution of the Boltzmann equation deterministically. However, it consumes a significant computational memory due to the discretization of molecular velocity space in hypersonic flows. In this paper, we address this issue by introducing the adaptive GSIS, where the Boltzmann equation is applied only in rarefied regions when the local Knudsen number exceeds a reference value, $\text{Kn}{ref}$. In contrast, the Navier-Stokes equations, with and without the high-order corrections to the constitutive relations, are applied in the continuum and rarefied regimes, respectively. Numerical results indicate that setting $\text{Kn}{ref}=0.01$ yields acceptable outcomes. With the adaptive GSIS, the computational memory and time can be significantly reduced in near-continuum flows, e.g. 24 and 7 times, respectively. in the simulation of rarefied gas flow passing the International Space Station.

physics.comp-ph↗

arXiv2025

Adjoint shape optimization from the continuum to free-molecular gas flows

An adjoint-based shape optimization method for solid bodies subjected to both rarefied and continuum gas flows is proposed. The gas-kinetic BGK equation with the diffuse-reflection boundary condition is used to describe the multiscale gas flows. In the vicinity of the gas-solid interface, a body-fitted mesh is utilized, and the sensitivity with respect to the boundary geometry is analyzed through a combined continuous and discrete adjoint methods. The primal and adjoint governing equations are resolved using efficient multiscale numerical schemes, ensuring the precision of the sensitivity analysis in all flow regimes. The sensitivity data is subsequently integrated into a quasi-Newton optimization algorithm to facilitate rapid convergence towards the optimal solution. Numerical experiments reveal that the discretization of the molecular velocity space can induce sensitivity oscillations; however, these can be effectively eliminated by employing appropriate parameterization of the boundary geometry. In optimizing 2D airfoils for drag reduction under varying degrees of gas rarefaction, our method achieves the optimal solution in just a dozen optimization iterations and within a time frame of 5 to 20 minutes (utilizing parallel computation with 40 to 160 cores), thereby underscoring its exceptional performance and efficiency.

physics.comp-ph↗

arXiv2024

Achieving Margin Maximization Exponentially Fast via Progressive Norm Rescaling

In this work, we investigate the margin-maximization bias exhibited by gradient-based algorithms in classifying linearly separable data. We present an in-depth analysis of the specific properties of the velocity field associated with (normalized) gradients, focusing on their role in margin maximization. Inspired by this analysis, we propose a novel algorithm called Progressive Rescaling Gradient Descent (PRGD) and show that PRGD can maximize the margin at an {\em exponential rate}. This stands in stark contrast to all existing algorithms, which maximize the margin at a slow {\em polynomial rate}. Specifically, we identify mild conditions on data distribution under which existing algorithms such as gradient descent (GD) and normalized gradient descent (NGD) {\em provably fail} in maximizing the margin efficiently. To validate our theoretical findings, we present both synthetic and real-world experiments. Notably, PRGD also shows promise in enhancing the generalization performance when applied to linearly non-separable datasets and deep neural networks.

cs.LG↗

arXiv2024

Halo-dependent Anharmonic Effects in Collective Excitation for Light Dark Matter Direct Detection

Phonon, the collective excitation of lattice vibration in the crystal, has been put forward as a means to search for light dark matter. However, the accurate modeling of the multi-phonon production process is challenging in theory. The anharmonicity of the crystal must be taken into account, as it has a significant impact on dark matter-nucleus scattering cross section in the low dark matter mass region. Notably, such an effect is sensitive to the velocity distribution of the dark matter halo. In this work, we consider the potential dark matter substructures indicated by the recent Gaia satellite observation and investigate their impact on the anharmonicity of the silicon crystal. By employing the likelihood analysis with the Asimov dataset, we present the expected sensitivity of dark matter-nucleus interactions, which can differ from the standard halo model by a factor of 2-3.

hep-ph↗

arXiv2024

The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI

The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space.The BraTS-METS 2023 challenge successfully curated well-annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied clinical environments and providing personalized volumetric reports to patients undergoing BM treatment.

q-bio.OT↗

arXiv2024

Dissecting Payload-based Transaction Phishing on Ethereum

In recent years, a more advanced form of phishing has arisen on Ethereum, surpassing early-stage, simple transaction phishing. This new form, which we refer to as payload-based transaction phishing (PTXPHISH), manipulates smart contract interactions through the execution of malicious payloads to deceive users. PTXPHISH has rapidly emerged as a significant threat, leading to incidents that caused losses exceeding \$70 million in 2023 reports. Despite its substantial impact, no previous studies have systematically explored PTXPHISH In this paper, we present the first comprehensive study of the PTXPHISH on Ethereum. Firstly, we conduct a long-term data collection and put considerable effort into establishing the first ground-truth PTXPHISH dataset, consisting of 5,000 phishing transactions. Based on the dataset, we dissect PTXPHISH, categorizing phishing tactics into four primary categories and eleven sub-categories. Secondly, we propose a rule-based multi-dimensional detection approach to identify PTXPHISH, achieving over 99% accuracy in the ground-truth dataset. Finally, we conducted a large-scale detection spanning 300 days and discovered a total of 130,637 phishing transactions on Ethereum, resulting in losses exceeding $341.9 million. Our in-depth analysis of these phishing transactions yielded valuable and insightful findings. Furthermore, our work has made significant contributions to mitigating real-world threats. We have reported 1,726 phishing addresses to the community, accounting for 42.7% of total community contributions during the same period. Additionally, we have sent 2,539 on-chain alert messages, assisting 1,980 victims. This research serves as a valuable reference in combating the emerging PTXPHISH and safeguarding users' assets.

cs.CR↗

arXiv2024

DeUEDroid: Detecting Underground Economy Apps Based on UTG Similarity

In recent years, the underground economy is proliferating in the mobile system. These underground economy apps (UEware) make profits from providing non-compliant services, especially in sensitive areas such as gambling, pornography, and loans. Unlike traditional malware, most of them (over 80%) do not have malicious payloads. Due to their unique characteristics, existing detection approaches cannot effectively and efficiently mitigate this emerging threat. To address this problem, we propose a novel approach to effectively and efficiently detect UEware by considering their UI transition graphs (UTGs). Based on the proposed approach, we design and implement a system named DeUEDroid to perform the detection. To evaluate DeUEDroid, we collect 25,717 apps and build the first large-scale ground-truth dataset (1,700 apps) of UEware. The evaluation result based on the ground-truth dataset shows that DeUEDroid can cover new UI features and statically construct precise UTG. It achieves 98.22% detection F1-score and 98.97% classification accuracy, significantly outperforming traditional approaches. The evaluation involving 24,017 apps demonstrates the effectiveness and efficiency of UEware detection in real-world scenarios. Furthermore, the result reveals that UEware are prevalent, with 54% of apps in the wild and 11% of apps in app stores being UEware. Our work sheds light on future work in analyzing and detecting UEware.

cs.CR↗

arXiv2024

BlueLM-V-3B: Algorithm and System Co-Design for Multimodal Large Language Models on Mobile Devices

The emergence and growing popularity of multimodal large language models (MLLMs) have significant potential to enhance various aspects of daily life, from improving communication to facilitating learning and problem-solving. Mobile phones, as essential daily companions, represent the most effective and accessible deployment platform for MLLMs, enabling seamless integration into everyday tasks. However, deploying MLLMs on mobile phones presents challenges due to limitations in memory size and computational capability, making it difficult to achieve smooth and real-time processing without extensive optimization. In this paper, we present BlueLM-V-3B, an algorithm and system co-design approach specifically tailored for the efficient deployment of MLLMs on mobile platforms. To be specific, we redesign the dynamic resolution scheme adopted by mainstream MLLMs and implement system optimization for hardware-aware deployment to optimize model inference on mobile phones. BlueLM-V-3B boasts the following key highlights: (1) Small Size: BlueLM-V-3B features a language model with 2.7B parameters and a vision encoder with 400M parameters. (2) Fast Speed: BlueLM-V-3B achieves a generation speed of 24.4 token/s on the MediaTek Dimensity 9300 processor with 4-bit LLM weight quantization. (3) Strong Performance: BlueLM-V-3B has attained the highest average score of 66.1 on the OpenCompass benchmark among models with $\leq$ 4B parameters and surpassed a series of models with much larger parameter sizes (e.g., MiniCPM-V-2.6, InternVL2-8B).

cs.CV↗

arXiv2024

Multiscale simulation of neutral particle flows in the plasma edge

The plasma edge flow, situated at the intricate boundary between plasma and neutral particles, plays a pivotal role in the design of nuclear fusion devices such as divertors and pumps. Traditional numerical simulation methods, such as the direct simulation Monte Carlo approach and the discrete velocity method, are hindered by extensive computation times when dealing with near-continuum flow conditions. This paper presents a general synthetic iterative scheme to deterministically simulate the plasma edge flows. By alternately solving the kinetic equations and macroscopic synthetic equations, our method substantially decreases the number of iterations, while maintains asymptotic-preserving properties even when the spatial cell size is much larger than the mean free path. Consequently, our approach achieves rapid convergence and high accuracy in plasma edge flow simulations, particularly in near-continuum flow regimes. This advancement provides a robust and efficient computational tool, essential for the advancement of next-generation nuclear fusion reactors.

physics.comp-ph↗

arXiv2024

Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent

Symmetries are prevalent in deep learning and can significantly influence the learning dynamics of neural networks. In this paper, we examine how exponential symmetries -- a broad subclass of continuous symmetries present in the model architecture or loss function -- interplay with stochastic gradient descent (SGD). We first prove that gradient noise creates a systematic motion (a ``Noether flow") of the parameters $θ$ along the degenerate direction to a unique initialization-independent fixed point $θ^*$. These points are referred to as the {\it noise equilibria} because, at these points, noise contributions from different directions are balanced and aligned. Then, we show that the balance and alignment of gradient noise can serve as a novel alternative mechanism for explaining important phenomena such as progressive sharpening/flattening and representation formation within neural networks and have practical implications for understanding techniques like representation normalization and warmup.

cs.LG↗

arXiv2024

Improving Generalization and Convergence by Enhancing Implicit Regularization

In this work, we propose an Implicit Regularization Enhancement (IRE) framework to accelerate the discovery of flat solutions in deep learning, thereby improving generalization and convergence. Specifically, IRE decouples the dynamics of flat and sharp directions, which boosts the sharpness reduction along flat directions while maintaining the training stability in sharp directions. We show that IRE can be practically incorporated with {\em generic base optimizers} without introducing significant computational overload. Experiments show that IRE consistently improves the generalization performance for image classification tasks across a variety of benchmark datasets (CIFAR-10/100, ImageNet) and models (ResNets and ViTs). Surprisingly, IRE also achieves a $2\times$ {\em speed-up} compared to AdamW in the pre-training of Llama models (of sizes ranging from 60M to 229M) on datasets including Wikitext-103, Minipile, and Openwebtext. Moreover, we provide theoretical guarantees, showing that IRE can substantially accelerate the convergence towards flat minima in Sharpness-aware Minimization (SAM).

cs.LG↗

arXiv2024

Prove Your Point!: Bringing Proof-Enhancement Principles to Argumentative Essay Generation

Argumentative essay generation (AEG) aims to generate complete texts on specific controversial topics or debates. Although current AEG methods can generate individual opinions, they often overlook the high-level connections between these opinions. This often leads to the generated results being mired in logical confusion, unable to proof their own arguments effectively. The generated essay may present evidence that contradicts the claims or they may fail to assemble the claims into logical flow. In this paper, we present a unified two-stage framework: Proof-Enhancement and Self-Annotation (PESA) for AEG with a focus on logical enhancement. Specifically, we first construct pseudo-labels for logical information,claims and grounds, using a large language model. We then propose a tree planning approach that introduces proof principles and ensures logical consistency. Extensive experimental results show that, benefiting from proof principle guidance, PESA generates argumentative essays with better logical validity and persuasiveness than strong baseline models.

cs.CL↗

arXiv2024

The Local Landscape of Phase Retrieval Under Limited Samples

In this paper, we present a fine-grained analysis of the local landscape of phase retrieval under the regime of limited samples. Specifically, we aim to ascertain the minimal sample size required to guarantee a benign local landscape surrounding global minima in high dimensions. Let $n$ and $d$ denote the sample size and input dimension, respectively. We first explore the local convexity and establish that when $n=o(d\log d)$, for almost every fixed point in the local ball, the Hessian matrix has negative eigenvalues, provided $d$ is sufficiently large. % Consequently, the local landscape is highly non-convex. We next consider the one-point convexity and show that, as long as $n=ω(d)$, with high probability, the landscape is one-point strongly convex in the local annulus: $\{w\in\mathbb{R}^d: o_d(1)\leqslant \|w-w^*\|\leqslant c\}$, where $w^*$ is the ground truth and $c$ is an absolute constant. This implies that gradient descent, initialized from any point in this domain, can converge to an $o_d(1)$-loss solution exponentially fast. Furthermore, we show that when $n=o(d\log d)$, there is a radius of $\widetildeΘ\left(\sqrt{1/d}\right)$ such that one-point convexity breaks down in the corresponding smaller local ball. This indicates an impossibility of establishing a convergence to the exact $w^*$ for gradient descent under limited samples by relying solely on one-point convexity.

cs.IT↗

arXiv2024

DTactive: A Vision-Based Tactile Sensor with Active Surface

The development of vision-based tactile sensors has significantly enhanced robots' perception and manipulation capabilities, especially for tasks requiring contact-rich interactions with objects. In this work, we present DTactive, a novel vision-based tactile sensor with active surfaces. DTactive inherits and modifies the tactile 3D shape reconstruction method of DTact while integrating a mechanical transmission mechanism that facilitates the mobility of its surface. Thanks to this design, the sensor is capable of simultaneously performing tactile perception and in-hand manipulation with surface movement. Leveraging the high-resolution tactile images from the sensor and the magnetic encoder data from the transmission mechanism, we propose a learning-based method to enable precise angular trajectory control during in-hand manipulation. In our experiments, we successfully achieved accurate rolling manipulation within the range of [ -180°,180° ] on various objects, with the root mean square error between the desired and actual angular trajectories being less than 12° on nine trained objects and less than 19° on three novel objects. The results demonstrate the potential of DTactive for in-hand object manipulation in terms of effectiveness, robustness and precision.

cs.RO↗

arXiv2024

Transient hydrodynamic phonon transport in two-dimensional disk geometry

Transient cooling phenomenon in two-dimensional materials is studied based on the phonon Boltzmann transport equation (BTE). Using a heating laser pulse to heat the two-dimensional disk geometry under the environment temperature, after the heating laser is removed, our results show that the transient temperature could be lower than the environment temperature and this transient cooling phenomenon could only appear in the phonon hydrodynamic regime with sufficient normal-process and insufficient resistive-process. In addition, the possibility of this phenomenon observed by experiments is theoretically discussed by using the experimental parameters as the input of the phonon BTE. Results show that this transient cooling phenomenon could obviously appear in a single-layer suspended graphene disk with diameter $7~μ$m in the temperature range of $50-150$ K. The present work could provide theoretical guidance for the future experimental proof of hydrodynamic phonon transport in two-dimensional materials.

cond-mat.mes-hall↗

arXiv2024

Deep Inelastic Scattering in the Capture of Dark Matter by Neutron Stars

Due to the dense environment, neutron stars (NSs) can serve as an ideal laboratory for studying the interactions between dark matter (DM) and ordinary matter. In the process of DM capture, deep inelastic scattering may dominate over elastic scattering, especially for the DM with a large momentum transfer. In this work, we calculate DM-nucleon deep inelastic scattering via a vector mediator and estimate its contribution to the capture rate. Using the surface temperature of the NSs, we derive the exclusion limits for the DM-nucleon scattering cross section in the mass range, $1~{\rm GeV}<m_χ< 10^{5}~{\rm GeV}$. We find the bounds for DM with the mass $\gtrsim$ 1 GeV can be changed several times after including the deep inelastic scattering contribution.

hep-ph↗

arXiv2024

Footprints of Axion-Like Particle in Pulsar Timing Array Data and James Webb Space Telescope Observations

Several Pulsar Timing Array (PTA) collaborations have recently reported the evidence for a stochastic gravitational-wave background (SGWB), which can unveil the formation of primordial seeds of inhomogeneities in the early universe. With the SGWB parameters inferred from PTAs data, we can make a prediction of the seeds for early galaxy formation from the domain walls in the axion-like particles (ALPs) field distribution. This also naturally provides a solution to the observation of high redshifts by the James Webb Space Telescope. The predicted photon coupling of the ALP is within the reach of future experimental searches.

hep-ph↗