arXiv subjects

Qi Wang

Publications and source records attributed to Qi Wang.

At least 235 records · Page 13Linked to original sources

arXiv2025

Scaling behaviour of rotating convection in a spherical shell with different Prandtl numbers

Rayleigh-Benard convection in a rotating spherical shell provides a simplified model for convective dynamics of planetary and stellar interiors. In this study, we build more than 200 numerical models of rotating convection in a spherical shell over a wide range of $\Pran$ ($10^{-2}\le\Pran\le10^2$). As increasing the Rayleigh number $Ra$, we characterise four different flow regimes, starting from the linear onset to multiple modes, then transiting to the geostrophic turbulence and eventually approaching the weakly rotating regime. In the multiple modes regime, we show evidence of triadic resonances in numerical models with different $\Pran$, which may provide a generic mechanism for the transition from laminar to turbulence in rotating convection. We analyse scaling behaviours of the heat transfer and convective flow speeds in numerical simulations, paying particular attention to the $\Pran$-dependence. We find that the so-called diffusion-free scaling for the heat transfer cannot reconcile all numerical models with different $\Pran$ in the geostrophic turbulence regime. However, the characteristic flow speeds at different $\Pran$ roughly follow a unified scaling that can be described by VAC force balances, though the scaling tends to approach the CIA force balance at low $\Pran$. Both scaling behaviours and transition behaviours suggest that the heat transfer is controlled by the boundary layers while the convective flow speeds are mainly determined by the force balance in the bulk for cases with $\Pran>1$, which is in line with recent experimental results with moderate to high $\Pran$. For cases with $\Pran \le 1$, both the heat transfer and convective velocities are approaching the inviscid dynamics in the bulk.

physics.flu-dyn↗

arXiv2025

Onsager Principle-Based Domain Embedding for Thermodynamically Consistent Cahn-Hilliard Model in Arbitrary Domain

The original Cahn-Hilliard model in an arbitrary domain with two prescribed boundary conditions is extended to a Cahn-Hilliard-type model in a larger, regular domain with homogeneous Neumann boundary conditions. The extension is based on the Onsager principle-based domain embedding (OPBDE) method, which has been developed as a systematic domain embedding framework to ensure thermodynamic consistency. By introducing a modified conservation law, the flux at the boundary of the original domain is incorporated into the conservation law as a source term. Our variational approach demonstrates that, even without a prior knowledge on the specific form of the rate of free energy pumped into the system, the Onsager principle remains an effective instrument in deriving the constitutive equation of the extended system. This approach clarifies the intrinsic structure of the extended model in the perspectives of free energy and its dissipation. Asymptotic analysis is carried out for the extended OPBDE Cahn-Hilliard model, demonstrating that the original Cahn-Hilliard model, including its boundary conditions, can be fully recovered. To validate our approach, a structure-preserving numerical scheme is developed to discretize the extended model. Numerical results show that the OPBDE Cahn-Hilliard model is accurate, effective, and robust, highlighting the capability of the OPBDE method in handling gradient flow problems in arbitrary domain geometries.

math.NA↗

arXiv2025

AR-GRPO: Training Autoregressive Image Generation Models via Reinforcement Learning

Inspired by the success of reinforcement learning (RL) in refining large language models (LLMs), we propose AR-GRPO, an approach to integrate online RL training into autoregressive (AR) image generation models. We adapt the Group Relative Policy Optimization (GRPO) algorithm to refine the vanilla autoregressive models' outputs by carefully designed reward functions that evaluate generated images across multiple quality dimensions, including perceptual quality, realism, and semantic fidelity. We conduct comprehensive experiments on both class-conditional (i.e., class-to-image) and text-conditional (i.e., text-to-image) image generation tasks, demonstrating that our RL-enhanced framework significantly improves both the image quality and human preference of generated images compared to the standard AR baselines. Our results show consistent improvements across various evaluation metrics, establishing the viability of RL-based optimization for AR image generation and opening new avenues for controllable and high-quality image synthesis. The source codes and models are available at: https://github.com/Kwai-Klear/AR-GRPO.

cs.CV↗

arXiv2025

TopKD: Top-scaled Knowledge Distillation

Recent advances in knowledge distillation (KD) predominantly emphasize feature-level knowledge transfer, frequently overlooking critical information embedded within the teacher's logit distributions. In this paper, we revisit logit-based distillation and reveal an underexplored yet critical element: Top-K knowledge. Motivated by this insight, we propose Top-scaled Knowledge Distillation (TopKD), a simple, efficient, and architecture-agnostic framework that significantly enhances logit-based distillation. TopKD consists of two main components: (1) a Top-K Scaling Module (TSM), which adaptively amplifies the most informative logits, and (2) a Top-K Decoupled Loss (TDL), which offers targeted and effective supervision. Notably, TopKD integrates seamlessly into existing KD methods without introducing extra modules or requiring architectural changes. Extensive experiments on CIFAR-100, ImageNet, STL-10, and Tiny-ImageNet demonstrate that TopKD consistently surpasses state-of-the-art distillation methods. Moreover, our method demonstrates substantial effectiveness when distilling Vision Transformers, underscoring its versatility across diverse network architectures. These findings highlight the significant potential of logits to advance knowledge distillation.

cs.CV↗

arXiv2025

Large Language Model Powered Automated Modeling and Optimization of Active Distribution Network Dispatch Problems

The increasing penetration of distributed energy resources into active distribution networks (ADNs) has made effective ADN dispatch imperative. However, the numerous newly-integrated ADN operators, such as distribution system aggregators, virtual power plant managers, and end prosumers, often lack specialized expertise in power system operation, modeling, optimization, and programming. This knowledge gap renders reliance on human experts both costly and time-intensive. To address this challenge and enable intelligent, flexible ADN dispatch, this paper proposes a large language model (LLM) powered automated modeling and optimization approach. First, the ADN dispatch problems are decomposed into sequential stages, and a multi-LLM coordination architecture is designed. This framework comprises an Information Extractor, a Problem Formulator, and a Code Programmer, tasked with information retrieval, optimization problem formulation, and code implementation, respectively. Afterwards, tailored refinement techniques are developed for each LLM agent, greatly improving the accuracy and reliability of generated content. The proposed approach features a user-centric interface that enables ADN operators to derive dispatch strategies via simple natural language queries, eliminating technical barriers and increasing efficiency. Comprehensive comparisons and end-to-end demonstrations on various test cases validate the effectiveness of the proposed architecture and methods.

cs.AI↗

arXiv2025

Self-Powered, Ultra-thin, Flexible, and Scalable Ultraviolet Detector Utilizing Diamond-MoS$_2$ Heterojunction

The escalating demand for ultraviolet (UV) sensing in space exploration, environmental monitoring, and agricultural productivity necessitates detectors that are both environmentally and mechanically resilient. Diamond, featuring its high bandgap and UV absorption, exceptional mechanical/chemical robustness, and excellent thermal stability, emerges as a highly promising material for next-generation UV detection in various scenarios. However, conventional diamond-based UV detectors are constrained by rigid bulk architectures and reliance on external power supplies, hindering their integration with curved and flexible platforms and complicating device scalability due to auxiliary power requirements. To tackle these challenges, herein, we firstly demonstrated a large-scale, self-powered, and flexible diamond UV detector by heterogeneously integrating a MoS$_2$ monolayer with an ultrathin, freestanding diamond membrane. The fabricated device operates at zero external bias, and simultaneously exhibits a high responsivity of 94 mA W$^{-1}$ at 220 nm, and detectivity of 5.88 x 109 Jones. Notably, mechanical bending enables strain-induced bandgap modulation of the diamond membrane, allowing dynamically tunable photoresponse-a capability absent in rigid diamond counterparts. To validate its practicality and scalability, a proof-of-concept UV imager with 3x3 pixels was demonstrated. This newly developed configuration will undoubtedly open up new routes toward scalable, integrable, flexible, and cost-effective UV sensing solutions for emerging technologies

physics.ins-det↗

arXiv2025

Charge density wave with suppressed long-range structural modulation in canted antiferromagnetic kagome FeGe

Kagome lattice can host abundant exotic quantum states such as superconductivity and charge density wave (CDW). Recently, successive orders of A-type antiferromagnetism (AFM), CDW and canted AFM have been manifested upon cooling in kagome FeGe. However, the mechanism of CDW and interaction with magnetism remains unclear. Here we investigate the evolution of CDW with temperature across the canted AFM by single-crystal x-ray diffraction, scanning tunneling microscope (STM) and resonant elastic x-ray scattering (REXS). Interestingly, CDW-induced superlattice reflections become weak after the canted AFM, although long-range CDW order is still detectable by STM and REXS. We uncover a novel long-range CDW order with suppressed structural modulation, likely due to the competition for the underlying crystal structure between CDW and canted AFM. Additionally, occupational modulations of Ge1 in the kagome plane and displacive modulations of all atoms were extracted. The results confirm Ge dimerization along the c axis and suggest a dynamic transformation between different CDW domains.

cond-mat.str-el↗

arXiv2025

Leanabell-Prover: Posttraining Scaling in Formal Reasoning

Recent advances in automated theorem proving (ATP) through LLMs have highlighted the potential of formal reasoning with Lean 4 codes. However, ATP has not yet be revolutionized by the recent posttraining scaling as demonstrated by Open AI O1/O3 and Deepseek R1. In this work, we investigate the entire posttraining of ATP, aiming to align it with breakthroughs in reasoning models in natural languages. To begin, we continual train current ATP models with a hybrid dataset, which consists of numerous statement-proof pairs, and additional data aimed at incorporating cognitive behaviors that emulate human reasoning and hypothesis refinement. Next, we explore reinforcement learning with the use of outcome reward returned by Lean 4 compiler. Through our designed continual training and reinforcement learning processes, we have successfully improved existing formal provers, including both DeepSeek-Prover-v1.5 and Goedel-Prover, achieving state-of-the-art performance in the field of whole-proof generation. For example, we achieve a 59.8% pass rate (pass@32) on MiniF2F. This is an on-going project and we will progressively update our findings, release our data and training details.

cs.AI↗

arXiv2025

Energy-Stable Swarm-Based Inertial Algorithms for Optimization

We formulate the swarming optimization problem as a weakly coupled, dissipative dynamical system governed by a controlled energy dissipation rate and initial velocities that adhere to the nonequilibrium Onsager principle. In this framework, agents' inertia, positions, and masses are dynamically coupled. To numerically solve the system, we develop a class of efficient, energy-stable algorithms that either preserve or enhance energy dissipation at the discrete level. At equilibrium, the system tends to converge toward one of the lowest local minima explored by the agents, thereby improving the likelihood of identifying the global minimum. Numerical experiments confirm the effectiveness of the proposed approach, demonstrating significant advantages over traditional swarm-based gradient descent methods, especially when operating with a limited number of agents.

math.NA↗

arXiv2025

Energy Dissipation Rate Guided Adaptive Sampling for Physics-Informed Neural Networks: Resolving Surface-Bulk Dynamics in Allen-Cahn Systems

We introduce the Energy Dissipation Rate guided Adaptive Sampling (EDRAS) strategy, a novel method that substantially enhances the performance of Physics-Informed Neural Networks (PINNs) in solving thermodynamically consistent partial differential equations (PDEs) over arbitrary domains. EDRAS leverages the local energy dissipation rate density as a guiding metric to identify and adaptively re-sample critical collocation points from both the interior and boundary of the computational domain. This dynamical sampling approach improves the accuracy of residual-based PINNs by aligning the training process with the underlying physical structure of the system. In this study, we demonstrate the effectiveness of EDRAS using the Allen-Cahn phase field model in irregular geometries, achieving up to a sixfold reduction in the relative mean square error compared to traditional residual-based adaptive refinement (RAR) methods. Moreover, we compare EDRAS with other residual-based adaptive sampling approaches and show that EDRAS is not only computationally more efficient but also more likely to identify high-impact collocation points. Through numerical solutions of the Allen-Cahn equation with both static (Neumann) and dynamic boundary conditions in 2D disk- and ellipse-shaped domains solved using PINN coupled with EDRAS, we gain significant insights into how dynamic boundary conditions influence bulk phase evolution and thermodynamic behavior. The proposed approach offers an effective, physically informed enhancement to PINN frameworks for solving thermodynamically consistent models, making PINN a robust and versatile computational tool for investigating complex thermodynamic processes in arbitrary geometries.

math.NA↗

arXiv2025

Review of Feed-forward 3D Reconstruction: From DUSt3R to VGGT

3D reconstruction, which aims to recover the dense three-dimensional structure of a scene, is a cornerstone technology for numerous applications, including augmented/virtual reality, autonomous driving, and robotics. While traditional pipelines like Structure from Motion (SfM) and Multi-View Stereo (MVS) achieve high precision through iterative optimization, they are limited by complex workflows, high computational cost, and poor robustness in challenging scenarios like texture-less regions. Recently, deep learning has catalyzed a paradigm shift in 3D reconstruction. A new family of models, exemplified by DUSt3R, has pioneered a feed-forward approach. These models employ a unified deep network to jointly infer camera poses and dense geometry directly from an Unconstrained set of images in a single forward pass. This survey provides a systematic review of this emerging domain. We begin by dissecting the technical framework of these feed-forward models, including their Transformer-based correspondence modeling, joint pose and geometry regression mechanisms, and strategies for scaling from two-view to multi-view scenarios. To highlight the disruptive nature of this new paradigm, we contrast it with both traditional pipelines and earlier learning-based methods like MVSNet. Furthermore, we provide an overview of relevant datasets and evaluation metrics. Finally, we discuss the technology's broad application prospects and identify key future challenges and opportunities, such as model accuracy and scalability, and handling dynamic scenes.

cs.CV↗

arXiv2025

Leanabell-Prover-V2: Verifier-integrated Reasoning for Formal Theorem Proving via Reinforcement Learning

We introduce our Leanabell-Prover-V2, a 7B large language models (LLMs) that can produce formal theorem proofs in Lean 4, with verifier-integrated Long Chain-of-Thoughts (CoT). Following our previous work Leanabell-Prover-V1, we continual to choose to posttrain existing strong prover models for further performance improvement. In our V2 version, we mainly upgrade the Reinforcement Learning (RL) with feedback provided by the Lean 4 verifier. Crucially, verifier feedback, such as indicating success or detailing specific errors, allows the LLM to become ``self-aware'' of the correctness of its own reasoning process and learn to reflexively correct errors. Leanabell-Prover-V2 directly optimizes LLM reasoning trajectories with multi-turn verifier interactions, together with feedback token masking for stable RL training and a simple reward strategy. Experiments show that Leanabell-Prover-V2 improves performance by 3.2% (pass@128) with Kimina-Prover-Preview-Distill-7B and 2.0% (pass@128) with DeepSeek-Prover-V2-7B on the MiniF2F test set. The source codes, curated data and models are available at: https://github.com/Leanabell-LM/Leanabell-Prover-V2.

cs.AI↗

arXiv2025

RLEP: Reinforcement Learning with Experience Replay for LLM Reasoning

Reinforcement learning (RL) for large language models is an energy-intensive endeavor: training can be unstable, and the policy may gradually drift away from its pretrained weights. We present \emph{RLEP}\, -- \,Reinforcement Learning with Experience rePlay\, -- \,a two-phase framework that first collects verified trajectories and then replays them during subsequent training. At every update step, the policy is optimized on mini-batches that blend newly generated rollouts with these replayed successes. By replaying high-quality examples, RLEP steers the model away from fruitless exploration, focuses learning on promising reasoning paths, and delivers both faster convergence and stronger final performance. On the Qwen2.5-Math-7B base model, RLEP reaches baseline peak accuracy with substantially fewer updates and ultimately surpasses it, improving accuracy on AIME-2024 from 38.2% to 39.9%, on AIME-2025 from 19.8% to 22.3%, and on AMC-2023 from 77.0% to 82.2%. Our code, datasets, and checkpoints are publicly available at https://github.com/Kwai-Klear/RLEP to facilitate reproducibility and further research.

cs.CL↗

arXiv2025

Intriguing kagome topological materials

Topological quantum materials with kagome lattice have become the emerging frontier in the context of condensedmatter physics. Kagome lattice harbors strongmagnetic frustration and topological electronic states generatedby the unique geometric configuration.Kagomelattice has the peculiar advantages in the aspectsofmagnetism, topology aswell as strong correlationwhenthe spin, charge,ororbit degreesof free is introduced, and providing a promising platform for investigating the entangled interactionsamongthem. In this paper, we will systematically introduce the research progress on the kagome topological materials and give a perspective in the framework of the potential future development directions in this field.

cond-mat.supr-con↗

arXiv2025

Frequency-Resolved Forward Capacitance in GaN-based LEDs

This study establishes a unified framework for interpreting dynamic capacitive responses in InGaN-based light-emitting diodes (LEDs) through forward-bias capacitance-voltage-frequency spectroscopy. A hybrid impedance model integrating series RL components and parallel C-G networks was developed to resolve distinct frequency-dependent capacitive regimes. The low-frequency regime (<1 kHz) is governed by interfacial capacitance with characteristic reciprocal frequency dependence, while the mid-frequency range(10 kHz-6.4 MHz) demonstrates carrier diffusion and recombination dynamics. At MHz frequencies, negative capacitance manifests due to delayed carrier emission mediated by deep-level traps. The model achieved sub-1% fitting errors (R^2 > 0.99)across a broad bandwidth(10 kHz-6.4 MHz) , conclusively attributing negative capacitance to intrinsic trap processes rather than extrinsic artifacts. Critical advances include quantum well cap thickness modulation reducing mid-frequency capacitance by 30% and the dominance of trap-mediated inductance over parasitic contributions by three orders of magnitude. This framework resolves persistent controversies in LED impedance interpretation. By bridging semiconductor physics with device engineering, this methodology provides essential tools for designing next-generation optoelectronic systems requiring ultralow-latency operation and precise charge-state control.

physics.app-ph↗

arXiv2025

SMoLoRA: Exploring and Defying Dual Catastrophic Forgetting in Continual Visual Instruction Tuning

Visual instruction tuning (VIT) enables multimodal large language models (MLLMs) to effectively handle a wide range of vision tasks by framing them as language-based instructions. Building on this, continual visual instruction tuning (CVIT) extends the capability of MLLMs to incrementally learn new tasks, accommodating evolving functionalities. While prior work has advanced CVIT through the development of new benchmarks and approaches to mitigate catastrophic forgetting, these efforts largely follow traditional continual learning paradigms, neglecting the unique challenges specific to CVIT. We identify a dual form of catastrophic forgetting in CVIT, where MLLMs not only forget previously learned visual understanding but also experience a decline in instruction following abilities as they acquire new tasks. To address this, we introduce the Separable Mixture of Low-Rank Adaptation (SMoLoRA) framework, which employs separable routing through two distinct modules-one for visual understanding and another for instruction following. This dual-routing design enables specialized adaptation in both domains, preventing forgetting while improving performance. Furthermore, we propose a new CVIT benchmark that goes beyond existing benchmarks by additionally evaluating a model's ability to generalize to unseen tasks and handle diverse instructions across various tasks. Extensive experiments demonstrate that SMoLoRA outperforms existing methods in mitigating dual forgetting, improving generalization to unseen tasks, and ensuring robustness in following diverse instructions. Code is available at https://github.com/Minato-Zackie/SMoLoRA.

cs.CV↗

arXiv2025

MirrorMe: Towards Realtime and High Fidelity Audio-Driven Halfbody Animation

Audio-driven portrait animation, which synthesizes realistic videos from reference images using audio signals, faces significant challenges in real-time generation of high-fidelity, temporally coherent animations. While recent diffusion-based methods improve generation quality by integrating audio into denoising processes, their reliance on frame-by-frame UNet architectures introduces prohibitive latency and struggles with temporal consistency. This paper introduces MirrorMe, a real-time, controllable framework built on the LTX video model, a diffusion transformer that compresses video spatially and temporally for efficient latent space denoising. To address LTX's trade-offs between compression and semantic fidelity, we propose three innovations: 1. A reference identity injection mechanism via VAE-encoded image concatenation and self-attention, ensuring identity consistency; 2. A causal audio encoder and adapter tailored to LTX's temporal structure, enabling precise audio-expression synchronization; and 3. A progressive training strategy combining close-up facial training, half-body synthesis with facial masking, and hand pose integration for enhanced gesture control. Extensive experiments on the EMTD Benchmark demonstrate MirrorMe's state-of-the-art performance in fidelity, lip-sync accuracy, and temporal stability.

cs.CV↗

arXiv2025

A Study of Dynamic Stock Relationship Modeling and S&P500 Price Forecasting Based on Differential Graph Transformer

Stock price prediction is vital for investment decisions and risk management, yet remains challenging due to markets' nonlinear dynamics and time-varying inter-stock correlations. Traditional static-correlation models fail to capture evolving stock relationships. To address this, we propose a Differential Graph Transformer (DGT) framework for dynamic relationship modeling and price prediction. Our DGT integrates sequential graph structure changes into multi-head self-attention via a differential graph mechanism, adaptively preserving high-value connections while suppressing noise. Causal temporal attention captures global/local dependencies in price sequences. We further evaluate correlation metrics (Pearson, Mutual Information, Spearman, Kendall's Tau) across global/local/dual scopes as spatial-attention priors. Using 10 years of S&P 500 closing prices (z-score normalized; 64-day sliding windows), DGT with spatial priors outperformed GRU baselines (RMSE: 0.24 vs. 0.87). Kendall's Tau global matrices yielded optimal results (MAE: 0.11). K-means clustering revealed "high-volatility growth" and "defensive blue-chip" stocks, with the latter showing lower errors (RMSE: 0.13) due to stable correlations. Kendall's Tau and Mutual Information excelled in volatile sectors. This study innovatively combines differential graph structures with Transformers, validating dynamic relationship modeling and identifying optimal correlation metrics/scopes. Clustering analysis supports tailored quantitative strategies. Our framework advances financial time-series prediction through dynamic modeling and cross-asset interaction analysis.

cs.CE↗