arXiv subjects

Qiang Wang

Publications and source records attributed to Qiang Wang.

At least 109 records · Page 6Linked to original sources

arXiv2025

Influence of Built-in Electric Fields on the Optoelectronic and Catalytic Properties of Two-Dimensional Materials

In the realm of modern materials science and advanced electronics, ferroelectric materials have emerged as a subject of great intrigue and significance, chiefly due to their remarkable property of reversible spontaneous polarization. This unique characteristic is not just an interesting physical phenomenon; it plays a pivotal role in revolutionizing multiple technological applications, especially in the domains of high-density data storage and the pursuit of fast device operation. In the past few decades, there has been a significant increase in the number of investigations and commercial applications proposed for ferroelectric materials. With the continuous miniaturization of electronic devices and the rapid development of two-dimensional (2D) materials, considerable efforts have been made towards exploring ferroelectricity in 2D materials, driven by the potential for revolutionary advancements in energy storage, data processing, and other emerging technologies. This exploration is fueled by the realization that 2D ferroelectric materials could offer unique properties such as high energy density, fast switching speeds, and scalability, which are crucial for the next generation of electronic devices. The out-of-plane (OOP) ferroelectricity exhibited by these 2D materials is generally more advantageous than the in-plane ferroelectricity, primarily because the vertical polarizability aligns more seamlessly with the requirements of most practical technological applications

cond-mat.mtrl-sci↗

arXiv2025

Phase-engineered Non-degenerate Sliding Ferroelectricity Enables Tunable Photovoltaics in Monolayer Janus In2S2Se

Two-dimensional sliding ferroelectrics, with their enhanced efficiencies of charge separation and tunability, constitute promising platforms for next-generation photovoltaic devices. However, recent systems predominantly exhibit dual degenerate polarization states with weak intensity, hindering the optimal manipulations of photovoltaic effects through sliding ferroelectricity. Here, we address this limitation by introducing two strengthened and distinct non-degenerate sliding ferroelectric phases (WZ' and ZB') in Janus In2S2Se, which can be achieved by Se-to-S substitution in monolayer In2Se3. First-principles calculations validate the experimental synthesis of this structure and its capability for reversible phase transitions triggered by atomic layer sliding, and a series of superior photovoltaic performances are demonstrated in such unique Janus In2S2Se, accompanied by a detailed analysis of how non-degenerate sliding ferroelectricity modulates distinct photovoltaic characteristics. The WZ' to ZB' transition can increase the carrier mobility and moderate the band gap while inducing an indirect-to-direct transition, yielding a marked red-shift and enhancement of the photocurrent peak in the infrared spectrum. Conversely, the WZ' phase, benefiting from enhanced polarization, delivers superior photoelectric conversion efficiency in the visible light region. This work establishes a phase-engineered framework of how non-degenerate sliding ferroelectricity orchestrates distinct photovoltaic behaviors, and the intrinsic physical correlations may offer novel perspectives for designing and regulating innovative photovoltaic devices.

cond-mat.mtrl-sci↗

arXiv2025

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation

Most knowledge distillation (KD) methodologies predominantly focus on teacher-student pairs with similar architectures, such as both being convolutional neural networks (CNNs). However, the potential and flexibility of KD can be greatly improved by expanding it to novel Cross-Architecture KD (CAKD), where the knowledge of homogeneous and heterogeneous teachers can be transferred flexibly to a given student. The primary challenge in CAKD lies in the substantial feature gaps between heterogeneous models, originating from the distinction of their inherent inductive biases and module functions. To this end, we introduce an assistant model as a bridge to facilitate smooth feature knowledge transfer between heterogeneous teachers and students. More importantly, within our proposed design principle, the assistant model combines the advantages of cross-architecture inductive biases and module functions by merging convolution and attention modules derived from both student and teacher module functions. Furthermore, we observe that heterogeneous features exhibit diverse spatial distributions in CAKD, hindering the effectiveness of conventional pixel-wise mean squared error (MSE) loss. Therefore, we leverage a spatial-agnostic InfoNCE loss to align features after spatial smoothing, thereby improving the feature alignments in CAKD. Our proposed method is evaluated across some homogeneous model pairs and arbitrary heterogeneous combinations of CNNs, ViTs, and MLPs, achieving state-of-the-art performance for distilled models with a maximum gain of 11.47% on CIFAR-100 and 3.67% on ImageNet-1K. Our code and models will be released.

cs.CV↗

arXiv2025

Distribution-aware Forgetting Compensation for Exemplar-Free Lifelong Person Re-identification

Lifelong Person Re-identification (LReID) suffers from a key challenge in preserving old knowledge while adapting to new information. The existing solutions include rehearsal-based and rehearsal-free methods to address this challenge. Rehearsal-based approaches rely on knowledge distillation, continuously accumulating forgetting during the distillation process. Rehearsal-free methods insufficiently learn the distribution of each domain, leading to forgetfulness over time. To solve these issues, we propose a novel Distribution-aware Forgetting Compensation (DAFC) model that explores cross-domain shared representation learning and domain-specific distribution integration without using old exemplars or knowledge distillation. We propose a Text-driven Prompt Aggregation (TPA) that utilizes text features to enrich prompt elements and guide the prompt model to learn fine-grained representations for each instance. This can enhance the differentiation of identity information and establish the foundation for domain distribution awareness. Then, Distribution-based Awareness and Integration (DAI) is designed to capture each domain-specific distribution by a dedicated expert network and adaptively consolidate them into a shared region in high-dimensional space. In this manner, DAI can consolidate and enhance cross-domain shared representation learning while alleviating catastrophic forgetting. Furthermore, we develop a Knowledge Consolidation Mechanism (KCM) that comprises instance-level discrimination and cross-domain consistency alignment strategies to facilitate model adaptive learning of new knowledge from the current domain and promote knowledge consolidation learning between acquired domain-specific distributions, respectively. Experimental results show that our DAFC outperforms state-of-the-art methods. Our code is available at https://github.com/LiuShiBen/DAFC.

cs.CV↗

arXiv2025

TCM-Tongue: A Standardized Tongue Image Dataset with Pathological Annotations for AI-Assisted TCM Diagnosis

Traditional Chinese medicine (TCM) tongue diagnosis, while clinically valuable, faces standardization challenges due to subjective interpretation and inconsistent imaging protocols, compounded by the lack of large-scale, annotated datasets for AI development. To address this gap, we present the first specialized dataset for AI-driven TCM tongue diagnosis, comprising 6,719 high-quality images captured under standardized conditions and annotated with 20 pathological symptom categories (averaging 2.54 clinically validated labels per image, all verified by licensed TCM practitioners). The dataset supports multiple annotation formats (COCO, TXT, XML) for broad usability and has been benchmarked using nine deep learning models (YOLOv5/v7/v8 variants, SSD, and MobileNetV2) to demonstrate its utility for AI development. This resource provides a critical foundation for advancing reliable computational tools in TCM, bridging the data shortage that has hindered progress in the field, and facilitating the integration of AI into both research and clinical practice through standardized, high-quality diagnostic data.

eess.IV↗

arXiv2025

Accurate and Efficient Fine-Tuning of Quantized Large Language Models Through Optimal Balance

Large Language Models (LLMs) have demonstrated impressive performance across various domains. However, the enormous number of model parameters makes fine-tuning challenging, significantly limiting their application and deployment. Existing solutions combine parameter quantization with Low-Rank Adaptation (LoRA), reducing memory usage but causing performance degradation. Additionally, converting fine-tuned models to low-precision representations further degrades performance. In this paper, we identify an imbalance in fine-tuning quantized LLMs with LoRA: overly complex adapter inputs and outputs versus low effective trainability of the adapter, leading to underfitting during fine-tuning. Thus, we propose Quantized LLMs fine-tuning with Balanced Low-Rank Adaptation (Q-BLoRA), which simplifies the adapter's inputs and outputs while increasing the adapter's rank to alleviate underfitting during fine-tuning. For low-precision deployment, we propose Quantization-Aware fine-tuning with Balanced Low-Rank Adaptation (QA-BLoRA), which aligns with the block-wise quantization and facilitates quantization-aware fine-tuning of low-rank adaptation based on the parameter merging of Q-BLoRA. Both Q-BLoRA and QA-BLoRA are easily implemented and offer the following optimizations: (i) Q-BLoRA consistently achieves state-of-the-art accuracy compared to baselines and other variants; (ii) QA-BLoRA enables the direct generation of low-precision inference models, which exhibit significant performance improvements over other low-precision models. We validate the effectiveness of Q-BLoRA and QA-BLoRA across various models and scenarios. Code will be made available at \href{https://github.com/xiaocaigou/qbaraqahira}{https://github.com/xiaocaigou/qbaraqahira}

cs.LG↗

arXiv2025

City-VLM: Towards Multidomain Perception Scene Understanding via Multimodal Incomplete Learning

Scene understanding enables intelligent agents to interpret and comprehend their environment. While existing large vision-language models (LVLMs) for scene understanding have primarily focused on indoor household tasks, they face two significant limitations when applied to outdoor large-scale scene understanding. First, outdoor scenarios typically encompass larger-scale environments observed through various sensors from multiple viewpoints (e.g., bird view and terrestrial view), while existing indoor LVLMs mainly analyze single visual modalities within building-scale contexts from humanoid viewpoints. Second, existing LVLMs suffer from missing multidomain perception outdoor data and struggle to effectively integrate 2D and 3D visual information. To address the aforementioned limitations, we build the first multidomain perception outdoor scene understanding dataset, named \textbf{\underline{SVM-City}}, deriving from multi\textbf{\underline{S}}cale scenarios with multi\textbf{\underline{V}}iew and multi\textbf{\underline{M}}odal instruction tuning data. It contains $420$k images and $4, 811$M point clouds with $567$k question-answering pairs from vehicles, low-altitude drones, high-altitude aerial planes, and satellite. To effectively fuse the multimodal data in the absence of one modality, we introduce incomplete multimodal learning to model outdoor scene understanding and design the LVLM named \textbf{\underline{City-VLM}}. Multimodal fusion is realized by constructing a joint probabilistic distribution space rather than implementing directly explicit fusion operations (e.g., concatenation). Experimental results on three typical outdoor scene understanding tasks show City-VLM achieves $18.14 \%$ performance surpassing existing LVLMs in question-answering tasks averagely. Our method demonstrates pragmatic and generalization performance across multiple outdoor scenes.

cs.CV↗

arXiv2025

FantasyPortrait: Enhancing Multi-Character Portrait Animation with Expression-Augmented Diffusion Transformers

Producing expressive facial animations from static images is a challenging task. Prior methods relying on explicit geometric priors (e.g., facial landmarks or 3DMM) often suffer from artifacts in cross reenactment and struggle to capture subtle emotions. Furthermore, existing approaches lack support for multi-character animation, as driving features from different individuals frequently interfere with one another, complicating the task. To address these challenges, we propose FantasyPortrait, a diffusion transformer based framework capable of generating high-fidelity and emotion-rich animations for both single- and multi-character scenarios. Our method introduces an expression-augmented learning strategy that utilizes implicit representations to capture identity-agnostic facial dynamics, enhancing the model's ability to render fine-grained emotions. For multi-character control, we design a masked cross-attention mechanism that ensures independent yet coordinated expression generation, effectively preventing feature interference. To advance research in this area, we propose the Multi-Expr dataset and ExprBench, which are specifically designed datasets and benchmarks for training and evaluating multi-character portrait animations. Extensive experiments demonstrate that FantasyPortrait significantly outperforms state-of-the-art methods in both quantitative metrics and qualitative evaluations, excelling particularly in challenging cross reenactment and multi-character contexts. Our project page is https://fantasy-amap.github.io/fantasy-portrait/.

cs.CV↗

arXiv2025

Modified gravitational wave propagations in linearized gravity with Lorentz and diffeomorphism violations and their gravitational wave constraints

The standard model extension (SME) is an effective field theory framework that can be used to study the possible violations of Lorentz symmetry and diffeomorphism invariance in the gravitational interaction. In this paper, we explore both the Lorentz- and diffeomorphism-violating effects on the propagations of gravitational waves in the SME's linearized gravity. It is shown that the violations of Lorentz symmetry and diffeomorphism invariance modify the conventional linear dispersion relation of gravitational waves, leading to anisotropy, birefringence, and dispersion effects in the propagation of gravitational waves. With these modified dispersion relations, we then calculate the dephasing effects due to the Lorentz and diffeomorphism violations in the waveforms of gravitational waves produced by the coalescence of compact binaries. With the distorted waveforms, we perform full Bayesian inference with the help of the open source software \texttt{BILBY} on the gravitational wave events of the compact binary mergers in the LIGO-Virgo-KAGRA catalogs GWTC-3. We consider the effects from the operators with the lowest mass dimension $d=2$ and $d=3$ due to the Lorentz and diffeomorphism violations in the linearized gravity. No signature of Lorentz and diffeomorphism violations arsing from the SME's linearized gravity are found for most GW events, which allows us to give a $90\%$ confidence interval for each Lorentz- and diffeomorphism-violating coefficient.

gr-qc↗

arXiv2025

ATSTrack: Enhancing Visual-Language Tracking by Aligning Temporal and Spatial Scales

A main challenge of Visual-Language Tracking (VLT) is the misalignment between visual inputs and language descriptions caused by target movement. Previous trackers have explored many effective feature modification methods to preserve more aligned features. However, an important yet unexplored factor ultimately hinders their capability, which is the inherent differences in the temporal and spatial scale of information between visual and language inputs. To address this issue, we propose a novel visual-language tracker that enhances the effect of feature modification by \textbf{A}ligning \textbf{T}emporal and \textbf{S}patial scale of different input components, named as \textbf{ATSTrack}. Specifically, we decompose each language description into phrases with different attributes based on their temporal and spatial correspondence with visual inputs, and modify their features in a fine-grained manner. Moreover, we introduce a Visual-Language token that comprises modified linguistic information from the previous frame to guide the model to extract visual features that are more relevant to language description, thereby reducing the impact caused by the differences in spatial scale. Experimental results show that our proposed ATSTrack achieves performance comparable to existing methods. Our code will be released.

cs.CV↗

arXiv2025

Diverse polymorphs and phase transitions in van der Waals In$_2$Se$_3$

Van der Waals In$_2$Se$_3$ has garnered significant attention due to its unique properties and wide applications associated with its rich polymorphs and polymorphic phase transitions. Despite extensive studies, the vast complex polymorphic phase space remains largely unexplored, and the underlying microscopic mechanism for their phase transformations remains elusive. Here, we develop a highly accurate, efficient, and reliable machine-learning potential (MLP), which not only facilitates accurate exploration of the intricate potential energy surface (PES), but also enables us to conduct large-scale molecular dynamics (MD) simulations with first-principles accuracy. We identify the accurate structure of the $β''$ polymorph and uncover several previously unreported $β'$ polymorph variants exhibiting dynamic stability and competing energies, which are elucidated by characteristic flat imaginary phonon bands and the distinctive Mexican-hat-like PES in the $β$ polymorph. Through the MLP-accelerated MD simulations, we directly observe the polymorphic phase transformations among the $α$, $β$, $β'$, and $β''$ polymorphs under varying temperature and pressure conditions, and build for the first time an ab initio temperature-pressure phase diagram, showing good agreement with experiments. Furthermore, our MD simulations reveal a novel strain-induced reversible phase transition between the $β'$ and $β''$ polymorphs. This work not only unveils diverse polymorphs in van der Waals In$_2$Se$_3$, but also provides crucial atomic insights into their phase transitions, opening new avenues for the design of novel functional electronic devices.

cond-mat.mtrl-sci↗

arXiv2025

RA-NeRF: Robust Neural Radiance Field Reconstruction with Accurate Camera Pose Estimation under Complex Trajectories

Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have emerged as powerful tools for 3D reconstruction and SLAM tasks. However, their performance depends heavily on accurate camera pose priors. Existing approaches attempt to address this issue by introducing external constraints but fall short of achieving satisfactory accuracy, particularly when camera trajectories are complex. In this paper, we propose a novel method, RA-NeRF, capable of predicting highly accurate camera poses even with complex camera trajectories. Following the incremental pipeline, RA-NeRF reconstructs the scene using NeRF with photometric consistency and incorporates flow-driven pose regulation to enhance robustness during initialization and localization. Additionally, RA-NeRF employs an implicit pose filter to capture the camera movement pattern and eliminate the noise for pose estimation. To validate our method, we conduct extensive experiments on the Tanks\&Temple dataset for standard evaluation, as well as the NeRFBuster dataset, which presents challenging camera pose trajectories. On both datasets, RA-NeRF achieves state-of-the-art results in both camera pose estimation and visual quality, demonstrating its effectiveness and robustness in scene reconstruction under complex pose trajectories.

cs.CV↗

arXiv2025

Permutation polynomials, projective polynomials, and bijections between $μ_{\frac{q^n-1}{q-1}}$ and $PG(n-1,q)$

Using arbitrary bases for the finite field $\mathbb{F}_{q^n}$ over $\mathbb{F}_{q}$, we obtain the generalized Möbius transformations (GMTs), which are a class of bijections between the projective geometry $PG(n-1,q)$ and the set of roots of unity $μ_{\frac{q^n-1}{q-1}}\subseteq\mathbb{F}_{q^n}$, where $n\geq 2$ is any integer. We also introduce a class of projective polynomials, using the properties of which we determine the inverses of the GMTs. Moreover, we study the roots of those projective polynomials, which lead to a three-way correspondence between partitions of $\mathbb{F}_{q^n}^\ast,μ_{\frac{q^n-1}{q-1}}$ and $PG(n-1,q)$. Through this correspondence and the GMTs, we construct permutation polynomials of index $\frac{q^n-1}{q-1}$ over $\mathbb{F}_{q^n}$.

math.CO↗

arXiv2025

Boosting Domain Incremental Learning: Selecting the Optimal Parameters is All You Need

Deep neural networks (DNNs) often underperform in real-world, dynamic settings where data distributions change over time. Domain Incremental Learning (DIL) offers a solution by enabling continual model adaptation, with Parameter-Isolation DIL (PIDIL) emerging as a promising paradigm to reduce knowledge conflicts. However, existing PIDIL methods struggle with parameter selection accuracy, especially as the number of domains and corresponding classes grows. To address this, we propose SOYO, a lightweight framework that improves domain selection in PIDIL. SOYO introduces a Gaussian Mixture Compressor (GMC) and Domain Feature Resampler (DFR) to store and balance prior domain data efficiently, while a Multi-level Domain Feature Fusion Network (MDFN) enhances domain feature extraction. Our framework supports multiple Parameter-Efficient Fine-Tuning (PEFT) methods and is validated across tasks such as image classification, object detection, and speech enhancement. Experimental results on six benchmarks demonstrate SOYO's consistent superiority over existing baselines, showcasing its robustness and adaptability in complex, evolving environments. The codes will be released in https://github.com/qwangcv/SOYO.

cs.CV↗

arXiv2025

Learning A Robust RGB-Thermal Detector for Extreme Modality Imbalance

RGB-Thermal (RGB-T) object detection utilizes thermal infrared (TIR) images to complement RGB data, improving robustness in challenging conditions. Traditional RGB-T detectors assume balanced training data, where both modalities contribute equally. However, in real-world scenarios, modality degradation-due to environmental factors or technical issues-can lead to extreme modality imbalance, causing out-of-distribution (OOD) issues during testing and disrupting model convergence during training. This paper addresses these challenges by proposing a novel base-and-auxiliary detector architecture. We introduce a modality interaction module to adaptively weigh modalities based on their quality and handle imbalanced samples effectively. Additionally, we leverage modality pseudo-degradation to simulate real-world imbalances in training data. The base detector, trained on high-quality pairs, provides a consistency constraint for the auxiliary detector, which receives degraded samples. This framework enhances model robustness, ensuring reliable performance even under severe modality degradation. Experimental results demonstrate the effectiveness of our method in handling extreme modality imbalances~(decreasing the Missing Rate by 55%) and improving performance across various baseline detectors.

cs.CV↗

arXiv2025

Dual-Polarization Stacked Intelligent Metasurfaces for Holographic MIMO

To address the limited wave domain signal processing capabilities of traditional single-polarized stacked intelligent metasurfaces (SIMs) in holographic multiple-input multiple-output (HMIMO) systems, which stems from limited integration space, this paper proposes a dual-polarized SIM (DPSIM) architecture. By stacking dual-polarized reconfigurable intelligent surfaces (DPRIS), DPSIM can independently process signals of two orthogonal polarizations in the wave domain, thereby effectively suppressing polarization cross-interference (PCI) and inter-stream interference (ISI). We introduce a layer-by-layer gradient descent with water-filling (LGD-WF) algorithm to enhance end-to-end performance. Simulation results show that, under the same number of metasurface layers and unit size, the DPSIM-aided HMIMO system can support more simultaneous data streams for ISI-free parallel transmission compared to traditional SIM-aided systems. Furthermore, under different polarization imperfection conditions, both the spectral efficiency (SE) and energy efficiency (EE) of the DPSIM-aided HMIMO system are significantly improved, approaching the theoretical upper bound.

eess.SP↗

arXiv2025

BurstGPT: A Real-world Workload Dataset to Optimize LLM Serving Systems

Serving systems for Large Language Models (LLMs) are often optimized to improve quality of service (QoS) and throughput. However, due to the lack of open-source LLM serving workloads, these systems are frequently evaluated under unrealistic workload assumptions. Consequently, performance may degrade when systems are deployed in real-world scenarios. This work presents BurstGPT, an LLM serving workload with 10.31 million traces from regional Azure OpenAI GPT services over 213 days. BurstGPT captures LLM serving characteristics from user, model and system perspectives: (1) User request concurrency: burstiness variations of requests in Azure OpenAI GPT services, revealing diversified concurrency patterns in different services and model types. (2) User conversation patterns: counts and intervals within conversations for service optimizations. (3) Model response lengths: auto-regressive serving processes of GPT models, showing statistical relations between requests and their responses. (4) System response failures: failures of conversation and API services, showing intensive resource needs and limited availability of LLM services in Azure. The details of the characteristics can serve multiple purposes in LLM serving optimizations, such as system evaluation and trace provisioning. In our demo evaluation with BurstGPT, frequent variations in BurstGPT reveal declines in efficiency, stability, or reliability in realistic LLM serving. We identify that the generalization of KV cache management, scheduling and disaggregation optimizations can be improved under realistic workload evaluations. BurstGPT is publicly available now at https://github.com/HPMLL/BurstGPT and is widely used to develop prototypes of LLM serving frameworks in the industry.

cs.DC↗

arXiv2025

ReCopilot: Reverse Engineering Copilot in Binary Analysis

Binary analysis plays a pivotal role in security domains such as malware detection and vulnerability discovery, yet it remains labor-intensive and heavily reliant on expert knowledge. General-purpose large language models (LLMs) perform well in programming analysis on source code, while binaryspecific LLMs are underexplored. In this work, we present ReCopilot, an expert LLM designed for binary analysis tasks. ReCopilot integrates binary code knowledge through a meticulously constructed dataset, encompassing continue pretraining (CPT), supervised fine-tuning (SFT), and direct preference optimization (DPO) stages. It leverages variable data flow and call graph to enhance context awareness and employs test-time scaling to improve reasoning capabilities. Evaluations on a comprehensive binary analysis benchmark demonstrate that ReCopilot achieves state-of-the-art performance in tasks such as function name recovery and variable type inference on the decompiled pseudo code, outperforming both existing tools and LLMs by 13%. Our findings highlight the effectiveness of domain-specific training and context enhancement, while also revealing challenges in building super long chain-of-thought. ReCopilot represents a significant step toward automating binary analysis with interpretable and scalable AI assistance in this domain.

cs.CR↗