arXiv subjects

Fan Wang

Publications and source records attributed to Fan Wang.

At least 145 records · Page 8Linked to original sources

arXiv2025

KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models

The increasing sizes of large language models (LLMs) result in significant computational overhead and memory usage when adapting these models to specific tasks or domains. Various parameter-efficient fine-tuning (PEFT) methods have been devised to mitigate these challenges by training a small set of parameters for the task-specific updates of the model weights. Among PEFT methods, LoRA stands out for its simplicity and efficiency, inspiring the development of a series of variants. However, LoRA and its successors disregard the knowledge that is noisy or irrelevant to the targeted task, detrimentally impacting model performance and leading to suboptimality. To address this limitation, we introduce Knowledge-aware Singular-value Adaptation (KaSA), a PEFT method that leverages singular value decomposition (SVD) with knowledge-aware singular values to dynamically activate knowledge based on its relevance to the task at hand. We conduct extensive experiments across a range of LLMs on tasks spanning natural language understanding (NLU), generation (NLG), instruction following, and commonsense reasoning. The experimental results demonstrate that KaSA consistently outperforms FFT and 14 popular PEFT baselines across 16 benchmarks and 4 synthetic datasets, underscoring our method's efficacy and adaptability. The source code of our method is available at https://github.com/juyongjiang/KaSA.

cs.CL↗

arXiv2025

Radiative decays of $X(3872)$ in $D{\bar D}^*$ molecule scenario

We investigate the radiative decays of the $X(3872)$ to $γV~(V=ρ^0,\, ω)$ in the molecule scenario, where the $X(3872)$ is regarded as a pure hadronic molecule of the $D\bar{D}^*+c.c$ in an $S$-wave with the quantum numbers $J^{PC}=1^{++}$. The radiative processes were assumed to occur via the triangle hadronic loops, and the relevant calculations were conducted using an effective Lagrangian approach. It is found that the absolute decay widths are model-dependent, but the relative width ratio is rather independent of the model parameter. Moreover, the calculated results indicate that the radiative decays of the $X(3872)$ are strongly influenced by the molecular configuration characterized by the proportion of the charged and neutral constituents. We hope that the present calculations could be tested by the experimental measurements.

hep-ph↗

arXiv2025

Joint Similarity Item Exploration and Overlapped User Guidance for Multi-Modal Cross-Domain Recommendation

Cross-Domain Recommendation (CDR) has been widely investigated for solving long-standing data sparsity problem via knowledge sharing across domains. In this paper, we focus on the Multi-Modal Cross-Domain Recommendation (MMCDR) problem where different items have multi-modal information while few users are overlapped across domains. MMCDR is particularly challenging in two aspects: fully exploiting diverse multi-modal information within each domain and leveraging useful knowledge transfer across domains. However, previous methods fail to cluster items with similar characteristics while filtering out inherit noises within different modalities, hurdling the model performance. What is worse, conventional CDR models primarily rely on overlapped users for domain adaptation, making them ill-equipped to handle scenarios where the majority of users are non-overlapped. To fill this gap, we propose Joint Similarity Item Exploration and Overlapped User Guidance (SIEOUG) for solving the MMCDR problem. SIEOUG first proposes similarity item exploration module, which not only obtains pair-wise and group-wise item-item graph knowledge, but also reduces irrelevant noise for multi-modal modeling. Then SIEOUG proposes user-item collaborative filtering module to aggregate user/item embeddings with the attention mechanism for collaborative filtering. Finally SIEOUG proposes overlapped user guidance module with optimal user matching for knowledge sharing across domains. Our empirical study on Amazon dataset with several different tasks demonstrates that SIEOUG significantly outperforms the state-of-the-art models under the MMCDR setting.

cs.IR↗

arXiv2025

Near-Field Localization with Physics-Compliant Electromagnetic Model: Algorithms and Model Mismatch Analysis

Accurate signal localization is critical for Internet of Things applications, but precise propagation models are often unavailable due to uncontrollable factors. Simplified models such as planar and spherical wavefront approximations are widely used but can cause model mismatches that reduce accuracy. To address this, we propose an expected likelihood ratio framework for model mismatch analysis and online model selection without requiring knowledge of the true propagation model. The framework leverages the scenario independent distribution of the likelihood ratio of the actual covariance matrix, enabling the detection of mismatches and outliers by comparing given models to a predefined distribution. When an accurate electromagnetic model is unavailable, the robustness of the framework is analyzed using data generated from a precise electromagnetic model and simplified models within positioning algorithms. Validation in direct localization and reconfigurable intelligent surface assisted scenarios demonstrates the ability to improve localization accuracy and reliably detect model mismatches in diverse Internet of Things environments.

eess.SP↗

arXiv2025

Multitype entanglement dynamics induced by exceptional points

As a most important feature of non-Hermitian systems, exceptional points (EPs) lead to a variety of unconventional phenomena and applications. Here, we study a generic model composed of two coupled non-Hermitian qubits, the EPs can be easily obtained in this system by adjusting the driving amplitude applied to the qubits. The diverse entanglement dynamics on the two sides of the original fourth-order EP (EP4') and second order EP (EP2) can be observed simultaneously in the weak coupling regime. With the increase of the coupling strength, the EP4' is replaced by an additional EP2, leading to the disappearance of the entanglement dynamics changing induced by EP4' in the strong coupling regime. Considering the case of Ising type interaction, we also realize EP-induced entanglement dynamics changing without the driving field. Our study paves the way for the investigation of EP-induced quantum effects and applications of EP-related quantum technologies.

quant-ph↗

arXiv2025

MuST: Multi-Head Skill Transformer for Long-Horizon Dexterous Manipulation with Skill Progress

Robot picking and packing tasks require dexterous manipulation skills, such as rearranging objects to establish a good grasping pose, or placing and pushing items to achieve tight packing. These tasks are challenging for robots due to the complexity and variability of the required actions. To tackle the difficulty of learning and executing long-horizon tasks, we propose a novel framework called the Multi-Head Skill Transformer (MuST). This model is designed to learn and sequentially chain together multiple motion primitives (skills), enabling robots to perform complex sequences of actions effectively. MuST introduces a "progress value" for each skill, guiding the robot on which skill to execute next and ensuring smooth transitions between skills. Additionally, our model is capable of expanding its skill set and managing various sequences of sub-tasks efficiently. Extensive experiments in both simulated and real-world environments demonstrate that MuST significantly enhances the robot's ability to perform long-horizon dexterous manipulation tasks.

cs.RO↗

arXiv2025

Transfer Learning for Nonparametric Contextual Dynamic Pricing

Dynamic pricing strategies are crucial for firms to maximize revenue by adjusting prices based on market conditions and customer characteristics. However, designing optimal pricing strategies becomes challenging when historical data are limited, as is often the case when launching new products or entering new markets. One promising approach to overcome this limitation is to leverage information from related products or markets to inform the focal pricing decisions. In this paper, we explore transfer learning for nonparametric contextual dynamic pricing under a covariate shift model, where the marginal distributions of covariates differ between source and target domains while the reward functions remain the same. We propose a novel Transfer Learning for Dynamic Pricing (TLDP) algorithm that can effectively leverage pre-collected data from a source domain to enhance pricing decisions in the target domain. The regret upper bound of TLDP is established under a simple Lipschitz condition on the reward function. To establish the optimality of TLDP, we further derive a matching minimax lower bound, which includes the target-only scenario as a special case and is presented for the first time in the literature. Extensive numerical experiments validate our approach, demonstrating its superiority over existing methods and highlighting its practical utility in real-world applications.

cs.LG↗

arXiv2025

Computationally Efficient Whole-Genome Signal Region Detection for Quantitative and Binary Traits

The identification of genetic signal regions in the human genome is critical for understanding the genetic architecture of complex traits and diseases. Numerous methods based on scan algorithms (i.e. QSCAN, SCANG, SCANG-STARR) have been developed to allow dynamic window sizes in whole-genome association studies. Beyond scan algorithms, we have recently developed the binary and re-search (BiRS) algorithm, which is more computationally efficient than scan-based methods and exhibits superior statistical power. However, the BiRS algorithm is based on two-sample mean test for binary traits, not accounting for multidimensional covariates or handling test statistics for non-binary outcomes. In this work, we present a distributed version of the BiRS algorithm (dBiRS) that incorporate a new infinity-norm test statistic based on summary statistics computed from a generalized linear model. The dBiRS algorithm accommodates regression-based statistics, allowing for the adjustment of covariates and the testing of both continuous and binary outcomes. This new framework enables parallel computing of block-wise results by aggregation through a central machine to ensure both detection accuracy and computational efficiency, and has theoretical guarantees for controlling family-wise error rates and false discovery rates while maintaining the power advantages of the original algorithm. Applying dBiRS to detect genetic regions associated with fluid intelligence and prospective memory using whole-exome sequencing data from the UK Biobank, we validate previous findings and identify numerous novel rare variants near newly implicated genes. These discoveries offer valuable insights into the genetic basis of cognitive performance and neurodegenerative disorders, highlighting the potential of dBiRS as a scalable and powerful tool for whole-genome signal region detection.

stat.AP↗

arXiv2025

Aster: Enhancing LSM-structures for Scalable Graph Database

There is a proliferation of applications requiring the management of large-scale, evolving graphs under workloads with intensive graph updates and lookups. Driven by this challenge, we introduce Poly-LSM, a high-performance key-value storage engine for graphs with the following novel techniques: (1) Poly-LSM is embedded with a new design of graph-oriented LSM-tree structure that features a hybrid storage model for concisely and effectively storing graph data. (2) Poly-LSM utilizes an adaptive mechanism to handle edge insertions and deletions on graphs with optimized I/O efficiency. (3) Poly-LSM exploits the skewness of graph data to encode the key-value entries. Building upon this foundation, we further implement Aster, a robust and versatile graph database that supports Gremlin query language facilitating various graph applications. In our experiments, we compared Aster against several mainstream real-world graph databases. The results demonstrate that Aster outperforms all baseline graph databases, especially on large-scale graphs. Notably, on the billion-scale Twitter graph dataset, Aster achieves up to 17x throughput improvement compared to the best-performing baseline graph system.

cs.DB↗

arXiv2024

Network shell structure based on hub and non-hub nodes

The shell structure holds significant importance in various domains such as information dissemination, supply chain management, and transportation. This study focuses on investigating the shell structure of hub and non-hub nodes, which play important roles in these domains. Our framework explores the topology of Erdös-Rényi (ER) and Scale-Free (SF) networks, considering source node selection strategies dependent on the nodes' degrees. We define the shell $l$ in a network as the set of nodes at a distance $l$ from a given node and represent $r_l$ as the fraction of nodes outside shell $l$. Statistical properties of the shells are examined for a selected node, taking into account the node's degree. For a network with a given degree distribution, we analytically derive the degree distribution and average degree of nodes outside shell $l$ as functions of $r_l$. Moreover, we discover that $r_l$ follows an iterative functional form $r_l = ϕ(r_{l-1})$, where $ϕ$ is expressed in terms of the generating function of the original degree distribution of the network.

physics.soc-ph↗

arXiv2024

RealisID: Scale-Robust and Fine-Controllable Identity Customization via Local and Global Complementation

Recently, the success of text-to-image synthesis has greatly advanced the development of identity customization techniques, whose main goal is to produce realistic identity-specific photographs based on text prompts and reference face images. However, it is difficult for existing identity customization methods to simultaneously meet the various requirements of different real-world applications, including the identity fidelity of small face, the control of face location, pose and expression, as well as the customization of multiple persons. To this end, we propose a scale-robust and fine-controllable method, namely RealisID, which learns different control capabilities through the cooperation between a pair of local and global branches. Specifically, by using cropping and up-sampling operations to filter out face-irrelevant information, the local branch concentrates the fine control of facial details and the scale-robust identity fidelity within the face region. Meanwhile, the global branch manages the overall harmony of the entire image. It also controls the face location by taking the location guidance as input. As a result, RealisID can benefit from the complementarity of these two branches. Finally, by implementing our branches with two different variants of ControlNet, our method can be easily extended to handle multi-person customization, even only trained on single-person datasets. Extensive experiments and ablation studies indicate the effectiveness of RealisID and verify its ability in fulfilling all the requirements mentioned above.

cs.CV↗

arXiv2024

SHMT: Self-supervised Hierarchical Makeup Transfer via Latent Diffusion Models

This paper studies the challenging task of makeup transfer, which aims to apply diverse makeup styles precisely and naturally to a given facial image. Due to the absence of paired data, current methods typically synthesize sub-optimal pseudo ground truths to guide the model training, resulting in low makeup fidelity. Additionally, different makeup styles generally have varying effects on the person face, but existing methods struggle to deal with this diversity. To address these issues, we propose a novel Self-supervised Hierarchical Makeup Transfer (SHMT) method via latent diffusion models. Following a "decoupling-and-reconstruction" paradigm, SHMT works in a self-supervised manner, freeing itself from the misguidance of imprecise pseudo-paired data. Furthermore, to accommodate a variety of makeup styles, hierarchical texture details are decomposed via a Laplacian pyramid and selectively introduced to the content representation. Finally, we design a novel Iterative Dual Alignment (IDA) module that dynamically adjusts the injection condition of the diffusion model, allowing the alignment errors caused by the domain gap between content and makeup representations to be corrected. Extensive quantitative and qualitative analyses demonstrate the effectiveness of our method. Our code is available at \url{https://github.com/Snowfallingplum/SHMT}.

cs.CV↗

arXiv2024

Hamiltonian cycles passing through matchings in $k$-ary $n$-cubes

As we all know, the $k$-ary $n$-cube is a highly efficient interconnect network topology structure. It is also a concept of great significance, with a broad range of applications spanning both mathematics and computer science. In this paper, we study the existence of Hamiltonian cycles passing through prescribed matchings in $k$-ary $n$-cubes, and obtain the following result. For $n\geq5$ and $k\geq4$, every matching with at most $4n-20$ edges is contained in a Hamiltonian cycle in the $k$-ary $n$-cube.

math.CO↗

arXiv2024

Unveiling the Superior Paradigm: A Comparative Study of Source-Free Domain Adaptation and Unsupervised Domain Adaptation

In domain adaptation, there are two popular paradigms: Unsupervised Domain Adaptation (UDA), which aligns distributions using source data, and Source-Free Domain Adaptation (SFDA), which leverages pre-trained source models without accessing source data. Evaluating the superiority of UDA versus SFDA is an open and timely question with significant implications for deploying adaptive algorithms in practical applications. In this study, we demonstrate through predictive coding theory and extensive experiments on multiple benchmark datasets that SFDA generally outperforms UDA in real-world scenarios. Specifically, SFDA offers advantages in time efficiency, storage requirements, targeted learning objectives, reduced risk of negative transfer, and increased robustness against overfitting. Notably, SFDA is particularly effective in mitigating negative transfer when there are substantial distribution discrepancies between source and target domains. Additionally, we introduce a novel data-model fusion scenario, where data sharing among stakeholders varies (e.g., some provide raw data while others provide only models), and reveal that traditional UDA and SFDA methods do not fully exploit their potential in this context. To address this limitation and capitalize on the strengths of SFDA, we propose a novel weight estimation method that effectively integrates available source data into multi-SFDA (MSFDA) approaches, thereby enhancing model performance within this scenario. This work provides a thorough analysis of UDA versus SFDA and advances a practical approach to model adaptation across diverse real-world environments.

cs.LG↗

arXiv2024

Empirical color correction to MIST and PARSEC isochrones on Gaia BR-RP and G-RP with benchmark open clusters

Recent literature reports a color deviation between observed Gaia color-magnitude diagrams (CMDs) and theoretical model isochrone predictions, particularly in the very low-mass regime. To assess its impact on cluster age determination via isochrone fitting, we quantified the color deviations for three benchmark clusters, Hyades, Pleiades, and Praesepe, both for the Gaia color (BP-RP) and (G-RP). In general, the (G-RP) color deviations are smaller than the (BP-RP) ones. Empirical color correction functions based on these benchmarks are derived for the currently available MIST and PARSEC 1.2S isochrone models. Applying the correction functions to 31 additional open clusters and 3 moving groups results in a significantly improved alignment between the isochrones and observed CMDs. With our empirical corrections, isochrones provide age estimates consistent with literature values obtained through the spectral Lithium Depletion Boundary method, validating the effectiveness of our approach. The corresponding metallicities with PARSEC 1.2S also show a good agreement with the spectroscopic results. The empirical color correction function we present in this work offers a tool for a consistent age determination within the full mass range of stellar clusters using the isochrone fitting method.

astro-ph.SR↗

arXiv2024

MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editing

Novel View Synthesis (NVS) and 3D generation have recently achieved prominent improvements. However, these works mainly focus on confined categories or synthetic 3D assets, which are discouraged from generalizing to challenging in-the-wild scenes and fail to be employed with 2D synthesis directly. Moreover, these methods heavily depended on camera poses, limiting their real-world applications. To overcome these issues, we propose MVInpainter, re-formulating the 3D editing as a multi-view 2D inpainting task. Specifically, MVInpainter partially inpaints multi-view images with the reference guidance rather than intractably generating an entirely novel view from scratch, which largely simplifies the difficulty of in-the-wild NVS and leverages unmasked clues instead of explicit pose conditions. To ensure cross-view consistency, MVInpainter is enhanced by video priors from motion components and appearance guidance from concatenated reference key&value attention. Furthermore, MVInpainter incorporates slot attention to aggregate high-level optical flow features from unmasked regions to control the camera movement with pose-free training and inference. Sufficient scene-level experiments on both object-centric and forward-facing datasets verify the effectiveness of MVInpainter, including diverse tasks, such as multi-view object removal, synthesis, insertion, and replacement. The project page is https://ewrfcas.github.io/MVInpainter/.

cs.CV↗

arXiv2024

RealisHuman: A Two-Stage Approach for Refining Malformed Human Parts in Generated Images

In recent years, diffusion models have revolutionized visual generation, outperforming traditional frameworks like Generative Adversarial Networks (GANs). However, generating images of humans with realistic semantic parts, such as hands and faces, remains a significant challenge due to their intricate structural complexity. To address this issue, we propose a novel post-processing solution named RealisHuman. The RealisHuman framework operates in two stages. First, it generates realistic human parts, such as hands or faces, using the original malformed parts as references, ensuring consistent details with the original image. Second, it seamlessly integrates the rectified human parts back into their corresponding positions by repainting the surrounding areas to ensure smooth and realistic blending. The RealisHuman framework significantly enhances the realism of human generation, as demonstrated by notable improvements in both qualitative and quantitative metrics. Code is available at https://github.com/Wangbenzhi/RealisHuman.

cs.CV↗

arXiv2024

A Survey on Large Language Models for Code Generation

Large Language Models (LLMs) have garnered remarkable advancements across diverse code-related tasks, known as Code LLMs, particularly in code generation that generates source code with LLM from natural language descriptions. This burgeoning field has captured significant interest from both academic researchers and industry professionals due to its practical significance in software development, e.g., GitHub Copilot. Despite the active exploration of LLMs for a variety of code tasks, either from the perspective of natural language processing (NLP) or software engineering (SE) or both, there is a noticeable absence of a comprehensive and up-to-date literature review dedicated to LLM for code generation. In this survey, we aim to bridge this gap by providing a systematic literature review that serves as a valuable reference for researchers investigating the cutting-edge progress in LLMs for code generation. We introduce a taxonomy to categorize and discuss the recent developments in LLMs for code generation, covering aspects such as data curation, latest advances, performance evaluation, ethical implications, environmental impact, and real-world applications. In addition, we present a historical overview of the evolution of LLMs for code generation and offer an empirical comparison using the HumanEval, MBPP, and BigCodeBench benchmarks across various levels of difficulty and types of programming tasks to highlight the progressive enhancements in LLM capabilities for code generation. We identify critical challenges and promising opportunities regarding the gap between academia and practical development. Furthermore, we have established a dedicated resource GitHub page (https://github.com/juyongjiang/CodeLLMSurvey) to continuously document and disseminate the most recent advances in the field.

cs.CL↗