arXiv subjects

Hui Li

Publications and source records attributed to Hui Li.

At least 307 records · Page 17Linked to original sources

arXiv2025

PediaBench: A Comprehensive Chinese Pediatric Dataset for Benchmarking Large Language Models

The emergence of Large Language Models (LLMs) in the medical domain has stressed a compelling need for standard datasets to evaluate their question-answering (QA) performance. Although there have been several benchmark datasets for medical QA, they either cover common knowledge across different departments or are specific to another department rather than pediatrics. Moreover, some of them are limited to objective questions and do not measure the generation capacity of LLMs. Therefore, they cannot comprehensively assess the QA ability of LLMs in pediatrics. To fill this gap, we construct PediaBench, the first Chinese pediatric dataset for LLM evaluation. Specifically, it contains 4,117 objective questions and 1,632 subjective questions spanning 12 pediatric disease groups. It adopts an integrated scoring criterion based on different difficulty levels to thoroughly assess the proficiency of an LLM in instruction following, knowledge understanding, clinical case analysis, etc. Finally, we validate the effectiveness of PediaBench with extensive experiments on 20 open-source and commercial LLMs. Through an in-depth analysis of experimental results, we offer insights into the ability of LLMs to answer pediatric questions in the Chinese context, highlighting their limitations for further improvements. Our code and data are published at https://github.com/ACMISLab/PediaBench.

cs.CL↗

arXiv2025

Multimodal Quantitative Language for Generative Recommendation

Generative recommendation has emerged as a promising paradigm aiming at directly generating the identifiers of the target candidates. Most existing methods attempt to leverage prior knowledge embedded in Pre-trained Language Models (PLMs) to improve the recommendation performance. However, they often fail to accommodate the differences between the general linguistic knowledge of PLMs and the specific needs of recommendation systems. Moreover, they rarely consider the complementary knowledge between the multimodal information of items, which represents the multi-faceted preferences of users. To facilitate efficient recommendation knowledge transfer, we propose a novel approach called Multimodal Quantitative Language for Generative Recommendation (MQL4GRec). Our key idea is to transform items from different domains and modalities into a unified language, which can serve as a bridge for transferring recommendation knowledge. Specifically, we first introduce quantitative translators to convert the text and image content of items from various domains into a new and concise language, known as quantitative language, with all items sharing the same vocabulary. Then, we design a series of quantitative language generation tasks to enrich quantitative language with semantic information and prior knowledge. Finally, we achieve the transfer of recommendation knowledge from different domains and modalities to the recommendation task through pre-training and fine-tuning. We evaluate the effectiveness of MQL4GRec through extensive experiments and comparisons with existing methods, achieving improvements over the baseline by 11.18\%, 14.82\%, and 7.95\% on the NDCG metric across three different datasets, respectively.

cs.IR↗

arXiv2025

Code Membership Inference for Detecting Unauthorized Data Use in Code Pre-trained Language Models

Code pre-trained language models (CPLMs) have received great attention since they can benefit various tasks that facilitate software development and maintenance. However, CPLMs are trained on massive open-source code, raising concerns about potential data infringement. This paper launches the study of detecting unauthorized code use in CPLMs, i.e., Code Membership Inference (CMI) task. We design a framework Buzzer for different settings of CMI. Buzzer deploys several inference techniques, including signal extraction from pre-training tasks, hard-to-learn sample calibration and weighted inference, to identify code membership status accurately. Extensive experiments show that CMI can be achieved with high accuracy using Buzzer. Hence, Buzzer can serve as a CMI tool and help protect intellectual property rights.

cs.SE↗

arXiv2025

DeepSeek-V3 Technical Report

We present DeepSeek-V3, a strong Mixture-of-Experts (MoE) language model with 671B total parameters with 37B activated for each token. To achieve efficient inference and cost-effective training, DeepSeek-V3 adopts Multi-head Latent Attention (MLA) and DeepSeekMoE architectures, which were thoroughly validated in DeepSeek-V2. Furthermore, DeepSeek-V3 pioneers an auxiliary-loss-free strategy for load balancing and sets a multi-token prediction training objective for stronger performance. We pre-train DeepSeek-V3 on 14.8 trillion diverse and high-quality tokens, followed by Supervised Fine-Tuning and Reinforcement Learning stages to fully harness its capabilities. Comprehensive evaluations reveal that DeepSeek-V3 outperforms other open-source models and achieves performance comparable to leading closed-source models. Despite its excellent performance, DeepSeek-V3 requires only 2.788M H800 GPU hours for its full training. In addition, its training process is remarkably stable. Throughout the entire training process, we did not experience any irrecoverable loss spikes or perform any rollbacks. The model checkpoints are available at https://github.com/deepseek-ai/DeepSeek-V3.

cs.CL↗

arXiv2025

Application of Many-body Non-perturbative Theories to the Three-Dimensional Attractive Hubbard Model

The attractive Fermi-Hubbard model stands out as a simple model for studying the pairing and superconductivity of fermions on a lattice. In this article, we apply several many-body theories in the three-dimensional attractive Hubbard model. Specifically, we compare the results of various GW methods with DQMC simulations and observe that they provide reliable results in the weak to intermediate coupling regime. The critical exponents also agree well with the accurate results obtained from the 3D XY model. In the superconducting phase, the post-GW method significantly improves the description of Green's functions and density of states. Additionally, we propose a method to determine the temperature at which the pseudogap appears.

cond-mat.str-el↗

arXiv2025

G$^2$V$^2$former: Graph Guided Video Vision Transformer for Face Anti-Spoofing

In videos containing spoofed faces, we may uncover the spoofing evidence based on either photometric or dynamic abnormality, even a combination of both. Prevailing face anti-spoofing (FAS) approaches generally concentrate on the single-frame scenario, however, purely photometric-driven methods overlook the dynamic spoofing clues that may be exposed over time. This may lead FAS systems to conclude incorrect judgments, especially in cases where it is easily distinguishable in terms of dynamics but challenging to discern in terms of photometrics. To this end, we propose the Graph Guided Video Vision Transformer (G$^2$V$^2$former), which combines faces with facial landmarks for photometric and dynamic feature fusion. We factorize the attention into space and time, and fuse them via a spatiotemporal block. Specifically, we design a novel temporal attention called Kronecker temporal attention, which has a wider receptive field, and is beneficial for capturing dynamic information. Moreover, we leverage the low-semantic motion of facial landmarks to guide the high-semantic change of facial expressions based on the motivation that regions containing landmarks may reveal more dynamic clues. Extensive experiments on nine benchmark datasets demonstrate that our method achieves superior performance under various scenarios. The codes will be released soon.

cs.CV↗

arXiv2025

Enhancing Security and Privacy in Federated Learning using Low-Dimensional Update Representation and Proximity-Based Defense

Federated Learning (FL) is a promising privacy-preserving machine learning paradigm that allows data owners to collaboratively train models while keeping their data localized. Despite its potential, FL faces challenges related to the trustworthiness of both clients and servers, particularly against curious or malicious adversaries. In this paper, we introduce a novel framework named \underline{F}ederated \underline{L}earning with Low-Dimensional \underline{U}pdate \underline{R}epresentation and \underline{P}roximity-Based defense (FLURP), designed to address privacy preservation and resistance to Byzantine attacks in distributed learning environments. FLURP employs $\mathsf{LinfSample}$ method, enabling clients to compute the $l_{\infty}$ norm across sliding windows of updates, resulting in a Low-Dimensional Update Representation (LUR). Calculating the shared distance matrix among LURs, rather than updates, significantly reduces the overhead of Secure Multi-Party Computation (SMPC) by three orders of magnitude while effectively distinguishing between benign and poisoned updates. Additionally, FLURP integrates a privacy-preserving proximity-based defense mechanism utilizing optimized SMPC protocols to minimize communication rounds. Our experiments demonstrate FLURP's effectiveness in countering Byzantine adversaries with low communication and runtime overhead. FLURP offers a scalable framework for secure and reliable FL in distributed environments, facilitating its application in scenarios requiring robust data management and security.

cs.CR↗

arXiv2025

Kronecker Mask and Interpretive Prompts are Language-Action Video Learners

Contrastive language-image pretraining (CLIP) has significantly advanced image-based vision learning. A pressing topic subsequently arises: how can we effectively adapt CLIP to the video domain? Recent studies have focused on adjusting either the textual or visual branch of CLIP for action recognition. However, we argue that adaptations of both branches are crucial. In this paper, we propose \textbf{CLAVER}: a \textbf{C}ontrastive \textbf{L}anguage-\textbf{A}ction \textbf{V}ideo Learn\textbf{er}, designed to shift CLIP's focus from the alignment of static visual objects and concrete nouns to the alignment of dynamic action behaviors and abstract verbs. Specifically, we introduce a novel Kronecker mask attention for temporal modeling. Our tailored Kronecker mask offers three benefits 1) it expands the temporal receptive field for each token, 2) it serves as an effective spatiotemporal heterogeneity inductive bias, mitigating the issue of spatiotemporal homogenization, and 3) it can be seamlessly plugged into transformer-based models. Regarding the textual branch, we leverage large language models to generate diverse, sentence-level and semantically rich interpretive prompts of actions, which shift the model's focus towards the verb comprehension. Extensive experiments on various benchmarks and learning scenarios demonstrate the superiority and generality of our approach.

cs.CV↗

arXiv2025

Two Channels of Metal-Rich Compact Stellar System Formation: Starbursts under High Ram Pressure versus Tidal Stripping

Most galaxies follow well-defined scaling relations of metallicity and stellar mass; however, some outliers at the low mass end of the observed galaxy population exhibit unusually high metallicity for their mass. Understanding how these objects get to be so metal-rich is vital for understanding the role of feedback in galaxy formation. Using the TNG50 simulation, we explore the origins of this phenomenon. We identify 227 metal-rich, compact stellar systems (CSSs) that deviate significantly from this scaling relation. These CSSs are satellites located in the vicinity of massive host galaxies, with stellar masses ranging from $10^{8} M_{\odot}$ to $10^{10}\ M_{\odot}$ (including six systems that are close analogs of the M31-M32 system). Contrary to the previously assumed scenario that such objects are predominantly products of tidal stripping, our results suggest a more prevalent role for ram pressure in their formation. Indeed, 76% (173) of these CSSs are formed through a burst of star formation occurring around the time of the first pericentric passage, typically at redshifts $z\lesssim1$, aided by strong ram pressure and tidal forces. The high ram pressure, resulting from the CSSs' rapid motion near the halo center, facilitates metal enrichment, producing high-metallicity CSSs by confining the metal-rich gas from bursty star formation, which leads to distinct stellar populations characterized by enhanced metallicity as well as high $α$-abundance. Only the remaining 24% (54) of metal-rich CSSs are generated through the tidal stripping of massive progenitors. Our results further indicate that M32 is more likely to have formed through intense star formation events rather than through gradual, tidal stripping, thereby providing crucial insights into the nature of low mass, compact galaxy formation.

astro-ph.GA↗

arXiv2025

Stellar streams reveal the mass loss of globular clusters

Globular cluster (GC) streams, debris of stars that tidally stripped from their progenitor GCs, have densities that correlate positively with the GC mass loss rate. In this work, we employ a novel particle spray algorithm that can accurately reproduce the morphology of streams of various orbital types, enabling us to uncover the relationship between the GC mass loss history and stream density profiles. Using recent discoveries of GC streams from Gaia DR3, we present, for the first time, a catalog of directly observed mass loss rates for 12 Galactic GCs, ranging from 0.5 to 200 $\rm M_\odot\,Myr^{-1}$. By fitting power-law relations between mass loss rate and key GC properties, we identify positive correlations with GC mass and orbital frequency, consistent with the predictions from N-body simulations.

astro-ph.GA↗

arXiv2025

Ferroelectricity in undoped HfO2 down to one-unit-cell on Si substrate

Hafnium oxide (HfO2), particularly at low-dimensional scales, exhibits extensive promising applications in ultrahigh density devices like low-power logic and non-volatile memory devices due to its compatibility with current semiconductor technology1-5. However, achieving ferroelectricity (FE) at ultimate scale especially in undoped HfO2 remains challenging as the non-centrosymmetric FE phase, so-called O-III (space group: Pca21) is metastable and FE has a strong tendency of depolarization with the decrease in thickness6. Up to now, this phase has usually stabilized via doping with other elements7-9. But the minimum film thickness is still limited to 1 nm, about 2-unit-cell, to keep FE8. Thinner and undoped films, conducive to further miniature device size and avoid contamination during deposition process, have been a challenge to fabricate on Si substrates. Herein, we report the robust FE observed in undoped HfO2 ultrathin films directly grown on Si substrate via atomic layer deposition (ALD) and post-heat treat in vacuum. The so-fabricated ferroelectric O-III phase contains about 4.48 at% oxygen vacancy, is robust even monoclinic phase (space group: P21/c) coexists. The spontaneous and switchable polarization is remarkably stable, still surviving even in films down to 0.5 nm (one-unit-cell). Our results show the robust FE O-III phase can be obtained in films down to one-unit-cell in thickness on Si, providing a practical way to fabricating this important material in thickness limit.

cond-mat.mtrl-sci↗

arXiv2025

Stability threshold of the two-dimensional Couette flow in the whole plane

In this paper, we study the stability threshold for the two-dimensional Couette flow in the whole plane. Our main result establishes that the asymptotic stability threshold is at most $\frac{1}{3}+$ for Sobolev perturbations with additional control over low horizontal frequencies, aligning with the threshold results in periodic domains. As a secondary outcome of our approach, we also prove the asymptotic stability for perturbations in weak Sobolev regularity with size $ν^{\frac{1}{2}}$.

math.AP↗

arXiv2025

FramePainter: Endowing Interactive Image Editing with Video Diffusion Priors

Interactive image editing allows users to modify images through visual interaction operations such as drawing, clicking, and dragging. Existing methods construct such supervision signals from videos, as they capture how objects change with various physical interactions. However, these models are usually built upon text-to-image diffusion models, so necessitate (i) massive training samples and (ii) an additional reference encoder to learn real-world dynamics and visual consistency. In this paper, we reformulate this task as an image-to-video generation problem, so that inherit powerful video diffusion priors to reduce training costs and ensure temporal consistency. Specifically, we introduce FramePainter as an efficient instantiation of this formulation. Initialized with Stable Video Diffusion, it only uses a lightweight sparse control encoder to inject editing signals. Considering the limitations of temporal attention in handling large motion between two frames, we further propose matching attention to enlarge the receptive field while encouraging dense correspondence between edited and source image tokens. We highlight the effectiveness and efficiency of FramePainter across various of editing signals: it domainantly outperforms previous state-of-the-art methods with far less training data, achieving highly seamless and coherent editing of images, \eg, automatically adjust the reflection of the cup. Moreover, FramePainter also exhibits exceptional generalization in scenarios not present in real-world videos, \eg, transform the clownfish into shark-like shape. Our code will be available at https://github.com/YBYBZhang/FramePainter.

cs.CV↗

arXiv2025

Towards Lightweight Time Series Forecasting: a Patch-wise Transformer with Weak Data Enriching

Patch-wise Transformer based time series forecasting achieves superior accuracy. However, this superiority relies heavily on intricate model design with massive parameters, rendering both training and inference expensive, thus preventing their deployments on edge devices with limited resources and low latency requirements. In addition, existing methods often work in an autoregressive manner, which take into account only historical values, but ignore valuable, easy-to-obtain context information, such as weather forecasts, date and time of day. To contend with the two limitations, we propose LiPFormer, a novel Lightweight Patch-wise Transformer with weak data enriching. First, to simplify the Transformer backbone, LiPFormer employs a novel lightweight cross-patch attention and a linear transformation-based attention to eliminate Layer Normalization and Feed Forward Network, two heavy components in existing Transformers. Second, we propose a lightweight, weak data enriching module to provide additional, valuable weak supervision to the training. It enhances forecasting accuracy without significantly increasing model complexity as it does not involve expensive, human-labeling but using easily accessible context information. This facilitates the weak data enriching to plug-and-play on existing models. Extensive experiments on nine benchmark time series datasets demonstrate that LiPFormer outperforms state-of-the-art methods in accuracy, while significantly reducing parameter scale, training duration, and GPU memory usage. Deployment on an edge device reveals that LiPFormer takes only 1/3 inference time compared to classic Transformers. In addition, we demonstrate that the weak data enriching can integrate seamlessly into various Transformer based models to enhance their accuracy, suggesting its generality.

cs.LG↗

arXiv2025

Atomic-resolution structural and spectroscopic evidence for the synthetic realization of two-dimensional copper boride

Since the first realization of borophene on Ag(111), two-dimensional (2D) boron nanomaterials have attracted significant interest due to their polymorphic diversity and potential for hosting solid-state quantum phenomena. Here, we use atomic-resolution scanning tunneling microscopy (STM) and field-emission resonance (FER) spectroscopy to elucidate the structure and properties of atomically thin boron phases grown on Cu(111). Specifically, FER spectroscopy reveals unique charge transfer and electronic states compared to the distinct borophene phases observed on silver, suggesting that the deposition of boron on copper can result in strong covalent bonding characteristic of a 2D copper boride. This conclusion is reinforced by detailed STM characterization of line defects that are consistent with density functional theory (DFT) calculations for atomically thin Cu8B14. This evidence for 2D copper boride is likely to motivate future synthetic efforts aimed at expanding the relatively unexplored family of atomically thin metal boride materials.

cond-mat.mtrl-sci↗

arXiv2025

Disentangling Cation-Polyanion Coupling in Solid Electrolytes: Which Anion Motion Dominates Cation Transport?

Lithium and sodium solid electrolytes feature polyanion frameworks and highly mobile cations. Understanding and quantifying the impact of polyanion dynamics on cations will help us to unravel the complex role that anion play in superionic conductors. However, no experimental or computational method can directly extract this information, as polyanion dynamics are always coupled with other factors that affect ion mobility. Here, we present the pioneering study that combines constraint algorithm and machine-learning molecular dynamics to quantitatively reveal the effects of polyanion translation, rotation, and vibration on cation mobility across a diverse material class. Ultralong-time, large-scale machine-learning molecular dynamics simulations with selective constraints on each anion motion mode unequivocally yield results at near room and elevated temperatures. In sharp contrast to the previous understanding that facile anion rotation primarily facilitates cation transport, the strong coupling between anion translation and vibration with cation diffusion has been unraveled for the first time; we find that translation, rotation, and vibration can each directly drive superionicity, with one typically dominant in each class of materials. Anion rotation dominates cation transport when the rotation frequency matches the cation hopping frequency, whereas anion translation prevails at higher and vibration at lower rotation frequencies. The impact of anion dynamics on cation diffusion becomes more prominent at lower temperatures.

physics.chem-ph↗

arXiv2025

OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation

Recent advancements in visual generation technologies have markedly increased the scale and availability of video datasets, which are crucial for training effective video generation models. However, a significant lack of high-quality, human-centric video datasets presents a challenge to progress in this field. To bridge this gap, we introduce OpenHumanVid, a large-scale and high-quality human-centric video dataset characterized by precise and detailed captions that encompass both human appearance and motion states, along with supplementary human motion conditions, including skeleton sequences and speech audio. To validate the efficacy of this dataset and the associated training strategies, we propose an extension of existing classical diffusion transformer architectures and conduct further pretraining of our models on the proposed dataset. Our findings yield two critical insights: First, the incorporation of a large-scale, high-quality dataset substantially enhances evaluation metrics for generated human videos while preserving performance in general video generation tasks. Second, the effective alignment of text with human appearance, human motion, and facial motion is essential for producing high-quality video outputs. Based on these insights and corresponding methodologies, the straightforward extended network trained on the proposed dataset demonstrates an obvious improvement in the generation of human-centric videos. Project page https://fudan-generative-vision.github.io/OpenHumanVid

cs.CV↗

arXiv2024

Improving image quality of the Solar Disk Imager (SDI) of the Lyman-alpha Solar Telescope (LST) onboard the ASO-S mission

The in-flight calibration and performance of the Solar Disk Imager (SDI), which is a pivotal instrument of the Lyman-alpha Solar Telescope (LST) onboard the Advanced Space-based Solar Observatory (ASO-S) mission, suggested a much lower spatial resolution than expected. In this paper, we developed the SDI point-spread function (PSF) and Image Bivariate Optimization Algorithm (SPIBOA) to improve the quality of SDI images. The bivariate optimization method smartly combines deep learning with optical system modeling. Despite the lack of information about the real image taken by SDI and the optical system function, this algorithm effectively estimates the PSF of the SDI imaging system directly from a large sample of observational data. We use the estimated PSF to conduct deconvolution correction to observed SDI images, and the resulting images show that the spatial resolution after correction has increased by a factor of more than three with respect to the observed ones. Meanwhile, our method also significantly reduces the inherent noise in the observed SDI images. The SPIBOA has now been successfully integrated into the routine SDI data processing, providing important support for the scientific studies based on the data. The development and application of SPIBOA also pave new ways to identify astronomical telescope systems and enhance observational image quality. Some essential factors and precautions in applying the SPIBOA method are also discussed.

astro-ph.SR↗