arXiv subjects

Guangyu Wang

Publications and source records attributed to Guangyu Wang.

At least 55 records · Page 3Linked to original sources

arXiv2025

Estimating LLM Uncertainty with Evidence

Over the past few years, Large Language Models (LLMs) have developed rapidly and are widely applied in various domains. However, LLMs face the issue of hallucinations, generating responses that may be unreliable when the models lack relevant knowledge. To be aware of potential hallucinations, uncertainty estimation methods have been introduced, and most of them have confirmed that reliability lies in critical tokens. However, probability-based methods perform poorly in identifying token reliability, limiting their practical utility. In this paper, we reveal that the probability-based method fails to estimate token reliability due to the loss of evidence strength information which is accumulated in the training stage. Therefore, we present Logits-induced token uncertainty (LogTokU), a framework for estimating decoupled token uncertainty in LLMs, enabling real-time uncertainty estimation without requiring multiple sampling processes. We employ evidence modeling to implement LogTokU and use the estimated uncertainty to guide downstream tasks. The experimental results demonstrate that LogTokU has significant effectiveness and promise.

cs.CL↗

arXiv2025

scDrugMap: Benchmarking Large Foundation Models for Drug Response Prediction

Drug resistance presents a major challenge in cancer therapy. Single cell profiling offers insights into cellular heterogeneity, yet the application of large-scale foundation models for predicting drug response in single cell data remains underexplored. To address this, we developed scDrugMap, an integrated framework featuring both a Python command-line interface and a web server for drug response prediction. scDrugMap evaluates a wide range of foundation models, including eight single-cell models and two large language models, using a curated dataset of over 326,000 cells in the primary collection and 18,800 cells in the validation set, spanning 36 datasets and diverse tissue and cancer types. We benchmarked model performance under pooled-data and cross-data evaluation settings, employing both layer freezing and Low-Rank Adaptation (LoRA) fine-tuning strategies. In the pooled-data scenario, scFoundation achieved the best performance, with mean F1 scores of 0.971 (layer freezing) and 0.947 (fine-tuning), outperforming the lowest-performing model by over 50%. In the cross-data setting, UCE excelled post fine-tuning (mean F1: 0.774), while scGPT led in zero-shot learning (mean F1: 0.858). Overall, scDrugMap provides the first large-scale benchmark of foundation models for drug response prediction in single-cell data and serves as a user-friendly, flexible platform for advancing drug discovery and translational research.

cs.AI↗

arXiv2025

HECLIP: Histology-Enhanced Contrastive Learning for Imputation of Transcriptomics Profiles

Histopathology, particularly hematoxylin and eosin (H\&E) staining, plays a critical role in diagnosing and characterizing pathological conditions by highlighting tissue morphology. However, H\&E-stained images inherently lack molecular information, requiring costly and resource-intensive methods like spatial transcriptomics to map gene expression with spatial resolution. To address these challenges, we introduce HECLIP (Histology-Enhanced Contrastive Learning for Imputation of Profiles), an innovative deep learning framework that bridges the gap between histological imaging and molecular profiling. HECLIP is specifically designed to infer gene expression profiles directly from H\&E-stained images, eliminating the need for expensive spatial transcriptomics assays. HECLIP leverages an advanced image-centric contrastive loss function to optimize image representation learning, ensuring that critical morphological patterns in histology images are effectively captured and translated into accurate gene expression profiles. This design enhances the predictive power of the image modality while minimizing reliance on gene expression data. Through extensive benchmarking on publicly available datasets, HECLIP demonstrates superior performance compared to existing approaches, delivering robust and biologically meaningful predictions. Detailed ablation studies further underscore its effectiveness in extracting molecular insights from histology images. Additionally, HECLIP's scalable and cost-efficient approach positions it as a transformative tool for both research and clinical applications, driving advancements in precision medicine. The source code for HECLIP is openly available at https://github.com/QSong-github/HECLIP.

cs.CE↗

arXiv2025

CoPRA: Bridging Cross-domain Pretrained Sequence Models with Complex Structures for Protein-RNA Binding Affinity Prediction

Accurately measuring protein-RNA binding affinity is crucial in many biological processes and drug design. Previous computational methods for protein-RNA binding affinity prediction rely on either sequence or structure features, unable to capture the binding mechanisms comprehensively. The recent emerging pre-trained language models trained on massive unsupervised sequences of protein and RNA have shown strong representation ability for various in-domain downstream tasks, including binding site prediction. However, applying different-domain language models collaboratively for complex-level tasks remains unexplored. In this paper, we propose CoPRA to bridge pre-trained language models from different biological domains via Complex structure for Protein-RNA binding Affinity prediction. We demonstrate for the first time that cross-biological modal language models can collaborate to improve binding affinity prediction. We propose a Co-Former to combine the cross-modal sequence and structure information and a bi-scope pre-training strategy for improving Co-Former's interaction understanding. Meanwhile, we build the largest protein-RNA binding affinity dataset PRA310 for performance evaluation. We also test our model on a public dataset for mutation effect prediction. CoPRA reaches state-of-the-art performance on all the datasets. We provide extensive analyses and verify that CoPRA can (1) accurately predict the protein-RNA binding affinity; (2) understand the binding affinity change caused by mutations; and (3) benefit from scaling data and model size.

q-bio.BM↗

arXiv2024

A Time Series is Worth Five Experts: Heterogeneous Mixture of Experts for Traffic Flow Prediction

Accurate traffic prediction faces significant challenges, necessitating a deep understanding of both temporal and spatial cues and their complex interactions across multiple variables. Recent advancements in traffic prediction systems are primarily due to the development of complex sequence-centric models. However, existing approaches often embed multiple variables and spatial relationships at each time step, which may hinder effective variable-centric learning, ultimately leading to performance degradation in traditional traffic prediction tasks. To overcome these limitations, we introduce variable-centric and prior knowledge-centric modeling techniques. Specifically, we propose a Heterogeneous Mixture of Experts (TITAN) model for traffic flow prediction. TITAN initially consists of three experts focused on sequence-centric modeling. Then, designed a low-rank adaptive method, TITAN simultaneously enables variable-centric modeling. Furthermore, we supervise the gating process using a prior knowledge-centric modeling strategy to ensure accurate routing. Experiments on two public traffic network datasets, METR-LA and PEMS-BAY, demonstrate that TITAN effectively captures variable-centric dependencies while ensuring accurate routing. Consequently, it achieves improvements in all evaluation metrics, ranging from approximately 4.37\% to 11.53\%, compared to previous state-of-the-art (SOTA) models. The code is open at \href{https://github.com/sqlcow/TITAN}{https://github.com/sqlcow/TITAN}.

cs.AI↗

arXiv2024

I-MedSAM: Implicit Medical Image Segmentation with Segment Anything

With the development of Deep Neural Networks (DNNs), many efforts have been made to handle medical image segmentation. Traditional methods such as nnUNet train specific segmentation models on the individual datasets. Plenty of recent methods have been proposed to adapt the foundational Segment Anything Model (SAM) to medical image segmentation. However, they still focus on discrete representations to generate pixel-wise predictions, which are spatially inflexible and scale poorly to higher resolution. In contrast, implicit methods learn continuous representations for segmentation, which is crucial for medical image segmentation. In this paper, we propose I-MedSAM, which leverages the benefits of both continuous representations and SAM, to obtain better cross-domain ability and accurate boundary delineation. Since medical image segmentation needs to predict detailed segmentation boundaries, we designed a novel adapter to enhance the SAM features with high-frequency information during Parameter-Efficient Fine-Tuning (PEFT). To convert the SAM features and coordinates into continuous segmentation output, we utilize Implicit Neural Representation (INR) to learn an implicit segmentation decoder. We also propose an uncertainty-guided sampling strategy for efficient learning of INR. Extensive evaluations on 2D medical image segmentation tasks have shown that our proposed method with only 1.6M trainable parameters outperforms existing methods including discrete and implicit methods. The code will be available at: https://github.com/ucwxb/I-MedSAM.

cs.CV↗

arXiv2024

MoVL:Exploring Fusion Strategies for the Domain-Adaptive Application of Pretrained Models in Medical Imaging Tasks

Medical images are often more difficult to acquire than natural images due to the specialism of the equipment and technology, which leads to less medical image datasets. So it is hard to train a strong pretrained medical vision model. How to make the best of natural pretrained vision model and adapt in medical domain still pends. For image classification, a popular method is linear probe (LP). However, LP only considers the output after feature extraction. Yet, there exists a gap between input medical images and natural pretrained vision model. We introduce visual prompting (VP) to fill in the gap, and analyze the strategies of coupling between LP and VP. We design a joint learning loss function containing categorisation loss and discrepancy loss, which describe the variance of prompted and plain images, naming this joint training strategy MoVL (Mixture of Visual Prompting and Linear Probe). We experiment on 4 medical image classification datasets, with two mainstream architectures, ResNet and CLIP. Results shows that without changing the parameters and architecture of backbone model and with less parameters, there is potential for MoVL to achieve full finetune (FF) accuracy (on four medical datasets, average 90.91% for MoVL and 91.13% for FF). On out of distribution medical dataset, our method(90.33%) can outperform FF (85.15%) with absolute 5.18 % lead.

cs.CV↗

arXiv2024

XScale-NVS: Cross-Scale Novel View Synthesis with Hash Featurized Manifold

We propose XScale-NVS for high-fidelity cross-scale novel view synthesis of real-world large-scale scenes. Existing representations based on explicit surface suffer from discretization resolution or UV distortion, while implicit volumetric representations lack scalability for large scenes due to the dispersed weight distribution and surface ambiguity. In light of the above challenges, we introduce hash featurized manifold, a novel hash-based featurization coupled with a deferred neural rendering framework. This approach fully unlocks the expressivity of the representation by explicitly concentrating the hash entries on the 2D manifold, thus effectively representing highly detailed contents independent of the discretization resolution. We also introduce a novel dataset, namely GigaNVS, to benchmark cross-scale, high-resolution novel view synthesis of realworld large-scale scenes. Our method significantly outperforms competing baselines on various real-world scenes, yielding an average LPIPS that is 40% lower than prior state-of-the-art on the challenging GigaNVS benchmark. Please see our project page at: xscalenvs.github.io.

cs.CV↗

arXiv2024

A Comprehensive Dataset and Automated Pipeline for Nailfold Capillary Analysis

Nailfold capillaroscopy is widely used in assessing health conditions, highlighting the pressing need for an automated nailfold capillary analysis system. In this study, we present a pioneering effort in constructing a comprehensive nailfold capillary dataset-321 images, 219 videos from 68 subjects, with clinic reports and expert annotations-that serves as a crucial resource for training deep-learning models. Leveraging this dataset, we finetuned three deep learning models with expert annotations as supervised labels and integrated them into a novel end-to-end nailfold capillary analysis pipeline. This pipeline excels in automatically detecting and measuring a wide range of size factors, morphological features, and dynamic aspects of nailfold capillaries. We compared our outcomes with clinical reports. Experiment results showed that our automated pipeline achieves an average of sub-pixel level precision in measurements and 89.9% accuracy in identifying morphological abnormalities. These results underscore its potential for advancing quantitative medical research and enabling pervasive computing in healthcare. Our data and code are available at https://github.com/THU-CS-PI-LAB/ANFC-Automated-Nailfold-Capillary.

eess.IV↗

arXiv2024

Superexchange interactions and magnetic anisotropy in MnPSe$_3$ monolayer

Two-dimensional van der Waals magnetic materials are of great current interest for their promising applications in spintronics. In this work, using density functional theory calculations in combination with the maximally localized Wannier functions method and the magnetic anisotropy analyses, we study the electronic and magnetic properties of MnPSe$_3$ monolayer. Our results show that it is a charge transfer antiferromagnetic (AF) insulator. For this Mn$^{2+}$ $3d^5$ system, although it seems straightforward to explain the AF ground state using the direct exchange, we find that the near 90$^\circ$ Mn-Se-Mn charge transfer type superexchange plays a dominant role in stabilizing the AF ground state. Moreover, our results indicate that although the shape anisotropy favors an out-of-plane spin orientation, the spin-orbit coupling (SOC) leads to the experimentally observed in-plane spin orientation. We prove that the actual dominant contribution to the magnetic anisotropy comes from the second-order perturbation of the SOC, by analyzing its distribution over the reciprocal space. Using the AF exchange and anisotropy parameters obtained from our calculations, our Monte Carlo simulations give the Néel temperature $T_{\rm N}=47$ K for MnPSe$_3$ monolayer, which agrees with the experimental 40 K. Furthermore, our calculations show that under a uniaxial tensile (compressive) strain, Néel vector would be parallel (perpendicular) to the strain direction, which well reproduces the recent experiments. We also predict that $T_{\rm N}$ would be increased by a compressive strain.

cond-mat.mtrl-sci↗

arXiv2023

TCM-GPT: Efficient Pre-training of Large Language Models for Domain Adaptation in Traditional Chinese Medicine

Pre-training and fine-tuning have emerged as a promising paradigm across various natural language processing (NLP) tasks. The effectiveness of pretrained large language models (LLM) has witnessed further enhancement, holding potential for applications in the field of medicine, particularly in the context of Traditional Chinese Medicine (TCM). However, the application of these general models to specific domains often yields suboptimal results, primarily due to challenges like lack of domain knowledge, unique objectives, and computational efficiency. Furthermore, their effectiveness in specialized domains, such as Traditional Chinese Medicine, requires comprehensive evaluation. To address the above issues, we propose a novel domain specific TCMDA (TCM Domain Adaptation) approach, efficient pre-training with domain-specific corpus. Specifically, we first construct a large TCM-specific corpus, TCM-Corpus-1B, by identifying domain keywords and retreving from general corpus. Then, our TCMDA leverages the LoRA which freezes the pretrained model's weights and uses rank decomposition matrices to efficiently train specific dense layers for pre-training and fine-tuning, efficiently aligning the model with TCM-related tasks, namely TCM-GPT-7B. We further conducted extensive experiments on two TCM tasks, including TCM examination and TCM diagnosis. TCM-GPT-7B archived the best performance across both datasets, outperforming other models by relative increments of 17% and 12% in accuracy, respectively. To the best of our knowledge, our study represents the pioneering validation of domain adaptation of a large language model with 7 billion parameters in TCM domain. We will release both TCMCorpus-1B and TCM-GPT-7B model once accepted to facilitate interdisciplinary development in TCM and NLP, serving as the foundation for further study.

cs.CL↗

arXiv2023

ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in medical applications is limited, due to challenges such as factual inaccuracies, reasoning abilities, and lack grounding in real-world experience. In this study, we present ClinicalGPT, a language model explicitly designed and optimized for clinical scenarios. By incorporating extensive and diverse real-world data, such as medical records, domain-specific knowledge, and multi-round dialogue consultations in the training process, ClinicalGPT is better prepared to handle multiple clinical task. Furthermore, we introduce a comprehensive evaluation framework that includes medical knowledge question-answering, medical exams, patient consultations, and diagnostic analysis of medical records. Our results demonstrate that ClinicalGPT significantly outperforms other models in these tasks, highlighting the effectiveness of our approach in adapting large language models to the critical domain of healthcare.

cs.CL↗

arXiv2023

Contrasting electronic states of RuI3 and RuCl3

The spin-orbital entangled states are of great interest as they hold exotic phases and intriguing properties. Here we use first-principles calculations to investigate the electronic and magnetic properties of RuI$_{3}$ and RuCl$_{3}$ in both bulk and monolayer cases. Our results show that RuI$_{3}$ bulk is a paramagnetic metal, which is in agreement with recent experiments. We find that the Ru$^{3+}$ ion of RuI$_{3}$ is in the spin-orbital entangled $j_{\rm eff}=\frac{1}{2}$ state. More interestingly, a metal-insulator transition occurs from RuI$_{3}$ bulk to monolayer, and this is mainly due to the band narrowing with the decreasing lattice dimensionality and to the Ru-I hybridization altered by the I $5p$ spin-orbit coupling. In contrast, RuCl$_{3}$ bulk and monolayer both show Mott-insulating behavior, the Ru$^{3+}$ ion is in the formal $S=\frac{1}{2}$ and $L=1$ state with a large in-plane orbital moment, and this result well explains the experimental large effective magnetic moment of RuCl$_{3}$ and the strong in-plane magnetization. The present work demonstrates the contrasting spin-orbital states and the varying properties of RuI$_{3}$ and RuCl$_{3}$.

cond-mat.str-el↗

arXiv2022

Self adaptive global-local feature enhancement for radiology report generation

Automated radiology report generation aims at automatically generating a detailed description of medical images, which can greatly alleviate the workload of radiologists and provide better medical services to remote areas. Most existing works pay attention to the holistic impression of medical images, failing to utilize important anatomy information. However, in actual clinical practice, radiologists usually locate important anatomical structures, and then look for signs of abnormalities in certain structures and reason the underlying disease. In this paper, we propose a novel framework AGFNet to dynamically fuse the global and anatomy region feature to generate multi-grained radiology report. Firstly, we extract important anatomy region features and global features of input Chest X-ray (CXR). Then, with the region features and the global features as input, our proposed self-adaptive fusion gate module could dynamically fuse multi-granularity information. Finally, the captioning generator generates the radiology reports through multi-granularity features. Experiment results illustrate that our model achieved the state-of-the-art performance on two benchmark datasets including the IU X-Ray and MIMIC-CXR. Further analyses also prove that our model is able to leverage the multi-grained information from radiology images and texts so as to help generate more accurate reports.

cs.CV↗

arXiv2022

Spin-Orbital States and Strong Antiferromagnetism of Layered Eu$_2$SrFe$_2$O$_6$ and Sr$_3$Fe$_2$O$_4$Cl$_2$

The insulating iron compounds Eu$_2$SrFe$_2$O$_6$ and Sr$_3$Fe$_2$O$_4$Cl$_2$ have high-temperature antiferromagnetic (AF) order despite their different layered structures. Here we carry out density functional calculations and Monte Carlo simulations to study their electronic structures and magnetic properties aided with analyses of the crystal field, magnetic anisotropy, and superexchange. We find that both compounds are Mott insulators and in the high-spin (HS) Fe$^{2+}$ state ($S$ = 2) accompanied by the weakened crystal field. Although they have different local coordination and crystal fields, the Fe$^{2+}$ ions have the same level sequence and ground-state configuration $(3z^2-r^2)^2(xz,yz)^2(xy)^1(x^2-y^2)^1$. Then, the multiorbital superexchange produces strong AF couplings, and the $(3z^2-r^2)/(xz,yz)$ mixing via the spin-orbit coupling (SOC) yields a small in-plane orbital moment and anisotropy. Indeed, by tracing a set of different spin-orbital states, our density functional calculations confirm the strong AF couplings and the easy planar magnetization for both compounds. Moreover, using the derived magnetic parameters, our Monte Carlo simulations give the Néel temperature $T_{\rm N}$ = 420 K (372 K) for the former (the latter), which well reproduce the experimental results. Therefore, the present study provides a unified picture for Eu$_2$SrFe$_2$O$_6$ and Sr$_3$Fe$_2$O$_4$Cl$_2$ concerning their electronic and magnetic properties.

cond-mat.str-el↗

arXiv2022

Magnetic frustration in the cubic double perovskite Ba2NiIrO6

Hybrid transition metal oxides continue to attract attention due to their multiple degrees of freedom ($e.g.$, lattice, charge, spin, and orbital) and versatile properties. Here we investigate the magnetic and electronic properties of the newly synthesized double perovskite Ba$_2$NiIrO$_6$, using crystal field theory, superexchange model analysis, density functional calculations, and parallel tempering Monte Carlo (PTMC) simulations. Our results indicate that Ba$_2$NiIrO$_6$ has the Ni$^{2+}$ ($t_{2g}^{6}e_{g}^{2}$)-Ir$^{6+}$ ($t_{2g}^{3}$) charge states. The first nearest-neighboring (1NN) Ni$^{2+}$-Ir$^{6+}$ ions prefer a ferromagnetic (FM) coupling as expected from the Goodenough-Kanamori-Anderson rules, which contradicts the experimental antiferromagnetic (AF) order in Ba$_2$NiIrO$_6$. We find that the strong 2NN AF couplings are frustrated in the fcc sublattices, and they play a major role in determining the observed AF ground state. We also prove that the $J_{\rm eff}$ = 3/2 and $J_{\rm eff}$ = 1/2 states induced by spin-orbit coupling, which would be manifested in low-dimensional (e.g., layered) iridates, are however not the case for cubic Ba$_2$NiIrO$_6$. Our PTMC simulations show that when the long-range (2NN and 3NN) AF interactions are included, an AF transition with $T_{\rm N}$ = 66 K would be obtained and it is well comparable with the experimental 51 K. Meanwhile, we propose a possible 2$\times$2$\times$2 noncollinear AF structure for Ba$_2$NiIrO$_6$.

cond-mat.str-el↗

arXiv2021

CrSbSe3: a pseudo one-dimensional ferromagnetic semiconductor

Low-dimensional magnetic materials have attracted much attention due to their novel properties and high potential for spintronic applications. In this work, we study the electronic structure and magnetic properties of the pseudo one-dimensional compound CrSbSe$_3$, using density functional calculations, superexchange model analyses, and Monte Carlo simulations. We find that CrSbSe$_3$ is a ferromagnetic (FM) semiconductor with a band gap of about 0.65 eV. The FM couplings within each zig-zag spin chain are due to the Cr-Se-Cr superexchange with the near-90$^\circ$ bonds, and the inter-chain FM couplings are one order of magnitude weaker. By inclusion of the spin-orbit coupling (SOC) effects, our calculations reproduce the experimental observation of the easy magnetization $a$ axis and the hard $b$ axis (the spin-chain direction), with the calculated moderate magnetic anisotropy of 0.19 meV/Cr. Moreover, we identify the nearly equal contributions from the single ion anisotropy of Cr, and from the exchange anisotropy due to the strong SOC of the heavy elements Sb and Se and their couplings with Cr. Using the parameters of the magnetic coupling and anisotropy from the above calculations, our Monte Carlo simulations yield the Curie temperature $T_{\rm{C}}$ of 108 K.

cond-mat.mtrl-sci↗

arXiv2021

Triaxial magnetic anisotropy in the two-dimensional ferromagnetic semiconductor CrSBr

Two-dimensional (2D) ferromagnets have recently drawn extensive attention, and here we study the electronic structure and magnetic properties of the bulk and monolayer of CrSBr, using first-principles calculations and Monte Carlo simulations. Our results show that bulk CrSBr is a magnetic semiconductor and has the easy magnetization b-axis, hard c-axis, and intermediate a-axis. Thus, the experimental triaxial magnetic anisotropy (MA) is well reproduced here, and it is identified to be the joint effects of spin-orbit coupling (SOC) and magnetic dipole-dipole interaction. We find that bulk CrSBr has a strong ferromagnetic (FM) intralayer coupling but a marginal interlayer one. We also study CrSBr monolayer in detail and find that the intralayer FM exchange persists and the shape anisotropy has a more pronounced contribution to the MA. Using the parameters of the FM exchange and the triaxial MA, our Monte Carlo simulations show that CrSBr monolayer has Curie temperature Tc = 175 K. Moreover, we find that a uniaxial tensile (compressive) strain along the a (b) axis would further increase the Tc.

cond-mat.mtrl-sci↗