arXiv Science⌕ Search

arXiv subjects

Yu-Feng Li

Publications and source records attributed to Yu-Feng Li.

At least 91 records · Page 5Linked to original sources

LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model

Large language models (LLMs), including both proprietary and open-source models, have showcased remarkable capabilities in addressing a wide range of downstream tasks. Nonetheless, when it comes to practical Chinese legal tasks, these models fail to meet the actual requirements. Proprietary models do not ensure data privacy for sensitive legal cases, while open-source models demonstrate unsatisfactory performance due to their lack of legal knowledge. To address this problem, we introduce LawGPT, the first open-source model specifically designed for Chinese legal applications. LawGPT comprises two key components: legal-oriented pre-training and legal supervised fine-tuning. Specifically, we employ large-scale Chinese legal documents for legal-oriented pre-training to incorporate legal domain knowledge. To further improve the model's performance on downstream legal tasks, we create a knowledge-driven instruction dataset for legal supervised fine-tuning. Our experimental results demonstrate that LawGPT outperforms the open-source LLaMA 7B model. Our code and resources are publicly available at https://github.com/pengxiao-song/LaWGPT and have received 5.7K stars on GitHub.

cs.CL↗

Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurts

The fine-tuning paradigm in addressing long-tail learning tasks has sparked significant interest since the emergence of foundation models. Nonetheless, how fine-tuning impacts performance in long-tail learning was not explicitly quantified. In this paper, we disclose that heavy fine-tuning may even lead to non-negligible performance deterioration on tail classes, and lightweight fine-tuning is more effective. The reason is attributed to inconsistent class conditions caused by heavy fine-tuning. With the observation above, we develop a low-complexity and accurate long-tail learning algorithms LIFT with the goal of facilitating fast prediction and compact models by adaptive lightweight fine-tuning. Experiments clearly verify that both the training time and the learned parameters are significantly reduced with more accurate predictive performance compared with state-of-the-art approaches. The implementation code is available at https://github.com/shijxcs/LIFT.

cs.CV↗

DeCoOp: Robust Prompt Tuning with Out-of-Distribution Detection

Vision-language models (VLMs), such as CLIP, have demonstrated impressive zero-shot capabilities for various downstream tasks. Their performance can be further enhanced through few-shot prompt tuning methods. However, current studies evaluate the performance of learned prompts separately on base and new classes. This evaluation lacks practicality for real-world applications since downstream tasks cannot determine whether the data belongs to base or new classes in advance. In this paper, we explore a problem setting called Open-world Prompt Tuning (OPT), which involves tuning prompts on base classes and evaluating on a combination of base and new classes. By introducing Decomposed Prompt Tuning framework (DePT), we theoretically demonstrate that OPT can be solved by incorporating out-of-distribution detection into prompt tuning, thereby enhancing the base-to-new discriminability. Based on DePT, we present a novel prompt tuning approach, namely, Decomposed Context Optimization (DeCoOp), which introduces new-class detectors and sub-classifiers to further enhance the base-class and new-class discriminability. Experimental results on 11 benchmark datasets validate the effectiveness of DePT and demonstrate that DeCoOp outperforms current state-of-the-art methods, providing a significant 2% average accuracy improvement.

cs.CV↗

Pulse shape discrimination technique for diffuse supernova neutrino background search with JUNO

Pulse shape discrimination (PSD) is widely used in particle and nuclear physics. Specifically in liquid scintillator detectors, PSD facilitates the classification of different particle types based on their energy deposition patterns. This technique is particularly valuable for studies of the Diffuse Supernova Neutrino Background (DSNB), nucleon decay, and dark matter searches. This paper presents a detailed investigation of the PSD technique, applied in the DSNB search performed with the Jiangmen Underground Neutrino Observatory (JUNO). Instead of using conventional cut-and-count methods, we employ methods based on Boosted Decision Trees and Neural Networks and compare their capability to distinguish the DSNB signals from the atmospheric neutrino neutral-current background events. The two methods demonstrate comparable performance, resulting in a 50\% to 80\% improvement in signal efficiency compared to a previous study performed for JUNO~\cite{JUNO:2015zny}. Moreover, we study the dependence of the PSD performance on the visible energy and final state composition of the events and find a significant dependence on the presence/absence of $^{11}$C. Finally, we evaluate the impact of the detector effects (photon propagation, PMT dark noise, and waveform reconstruction) on the PSD performance.

hep-ex↗

Expected geoneutrino signal at JUNO using local integrated 3-D refined crustal model

Geoneutrinos serve as a potent tool for comprehending the radiogenic power and composition of Earth. Although geoneutrinos have been observed in prior experiments, the forthcoming generation of experiments,such as JUNO, will be necessary for fully harnessing their potential. Precise prediction of the crustal contribution is vital for interpreting particlephysics measurements in the context of geo-scientific inquiries. Nonetheless, existing models such as JULOC and GIGJ have limitations in accurately forecasting the crustal contribution. This paper introduces JULOCI, the novel 3-D integrated crustal model of JUNO, which employs seismic, gravity, rock sample, and heat flow data to precisely estimate the geoneutrino signal of the lithosphere. The model indicates elevated concentrations of uranium and thorium in southern China, resulting in unexpectedly strong geoneutrino signals.The accuracy of JULOC-I, coupled with a decade of experimental data, affords JUNO the opportunity to test multiple mantle models. Once operational, JUNO can validate the model predictions and enhance the precision of mantle measurements. All in all, the improved accuracy ofJULOC-I represents a substantial stride towards comprehending the geochemical distribution of the South China crust, offering a valuable tool for investigating the composition and evolution of the Earth through geoneutrinos.

physics.geo-ph↗

Interactive Reweighting for Mitigating Label Quality Issues

Label quality issues, such as noisy labels and imbalanced class distributions, have negative effects on model performance. Automatic reweighting methods identify problematic samples with label quality issues by recognizing their negative effects on validation samples and assigning lower weights to them. However, these methods fail to achieve satisfactory performance when the validation samples are of low quality. To tackle this, we develop Reweighter, a visual analysis tool for sample reweighting. The reweighting relationships between validation samples and training samples are modeled as a bipartite graph. Based on this graph, a validation sample improvement method is developed to improve the quality of validation samples. Since the automatic improvement may not always be perfect, a co-cluster-based bipartite graph visualization is developed to illustrate the reweighting relationships and support the interactive adjustments to validation samples and reweighting results. The adjustments are converted into the constraints of the validation sample improvement method to further improve validation samples. We demonstrate the effectiveness of Reweighter in improving reweighting results through quantitative evaluation and two case studies.

cs.HC↗

How Re-sampling Helps for Long-Tail Learning?

Long-tail learning has received significant attention in recent years due to the challenge it poses with extremely imbalanced datasets. In these datasets, only a few classes (known as the head classes) have an adequate number of training samples, while the rest of the classes (known as the tail classes) are infrequent in the training data. Re-sampling is a classical and widely used approach for addressing class imbalance issues. Unfortunately, recent studies claim that re-sampling brings negligible performance improvements in modern long-tail learning tasks. This paper aims to investigate this phenomenon systematically. Our research shows that re-sampling can considerably improve generalization when the training images do not contain semantically irrelevant contexts. In other scenarios, however, it can learn unexpected spurious correlations between irrelevant contexts and target labels. We design experiments on two homogeneous datasets, one containing irrelevant context and the other not, to confirm our findings. To prevent the learning of spurious correlations, we propose a new context shift augmentation module that generates diverse training images for the tail class by maintaining a context bank extracted from the head-class images. Experiments demonstrate that our proposed module can boost the generalization and outperform other approaches, including class-balanced re-sampling, decoupled classifier re-training, and data augmentation methods. The source code is available at https://www.lamda.nju.edu.cn/code_CSA.ashx.

cs.CV↗

Investigating the Limitation of CLIP Models: The Worst-Performing Categories

Contrastive Language-Image Pre-training (CLIP) provides a foundation model by integrating natural language into visual concepts, enabling zero-shot recognition on downstream tasks. It is usually expected that satisfactory overall accuracy can be achieved across numerous domains through well-designed textual prompts. However, we found that their performance in the worst categories is significantly inferior to the overall performance. For example, on ImageNet, there are a total of 10 categories with class-wise accuracy as low as 0\%, even though the overall performance has achieved 64.1\%. This phenomenon reveals the potential risks associated with using CLIP models, particularly in risk-sensitive applications where specific categories hold significant importance. To address this issue, we investigate the alignment between the two modalities in the CLIP model and propose the Class-wise Matching Margin (\cmm) to measure the inference confusion. \cmm\ can effectively identify the worst-performing categories and estimate the potential performance of the candidate prompts. We further query large language models to enrich descriptions of worst-performing categories and build a weighted ensemble to highlight the efficient prompts. Experimental results clearly verify the effectiveness of our proposal, where the accuracy on the worst-10 categories on ImageNet is boosted to 5.2\%, without manual prompt engineering, laborious optimization, or access to labeled validation data.

cs.CV↗

LAMDA-SSL: Semi-Supervised Learning in Python

LAMDA-SSL is open-sourced on GitHub and its detailed usage documentation is available at https://ygzwqzd.github.io/LAMDA-SSL/. This documentation introduces LAMDA-SSL in detail from various aspects and can be divided into four parts. The first part introduces the design idea, features and functions of LAMDA-SSL. The second part shows the usage of LAMDA-SSL by abundant examples in detail. The third part introduces all algorithms implemented by LAMDA-SSL to help users quickly understand and choose SSL algorithms. The fourth part shows the APIs of LAMDA-SSL. This detailed documentation greatly reduces the cost of familiarizing users with LAMDA-SSL toolkit and SSL algorithms.

cs.LG↗

Enhancement of the screening effect in semiconductor detectors in the presence of the neutrino magnetic moment

The theoretical framework of the neutrino electron excitation at low energies including the screening effect in semiconductor detectors is developed for the first time, both in the Standard Model and in the presence of the neutrino magnetic moment. We explore the contribution of the screening effect of semiconductors to the neutrino electron excitation based on the linear response theory and calculate the corresponding numerical results. We show that excitation rates from the neutrino magnetic moment are dramatically enhanced {by} the screening effect and the sensitivity can be significantly improved to the level of $10^{-13}\,μ_{\rm B}$, much better than the current {laboratory and astrophysical} limits.

hep-ph↗

Robust Deep Semi-Supervised Learning: A Brief Introduction

Semi-supervised learning (SSL) is the branch of machine learning that aims to improve learning performance by leveraging unlabeled data when labels are insufficient. Recently, SSL with deep models has proven to be successful on standard benchmark tasks. However, they are still vulnerable to various robustness threats in real-world applications as these benchmarks provide perfect unlabeled data, while in realistic scenarios, unlabeled data could be corrupted. Many researchers have pointed out that after exploiting corrupted unlabeled data, SSL suffers severe performance degradation problems. Thus, there is an urgent need to develop SSL algorithms that could work robustly with corrupted unlabeled data. To fully understand robust SSL, we conduct a survey study. We first clarify a formal definition of robust SSL from the perspective of machine learning. Then, we classify the robustness threats into three categories: i) distribution corruption, i.e., unlabeled data distribution is mismatched with labeled data; ii) feature corruption, i.e., the features of unlabeled examples are adversarially attacked; and iii) label corruption, i.e., the label distribution of unlabeled data is imbalanced. Under this unified taxonomy, we provide a thorough review and discussion of recent works that focus on these issues. Finally, we propose possible promising directions within robust SSL to provide insights for future research.

cs.LG↗

USB: A Unified Semi-supervised Learning Benchmark for Classification

Semi-supervised learning (SSL) improves model generalization by leveraging massive unlabeled data to augment limited labeled samples. However, currently, popular SSL evaluation protocols are often constrained to computer vision (CV) tasks. In addition, previous work typically trains deep neural networks from scratch, which is time-consuming and environmentally unfriendly. To address the above issues, we construct a Unified SSL Benchmark (USB) for classification by selecting 15 diverse, challenging, and comprehensive tasks from CV, natural language processing (NLP), and audio processing (Audio), on which we systematically evaluate the dominant SSL methods, and also open-source a modular and extensible codebase for fair evaluation of these SSL methods. We further provide the pre-trained versions of the state-of-the-art neural models for CV tasks to make the cost affordable for further tuning. USB enables the evaluation of a single SSL algorithm on more tasks from multiple domains but with less cost. Specifically, on a single NVIDIA V100, only 39 GPU days are required to evaluate FixMatch on 15 tasks in USB while 335 GPU days (279 GPU days on 4 CV datasets except for ImageNet) are needed on 5 CV tasks with TorchSSL.

cs.LG↗

A Survey on Extreme Multi-label Learning

Multi-label learning has attracted significant attention from both academic and industry field in recent decades. Although existing multi-label learning algorithms achieved good performance in various tasks, they implicitly assume the size of target label space is not huge, which can be restrictive for real-world scenarios. Moreover, it is infeasible to directly adapt them to extremely large label space because of the compute and memory overhead. Therefore, eXtreme Multi-label Learning (XML) is becoming an important task and many effective approaches are proposed. To fully understand XML, we conduct a survey study in this paper. We first clarify a formal definition for XML from the perspective of supervised learning. Then, based on different model architectures and challenges of the problem, we provide a thorough discussion of the advantages and disadvantages of each category of methods. For the benefit of conducting empirical studies, we collect abundant resources regarding XML, including code implementations, and useful tools. Lastly, we propose possible research directions in XML, such as new evaluation metrics, the tail label problem, and weakly supervised XML.

cs.LG↗

Neutrinoless double beta decay in the minimal type-I seesaw model: How the enhancement or cancellation happens?

We discuss the contribution of right-handed neutrinos (RHNs) to the effective neutrino mass of the neutrinoless double beta decay within the minimal type-I seesaw model using the intrinsic seesaw relation of neutrino mass and mixing parameters and the relative mass dependence of the nuclear matrix elements. In the viable parameter space, we find the possibilities of both the enhancement and cancellation to the effective neutrino mass from RHNs. The bounds on the parameter space of the RHNs can be determined with the effective neutrino mass extracted from neutrinoless double beta decay experiments.

hep-ph↗

Probing neutrino magnetic moments and the XENON1T excess with coherent elastic solar neutrino scattering

The detection potential of the active neutrino magnetic moment ($ν_{a}$MM) and the active sterile transition magnetic moment ($ν_{s}$MM) of the solar neutrino CE$ν$NS process in future Dark Matter direct detection experiments is studied and compared with the respective allowed range to explain the Xenon1T excess. We find that the sensitivity to the $ν_{a}$MM approaches to the level between $10^{-10}μ_B$ and $10^{-11}μ_B$, which is dominantly limited by the detection threshold. On the other hand, the future solar neutrino CE$ν$NS detection would be powerful in probing the $ν_{s}$MM for the sterile neutrino mass below 10 MeV, which could unambiguously test the $ν_{s}$MM explanation of the Xenon1T excess. The sensitivity in the general framework with both $ν_{a}$MM and $ν_{s}$MM contributions is also derived.

hep-ph↗

Constraining Light Mediators via Detection of Coherent Elastic Solar Neutrino Nucleus Scattering

Dark matter (DM) direct detection experiments are entering the multiple-ton era and will be sensitive to the coherent elastic neutrino nucleus scattering (CE$ν$NS) of solar neutrinos, enabling the possibility to explore contributions from new physics with light mediators at the low energy range. In this paper we consider light mediator models (scalar, vector and axial vector) and the corresponding contributions to the solar neutrino CE$ν$NS process. Motivated by the current status of new generation of DM direct detection experiments and the future plan, we study the sensitivity of light mediators in DM direct detection experiments of different nuclear targets and detector techniques. The constraints from the latest $^8$B solar neutrino measurements of XENON-1T are also derived. Finally, We show that the solar neutrino CE$ν$NS process can provide stringent limitation on the $ L_μ-L_τ $ model with the vector mediator mass below 100 MeV, covering the viable parameter space of the solution to the $ (g-2)_μ$ anomaly.

hep-ph↗

Prospects for the detection of the Diffuse Supernova Neutrino Background with the experiments SK-Gd and JUNO

The advent of gadolinium-loaded Super-Kamiokande (SK-Gd) and of the soon-to-start JUNO liquid scintillator detector marks a substantial improvement in the global sensitivity for the Diffuse Supernova Neutrino Background (DSNB). The present article reviews the detector properties most relevant for the DSNB searches in both experiments and estimates the expected signal and background levels. Based on these inputs, we evaluate the sensitivity of both experiments individually and combined. Using a simplified statistical approach, we find that both SK-Gd and JUNO have the potential to reach $>$3$σ$ evidence of the DSNB signal within 10 years of measurement. The combined results are likely to enable a $5σ$ discovery of the DSNB signal within the next decade.

astro-ph.HE↗

Model-Independent Determination of Isotopic Cross Sections per Fission for Reactor Antineutrinos

Model-independent reactor isotopic cross sections per fission are determined by global fits of the reactor antineutrino data from High-Enriched Uranium (HEU) reactor rates, Low-Enriched Uranium (LEU) reactor rates, and reactor fuel evolution data. Taking account of the implicit quasi-linear relationship between the fission fractions of $^{239}\rm{Pu}$ and $^{241}\rm{Pu}$ in the LEU reactor data, the Inverse-Beta-Decay (IBD) yields and their correlations of the fissionable isotopes $^{235}\rm{U}$, $^{238}\rm{U}$, and Pu's are obtained. The data-driven isotopic IBD yields provide an anomaly-free model for the reactor isotopic cross sections per fission, where better than 1\% accuracy of the expected reactor IBD yields can be achieved for future experiments.

nucl-th↗