arXiv subjects

Kun Fang

Publications and source records attributed to Kun Fang.

At least 73 records · Page 4Linked to original sources

arXiv2024

Cosmic-ray deuteron excess from a primary component

The recent AMS-02 measurements of cosmic-ray (CR) deuteron fluxes suggest the presence of primary deuterons in quantities far exceeding predictions from Big Bang nucleosynthesis. This poses a significant challenge to modern astrophysics, as no known processes can account for such large amounts of deuterons without violating existing constraints~\cite{Epstein:1976hq}. In contrast, it is recently proposed that the AMS-02 measurements can be explained by a purely secondary origin when contributions from heavier nuclei are considered. In this study, we recalculate the secondary deuteron flux using production cross sections updated with the latest collider data. We find that some of the deuteron production cross sections are overestimated in the widely-used calculation tools for CR propagation, and a primary deuteron component is still necessary. We then propose a novel process for generating primary deuterons at CR sources through a fusion mechanism, which is naturally unique to deuterons. This model could explain the observed deuteron excess while maintaining consistency with other CR measurements.

astro-ph.HE↗

arXiv2024

A rigorous solution to the superluminal issue in the diffusion equation

Superluminal propagation is an intrinsic problem in the diffusion equation and has not been effectively addressed for a long time. In this work, a rigorous solution to this issue is obtained under the assumption that particles undergo a random flight process, where they move isotropically at a constant speed while experiencing random scatterings. We validate this solution by comparing it with comprehensive simulations of the random flight process and find that it significantly deviates from the solution derived from the Jüttner propagator. This solution is broadly applicable to various diffusion phenomena, such as cosmic-ray propagation. We emphasize that our rigorous solution is particularly crucial in scenarios involving burst-like particle injection, where previous phenomenological approaches to the superluminal diffusion problem may not yield accurate results.

astro-ph.HE↗

arXiv2024

Constraining anisotropic diffusion between Geminga and Earth with the cosmic-ray electron and positron spectrum

The gamma-ray halo surrounding Geminga suggests a notable reduction in cosmic-ray diffusion. One potential explanation for this phenomenon is the projection effect of slow diffusion perpendicular to the average magnetic field (represented by the diffusion coefficient $D_\perp$) within an anisotropic diffusion framework. In this context, the diffusion coefficient parallel to the mean field ($D_\parallel$) may remain substantial, allowing electrons and positrons ($e^\pm$) generated by Geminga to effectively propagate towards Earth along magnetic field lines, potentially leading to an observable $e^\pm$ flux. This study initially establishes the fundamental parameters of the anisotropic model based on the morphology and spectral observations of the Geminga halo, and subsequently forecasts the $e^\pm$ flux generated by Geminga at Earth's location. Our findings indicate that the $e^-+e^+$ spectrum obtained by DAMPE can provide critical constraints on the anisotropic diffusion model: to ensure that the projected spectrum does not surpass the observational data, the Alfvén Mach number of the turbulent magnetic field ($M_A$) should not fall below 0.75, corresponding to $D_\parallel/D_\perp\lesssim3$ given $D_\perp=D_\parallel M_A^4$. This suggests that a substantial reduction in $D_\parallel$ relative to the Galactic average may still be necessary. Additionally, our analysis reveals that within the anisotropic diffusion framework, Geminga could generate a distinct peak around 1 TeV in the $e^-+e^+$ spectrum, potentially accounting for the anomalous 1.4 TeV excess tentatively detected by DAMPE.

astro-ph.HE↗

arXiv2024

A New Perspective on the Diffuse Gamma-Ray Emission Excess

The Large High-Altitude Air Shower Observatory (LHAASO) recently published measurements of diffuse Galactic gamma-ray emission (DGE) in the 10-1000 TeV energy range. The measured DGE flux is significantly higher than the expectation from hadronic interactions between cosmic rays (CRs) and the interstellar medium. This excess has been proposed to originate from unknown extended sources produced by electron radiation, such as pulsar wind nebulae or pulsar halos (PWNe/halos). In this study, we propose a new perspective to explain the DGE excess observed by LHAASO. The masking regions used in the LHAASO DGE measurement may not fully encompass the extended signals of PWNe/halos. By employing a two-zone diffusion model for electrons around pulsars, we find that the DGE excess in most regions of the Galactic plane can be well explained by the signal leakage model under certain parameters. Our results indicate that the signal leakage from known sources and contributions from unresolved sources should be considered complementary in explaining the DGE excess.

astro-ph.HE↗

arXiv2024

PAS: Data-Efficient Plug-and-Play Prompt Augmentation System

In recent years, the rise of Large Language Models (LLMs) has spurred a growing demand for plug-and-play AI systems. Among the various AI techniques, prompt engineering stands out as particularly significant. However, users often face challenges in writing prompts due to the steep learning curve and significant time investment, and existing automatic prompt engineering (APE) models can be difficult to use. To address this issue, we propose PAS, an LLM-based plug-and-play APE system. PAS utilizes LLMs trained on high-quality, automatically generated prompt complementary datasets, resulting in exceptional performance. In comprehensive benchmarks, PAS achieves state-of-the-art (SoTA) results compared to previous APE models, with an average improvement of 6.09 points. Moreover, PAS is highly efficient, achieving SoTA performance with only 9000 data points. Additionally, PAS can autonomously generate prompt augmentation data without requiring additional human labor. Its flexibility also allows it to be compatible with all existing LLMs and applicable to a wide range of tasks. PAS excels in human evaluations, underscoring its suitability as a plug-in for users. This combination of high performance, efficiency, and flexibility makes PAS a valuable system for enhancing the usability and effectiveness of LLMs through improved prompt engineering.

cs.CL↗

arXiv2024

Revisiting Deep Ensemble for Out-of-Distribution Detection: A Loss Landscape Perspective

Existing Out-of-Distribution (OoD) detection methods address to detect OoD samples from In-Distribution (InD) data mainly by exploring differences in features, logits and gradients in Deep Neural Networks (DNNs). We in this work propose a new perspective upon loss landscape and mode ensemble to investigate OoD detection. In the optimization of DNNs, there exist many local optima in the parameter space, or namely modes. Interestingly, we observe that these independent modes, which all reach low-loss regions with InD data (training and test data), yet yield significantly different loss landscapes with OoD data. Such an observation provides a novel view to investigate the OoD detection from the loss landscape, and further suggests significantly fluctuating OoD detection performance across these modes. For instance, FPR values of the RankFeat method can range from 46.58% to 84.70% among 5 modes, showing uncertain detection performance evaluations across independent modes. Motivated by such diversities on OoD loss landscape across modes, we revisit the deep ensemble method for OoD detection through mode ensemble, leading to improved performance and benefiting the OoD detector with reduced variances. Extensive experiments covering varied OoD detectors and network structures illustrate high variances across modes and validate the superiority of mode ensemble in boosting OoD detection. We hope this work could attract attention in the view of independent modes in the loss landscape of OoD data and more reliable evaluations on OoD detectors.

cs.LG↗

arXiv2024

DomainRAG: A Chinese Benchmark for Evaluating Domain-specific Retrieval-Augmented Generation

Retrieval-Augmented Generation (RAG) offers a promising solution to address various limitations of Large Language Models (LLMs), such as hallucination and difficulties in keeping up with real-time updates. This approach is particularly critical in expert and domain-specific applications where LLMs struggle to cover expert knowledge. Therefore, evaluating RAG models in such scenarios is crucial, yet current studies often rely on general knowledge sources like Wikipedia to assess the models' abilities in solving common-sense problems. In this paper, we evaluated LLMs by RAG settings in a domain-specific context, college enrollment. We identified six required abilities for RAG models, including the ability in conversational RAG, analyzing structural information, faithfulness to external knowledge, denoising, solving time-sensitive problems, and understanding multi-document interactions. Each ability has an associated dataset with shared corpora to evaluate the RAG models' performance. We evaluated popular LLMs such as Llama, Baichuan, ChatGLM, and GPT models. Experimental results indicate that existing closed-book LLMs struggle with domain-specific questions, highlighting the need for RAG models to solve expert problems. Moreover, there is room for RAG models to improve their abilities in comprehending conversational history, analyzing structural information, denoising, processing multi-document interactions, and faithfulness in expert knowledge. We expect future studies could solve these problems better.

cs.CL↗

arXiv2024

Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs

The integration of large language models (LLMs) and search engines represents a significant evolution in knowledge acquisition methodologies. However, determining the knowledge that an LLM already possesses and the knowledge that requires the help of a search engine remains an unresolved issue. Most existing methods solve this problem through the results of preliminary answers or reasoning done by the LLM itself, but this incurs excessively high computational costs. This paper introduces a novel collaborative approach, namely SlimPLM, that detects missing knowledge in LLMs with a slim proxy model, to enhance the LLM's knowledge acquisition process. We employ a proxy model which has far fewer parameters, and take its answers as heuristic answers. Heuristic answers are then utilized to predict the knowledge required to answer the user question, as well as the known and unknown knowledge within the LLM. We only conduct retrieval for the missing knowledge in questions that the LLM does not know. Extensive experimental results on five datasets with two LLMs demonstrate a notable improvement in the end-to-end performance of LLMs in question-answering tasks, achieving or surpassing current state-of-the-art models with lower LLM inference costs.

cs.CL↗

arXiv2024

Possible spectral irregularities in the AMS-02 positron spectrum

The excesses in the electron and positron spectra observed by many experiments, such as PAMELA and AMS-02, have sparked significant theoretical investigation. It is not easy to distinguish the two primary hypotheses dark matter annihilation/decay and pulsars from the spectral features. Should pulsars be the source of this excess, the expected variability in their distribution may introduce distinct irregularities in the positron energy spectrum. In this study, we use an irregularity estimator to detect these potential features in the positron energy spectrum of AMS-02. Our analysis of the current AMS-02 data reveals these spectral irregularities with a statistical significance of $1.75σ$. However, our projection indicates that, with AMS-02 data collected over a period of 20 years, such irregularities could be identified with a confidence level of $3σ$ level in 71\% of our simulations.

astro-ph.HE↗

arXiv2024

Revisiting Random Weight Perturbation for Efficiently Improving Generalization

Improving the generalization ability of modern deep neural networks (DNNs) is a fundamental challenge in machine learning. Two branches of methods have been proposed to seek flat minima and improve generalization: one led by sharpness-aware minimization (SAM) minimizes the worst-case neighborhood loss through adversarial weight perturbation (AWP), and the other minimizes the expected Bayes objective with random weight perturbation (RWP). While RWP offers advantages in computation and is closely linked to AWP on a mathematical basis, its empirical performance has consistently lagged behind that of AWP. In this paper, we revisit the use of RWP for improving generalization and propose improvements from two perspectives: i) the trade-off between generalization and convergence and ii) the random perturbation generation. Through extensive experimental evaluations, we demonstrate that our enhanced RWP methods achieve greater efficiency in enhancing generalization, particularly in large-scale problems, while also offering comparable or even superior performance to SAM. The code is released at https://github.com/nblt/mARWP.

cs.LG↗

arXiv2024

Precise measurement of the cosmic-ray spectrum and $\left \langle \ln A \right \rangle$ by LHAASO -- connecting the Galactic to the extragalactic components

Recently LHAASO Collaboration gives precise measurements of cosmic rays (CR) all particle energy spectrum and mean logarithmic mass $\left \langle \ln A \right \rangle$ from 0.3 PeV to 30 PeV. Combining the CR measurements by AMS-02 and DAMPE in space and that by LHAASO and Auger on the ground we construct a model to recover all these measurements from tens of GeV to tens of EeV. We find the LHAASO measurement is crucial in the model construction by connecting the Galactic component to the extragalactic component. The precise measurements of CR spectra for individual species by AMS-02 and DAMPE together with the newest LHAASO results clearly indicates three Galactic CR components, that is, a soft low energy background, a hard high energy component, and a local source contribution. However, the LHAASO data show that above $\sim 10^{16}$ eV a nonnegligible extragalactic component must be included. Combining the Auger results and the LHAASO results we figure out the extragalactic CRs which need at least two components at lower and higher energies. Thanks to the precise measurements by LHAASO the constraints on the model parameters are quite stringent. The spectra features and mass measurements in all energy range are all well reproduced in the model.

astro-ph.HE↗

arXiv2024

Constraining the slow-diffusion zone size and electron injection spectral index for the Geminga pulsar halo

Measuring the electron diffusion coefficient is the most straightforward task in the study of gamma-ray pulsar halos. The updated measurements of the spatial morphology and spectrum of the Geminga halo by the High-Altitude Water Cherenkov (HAWC) experiment enable us to constrain parameters beyond the diffusion coefficient, including the size of the slow-diffusion zone and the electron injection spectrum from the pulsar wind nebulae (PWNe). Based on the two-zone diffusion model, we find that the slow-diffusion zone size ($r_*$) around Geminga is within the range of $30-70$~pc. The lower boundary of this range is determined by the goodness of fit of the model to the one-dimensional morphology of the Geminga halo. The upper limit is derived from fitting the gamma-ray spectrum of the Geminga halo, along with the expectations for the power-law index of the injection spectrum based on simulations and PWNe observations, i.e., $p\gtrsim1$. With $r_*$ set at its lower limit of $30$~pc, we obtain the maximum $p$ permitted by the HAWC spectrum measurement, with an upper limit of $2.17$ at a $3σ$ significance. Moreover, we find that when $r_*=30$~pc and $p=2.17$, the predicted positron spectrum generated by Geminga at Earth coincides with the AMS-02 measurement in the $50-500$~GeV range.

astro-ph.HE↗

arXiv2024

Reexamine the dark matter scenario accounting for the positron excess in a new cosmic ray propagation model

The positron excess in cosmic rays has stimulated a lot of interests in the last decade. The dark matter origin of the extra positrons has attracted great attention. However, the $γ$-ray search set very stringent constraints on the dark matter annihilation/decay rate, which leads to great disfavor of the dark matter scenario. In the work, we incorporate the recent progress in cosmic rays propagation and reexamine the dark matter scenario accounting for the positron excess. Recent observations indicate that cosmic rays propagation in the Milky Way may be not uniform and diffusion in the Galactic disk should be slower than that in the halo. In the spatial-dependent propagation model, the positrons/electrons are more concentrated in the disk and lead to smaller dark matter annihilation/decay rate to account for the positron excess and also a smaller deficit in the background positron flux. Especially for the $μ^+μ^-$ channel the positron spectrum fit the AMS-02 latest data perfectly and the annihilation rate satisfies all the present constraints from $γ$-ray and CMB observations.

astro-ph.HE↗

arXiv2024

Reanalysis of the Systematic Uncertainties in Cosmic-Ray Antiproton Flux

Recent studies on cosmic rays (CRs) have reported the possibility of an excess in the antiproton flux around $10-20$ GeV. However, the associated systematic uncertainties have impeded the interpretation of these findings. In this study, we conduct a global Bayesian analysis to constrain the propagation parameters and evaluate the CR antiproton spectrum, while comprehensively accounting for uncertainties associated with interstellar CR propagation, production cross sections for antiprotons and other secondaries, and the charge and energy dependent effects of solar modulation. We establish that the most recent AMS-02 $\bar{p}$ spectrum is in agreement with a pure secondary origin. Based on this, we establish upper limits on dark matter (DM) annihilation. We also determine that the AMS-02 data favors the empirical hadronic interaction models over phenomenological ones. Finally, we find that the latest AMS-02 antiproton data from 2011 to 2018 disfavors the antiproton excess at $\mathcal{O}$(10) GeV and the corresponding DM interpretation that can simultaneously account for the Galactic Center excess in the gamma-ray observation.

astro-ph.HE↗

arXiv2024

Interpretation of AMS-02 beryllium isotope fluxes using data-driven production cross sections

The Be isotopic measurements preliminarily reported by the AMS-02 Collaboration have reached an unprecedented energy of 12 GeV/$n$. As secondary cosmic rays (CRs), the Be isotopes include both stable and unstable species, which are crucial for constraining the propagation parameters of Galactic CRs. However, uncertainties in their production cross sections can skew the interpretation of the CR data, especially when cross-section measurements are of significantly lower quality than CR measurements. In this work, we consider the uncertainties of the cross sections to interpret the Be isotopic data by adopting a cross-section parametrization that fully utilizes the available experimental data. Owing to the high-quality measurements of the $^7$Be production cross section, we innovatively employ $^7$Be instead of $^9$Be to constrain propagation parameters. Notably, the diffusion halo thickness is constrained to $5.67\pm0.76$~kpc, representing a moderate value compared to previous analogous works. Combining the well-constrained CR propagation model and the precise CR measurements of $^9$Be, we conversely constrain the major production cross section of $^9$Be and find that it ought to be remarkably lower than previously thought. Our analysis also questions the reliability of certain cross sections measured by some experiments, potentially marking the first time CR data has been used to identify dubious nucleon production cross sections. The method presented in this work holds promise for analyzing upcoming isotopic data from other nuclei.

astro-ph.HE↗

arXiv2024

End-to-end Kernel Learning via Generative Random Fourier Features

Random Fourier features (RFFs) provide a promising way for kernel learning in a spectral case. Current RFFs-based kernel learning methods usually work in a two-stage way. In the first-stage process, learning the optimal feature map is often formulated as a target alignment problem, which aims to align the learned kernel with the pre-defined target kernel (usually the ideal kernel). In the second-stage process, a linear learner is conducted with respect to the mapped random features. Nevertheless, the pre-defined kernel in target alignment is not necessarily optimal for the generalization of the linear learner. Instead, in this paper, we consider a one-stage process that incorporates the kernel learning and linear learner into a unifying framework. To be specific, a generative network via RFFs is devised to implicitly learn the kernel, followed by a linear classifier parameterized as a full-connected layer. Then the generative network and the classifier are jointly trained by solving the empirical risk minimization (ERM) problem to reach a one-stage solution. This end-to-end scheme naturally allows deeper features, in correspondence to a multi-layer structure, and shows superior generalization performance over the classical two-stage, RFFs-based methods in real-world classification tasks. Moreover, inspired by the randomized resampling mechanism of the proposed method, its enhanced adversarial robustness is investigated and experimentally verified.

cs.LG↗

arXiv2024

Towards Robust Neural Networks via Orthogonal Diversity

Deep Neural Networks (DNNs) are vulnerable to invisible perturbations on the images generated by adversarial attacks, which raises researches on the adversarial robustness of DNNs. A series of methods represented by the adversarial training and its variants have proven as one of the most effective techniques in enhancing the DNN robustness. Generally, adversarial training focuses on enriching the training data by involving perturbed data. Such data augmentation effect of the involved perturbed data in adversarial training does not contribute to the robustness of DNN itself and usually suffers from clean accuracy drop. Towards the robustness of DNN itself, we in this paper propose a novel defense that aims at augmenting the model in order to learn features that are adaptive to diverse inputs, including adversarial examples. More specifically, to augment the model, multiple paths are embedded into the network, and an orthogonality constraint is imposed on these paths to guarantee the diversity among them. A margin-maximization loss is then designed to further boost such DIversity via Orthogonality (DIO). In this way, the proposed DIO augments the model and enhances the robustness of DNN itself as the learned features can be corrected by these mutually-orthogonal paths. Extensive empirical results on various data sets, structures and attacks verify the stronger adversarial robustness of the proposed DIO utilizing model augmentation. Besides, DIO can also be flexibly combined with different data augmentation techniques (e.g., TRADES and DDPM), further promoting robustness gains.

cs.CV↗

arXiv2024

Online LiDAR-Camera Extrinsic Parameters Self-checking

With the development of neural networks and the increasing popularity of automatic driving, the calibration of the LiDAR and the camera has attracted more and more attention. This calibration task is multi-modal, where the rich color and texture information captured by the camera and the accurate three-dimensional spatial information from the LiDAR is incredibly significant for downstream tasks. Current research interests mainly focus on obtaining accurate calibration results through information fusion. However, they seldom analyze whether the calibrated results are correct or not, which could be of significant importance in real-world applications. For example, in large-scale production, the LiDARs and the cameras of each smart car have to get well-calibrated as the car leaves the production line, while in the rest of the car life period, the poses of the LiDARs and cameras should also get continually supervised to ensure the security. To this end, this paper proposes a self-checking algorithm to judge whether the extrinsic parameters are well-calibrated by introducing a binary classification network based on the fused information from the camera and the LiDAR. Moreover, since there is no such dataset for the task in this work, we further generate a new dataset branch from the KITTI dataset tailored for the task. Our experiments on the proposed dataset branch demonstrate the performance of our method. To the best of our knowledge, this is the first work to address the significance of continually checking the calibrated extrinsic parameters for autonomous driving. The code is open-sourced on the Github website at https://github.com/OpenCalib/LiDAR2camera_self-check.

cs.CV↗