arXiv Science⌕ Search

arXiv subjects

Kun Fang

Publications and source records attributed to Kun Fang.

At least 55 records · Page 3Linked to original sources

Geometric optimization for quantum communication

Determining the ultimate limits of quantum communication, such as the quantum capacity of a channel and the distillable entanglement of a shared state, remains a central challenge in quantum information theory, primarily due to the phenomenon of superadditivity. This work develops Riemannian optimization methods to establish significantly tighter, computable two-sided bounds on these fundamental quantities. For upper bounds, our method systematically searches for state and channel extensions that minimize known information-theoretic bounds. We achieve this by parameterizing the space of all possible extensions as a Stiefel manifold, enabling a universal search that overcomes the limitations of ad-hoc constructions. Combined with an improved upper bound on the one-way distillable entanglement based on a refined continuity bound on quantum conditional entropy, our approach yields new state-of-the-art upper bounds on the quantum capacity of the qubit depolarizing channel for large values of the depolarizing parameter, strictly improving the previously best-known bounds. For lower bounds, we introduce Riemannian optimization methods to compute multi-shot coherent information. We establish lower bounds on the one-way distillable entanglement by parameterizing quantum instruments on the unitary manifold, and on the quantum capacity by parameterizing code states with a product of unitary manifolds. Numerical results for noisy entangled states and different channels demonstrate that our methods successfully unlock superadditive gains, improving previous results. Together, these findings establish Riemannian optimization as a principled and powerful tool for navigating the complex landscape of quantum communication limits. Furthermore, we prove that amortization does not enhance the channel coherent information, thereby closing a potential avenue for improving capacity lower bounds in general.

quant-ph↗

Quantum channel discrimination against jammers

We study the problem of quantum channel discrimination between two channels with an adversary input party (a.k.a. a jammer). This setup interpolates between the best-case channel discrimination as studied by (Wang & Wilde, 2019) and the worst-case channel discrimination as studied by (Fang, Fawzi, & Fawzi, 2025), thereby generalizing both frameworks. To address this problem, we introduce the notion of minimax channel divergence and establish several of its key mathematical properties. We prove the Stein's lemma in this new setting, showing that the optimal type-II error exponent in the asymptotic regime under parallel strategies is characterized by the regularized minimax channel divergence.

quant-ph↗

Resource theory of asymmetric distinguishability with partial information

Recent studies have introduced the worst-case quantum divergence as a key measure in quantum information. Here we show that such divergences can be understood from the perspective of the resource theory of asymmetric distinguishability, which utilizes the asymmetric distinguishability between a pair of quantum states as resource. In our work, we extend this framework to settings with partial information, where the goal is to distinguish between sets of quantum states rather than individual states. Within this setting, we characterize optimal rates for resource distillation and dilution using (smoothed) one-shot divergences and regularized divergences. Our framework further exhibits a reversibility property: resource interconversions can be achieved without loss at rates determined entirely by regularized divergences. These results offer a broad operational interpretation of divergences between state sets and generalize existing resource theories to encompass incomplete information scenarios.

quant-ph↗

Estimating quantum relative entropies on quantum computers

Quantum relative entropy, a quantum generalization of the renowned Kullback-Leibler divergence, serves as a fundamental measure of the distinguishability between quantum states and plays a pivotal role in quantum information science. Despite its importance, efficiently estimating quantum relative entropy between two quantum states on quantum computers remains a significant challenge. In this work, we propose the first quantum algorithm for directly estimating quantum relative entropy and Petz Renyi divergence from two unknown quantum states on quantum computers, addressing open problems highlighted in [Phys. Rev. A 109, 032431 (2024)] and [IEEE Trans. Inf. Theory 70, 5653-5680 (2024)]. Notably, the circuit size of our algorithm is at most $2n+1$ with $n$ being the number of qubits in the quantum states and it is directly applicable to distributed scenarios, where quantum states to be compared are hosted on cross-platform quantum computers. We prove that our loss function is operator-convex, ensuring that any local minimum is also a global minimum. We validate the effectiveness of our method through numerical experiments and observe the absence of the barren plateau phenomenon. As an application, we employ our algorithm to investigate the superadditivity of quantum channel capacity. Numerical simulations reveal new examples of qubit channels exhibiting strict superadditivity of coherent information, highlighting the potential of quantum machine learning to address quantum-native problems.

quant-ph↗

Unified Solar Modulation Potential for Same-Charge Cosmic Rays and Implications for Local Interstellar Spectra

The energy spectra of cosmic rays (CRs) below tens of GeV are significantly modulated by solar activity within the heliosphere. To investigate the properties of Galactic CRs, it is important to determine the unmodulated local interstellar spectrum (LIS). Recent high-precision temporal measurements of CR energy spectra, released by the AMS-02 collaboration, provide a crucial observational foundation for this endeavor. In this study, we employ the widely used force-field approximation (FFA) model to analyze the AMS-02 data, and attempt to derive the LIS for CR protons and positrons. By applying a non-LIS method, we derive temporal variations of the relative solar modulation potential, $Δϕ$, for individual particle species. Our analysis demonstrates that the FFA provides sufficient accuracy in explaining the AMS-02 spectral measurements of all particles during the low solar activity period. Notably, the derived $Δϕ(t)$ for protons and positrons, as well as for electrons and antiprotons, exhibit excellent consistency, indicating that particles with the same charge sign can be effectively described within a unified FFA framework during the low solar activity period. Having established a well-constrained proton LIS and its associated modulation potential, we apply the common modulation behavior between positrons and protons to demodulate the AMS-02 positron measurements, and derive the positron LIS without necessitating prior knowledge of its characteristics. This LIS is useful for quantitative investigations into potential exotic origins of CR positrons.

astro-ph.HE↗

Uncertainty in Hadronic Diffuse $γ$-Ray Emission from the Temporal Stochasticity of Cosmic-Ray Sources

Diffuse $γ$-ray emission is a key probe of cosmic rays (CRs) distribution within the Galaxy. However, the discrepancies between observations and theoretical model expectations highlight the need for refined uncertainty estimates. In the literature, spatial and temporal variability of lepton flux has been discussed as an uncertainty in diffuse $γ$-ray estimation. In the present work, we demonstrate that variability in the high energy CR hadron flux is an important, yet previously underappreciated, source of uncertainty in diffuse $γ$-ray estimates. To assess this effect, we perform fully three-dimensional, time-dependent GALPROP simulations of CR protons injected from discrete Galactic sources. Our results reveal that the uncertainty in the hadronic component of diffuse $γ$ rays is non-negligible and can be comparable to, or even exceed, current experimental uncertainties at very high energies. This finding challenges the conventional assumption that only leptonic fluctuations are relevant to diffuse $γ$-ray modeling.

astro-ph.HE↗

Fourier Basis Mapping: A Time-Frequency Learning Framework for Time Series Forecasting

The integration of Fourier transform and deep learning opens new avenues for time series forecasting. We reconsider the Fourier transform from a basis functions perspective. Specifically, the real and imaginary parts of the frequency components can be regarded as the coefficients of cosine and sine basis functions at tiered frequency levels, respectively. We find that existing Fourier-based methods face inconsistent starting cycles and inconsistent series length issues. They fail to interpret frequency components precisely and overlook temporal information. Accordingly, the novel Fourier Basis Mapping (FBM) method addresses these issues by integrating time-frequency features through Fourier basis expansion and mapping in the time-frequency space. Our approach extracts explicit frequency features while preserving temporal characteristics. FBM supports plug-and-play integration with various types of neural networks by only adjusting the first initial projection layer for better performance. First, we propose FBM-L, FBM-NL, and FBM-NP to enhance linear, MLP-based, and Transformer-based models, respectively, demonstrating the effectiveness of time-frequency features. Next, we propose a synergetic model architecture, termed FBM-S, which decomposes the seasonal, trend, and interaction effects into three separate blocks, each designed to model time-frequency features in a specialized manner. Finally, we introduce several techniques tailored for time-frequency features, including interaction masking, centralization, patching, rolling window projection, and multi-scale down-sampling. The results are validated on diverse real-world datasets for both long-term and short-term forecasting tasks with SOTA performance.

cs.LG↗

Towards the ultimate limits of quantum channel discrimination and quantum communication

Distinguishability is fundamental to information theory and extends naturally to quantum systems. While quantum state discrimination is well understood, quantum channel discrimination remains challenging due to the dynamic nature of channels and the variety of discrimination strategies. This work advances the understanding of quantum channel discrimination and its fundamental limits. We develop new tools for quantum divergences, including sharper bounds on the quantum hypothesis testing relative entropy and additivity results for channel divergences. We establish a quantum Stein's lemma for memoryless channel discrimination, and link the strong converse property to the asymptotic equipartition property and continuity of divergences. Notably, we prove the equivalence of exponentially strong converse properties under coherent and sequential strategies. We further explore the interplay among operational regimes, discrimination strategies, and channel divergences, deriving exponents in various settings and contributing to a unified framework for channel discrimination. Finally, we recast quantum communication tasks as discrimination problems, uncovering deep connections between channel capacities, channel discrimination, and the mathematical structure of channel divergences. These results bridge two core areas of quantum information theory and offer new insights for future exploration.

quant-ph↗

High-Resolution Sustain Pedal Depth Estimation from Piano Audio Across Room Acoustics

Piano sustain pedal detection has previously been approached as a binary on/off classification task, limiting its application in real-world piano performance scenarios where pedal depth significantly influences musical expression. This paper presents a novel approach for high-resolution estimation that predicts continuous pedal depth values. We introduce a Transformer-based architecture that not only matches state-of-the-art performance on the traditional binary classification task but also achieves high accuracy in continuous pedal depth estimation. Furthermore, by estimating continuous values, our model provides musically meaningful predictions for sustain pedal usage, whereas baseline models struggle to capture such nuanced expressions with their binary detection approach. Additionally, this paper investigates the influence of room acoustics on sustain pedal estimation using a synthetic dataset that includes varied acoustic conditions. We train our model with different combinations of room settings and test it in an unseen new environment using a "leave-one-out" approach. Our findings show that the two baseline models and ours are not robust to unseen room conditions. Statistical analysis further confirms that reverberation influences model predictions and introduces an overestimation bias.

cs.SD↗

Efficient approximation of regularized relative entropies and applications

The quantum relative entropy is a fundamental quantity in quantum information science, characterizing the distinguishability between two quantum states. However, this quantity is not additive in general for correlated quantum states, necessitating regularization for precise characterization of the operational tasks of interest. Recently, we proposed the study of the regularized relative entropy between two sequences of sets of quantum states in [arXiv:2411.04035], which captures a general framework for a wide range of quantum information tasks. Here, we show that given suitable structural assumptions and efficient descriptions of the sets, the regularized relative entropy can be efficiently approximated within an additive error by a quantum relative entropy program of polynomial size. This applies in particular to the regularized relative entropy in adversarial quantum channel discrimination. Moreover, we apply the idea of efficient approximation to quantum resource theories. In particular, when the set of interest does not directly satisfy the required structural assumptions, it can be relaxed to one that does. This provides improved and efficient bounds for the entanglement cost of quantum states and channels, entanglement distillation and magic state distillation. Numerical results demonstrate improvements even for the first level of approximation.

quant-ph↗

Baichuan 2: Open Large-scale Language Models

Large language models (LLMs) have demonstrated remarkable performance on a variety of natural language tasks based on just a few examples of natural language instructions, reducing the need for extensive feature engineering. However, most powerful LLMs are closed-source or limited in their capability for languages other than English. In this technical report, we present Baichuan 2, a series of large-scale multilingual language models containing 7 billion and 13 billion parameters, trained from scratch, on 2.6 trillion tokens. Baichuan 2 matches or outperforms other open-source models of similar size on public benchmarks like MMLU, CMMLU, GSM8K, and HumanEval. Furthermore, Baichuan 2 excels in vertical domains such as medicine and law. We will release all pre-training model checkpoints to benefit the research community in better understanding the training dynamics of Baichuan 2.

cs.CL↗

Multi-head Ensemble of Smoothed Classifiers for Certified Robustness

Randomized Smoothing (RS) is a promising technique for certified robustness, and recently in RS the ensemble of multiple Deep Neural Networks (DNNs) has shown state-of-the-art performances due to its variance reduction effect over Gaussian noises. However, such an ensemble brings heavy computation burdens in both training and certification, and yet under-exploits individual DNNs and their mutual effects, as the communication between these classifiers is commonly ignored in optimization. In this work, we consider a novel ensemble-based training way for a single DNN with multiple augmented heads, named as SmOothed Multi-head Ensemble (SOME). In SOME, similar to the pursuit of variance reduction via ensemble, an ensemble of multiple heads imposed with a cosine constraint inside a single DNN is employed with much cheaper training and certification computation overloads in RS. In such network structure, an associated training strategy is designed by introducing a circular communication flow among those augmented heads. That is, each head teaches its neighbor with the self-paced learning strategy using smoothed losses, which are specifically designed in relation to certified robustness. The deployed multi-head structure and the circular-teaching scheme in SOME jointly contribute to the diversities among multiple heads and benefit their ensemble, leading to a competitively stronger certifiably-robust RS-based defense than ensembling multiple DNNs (effectiveness) at the cost of much less computational expenses (efficiency), verified by extensive experiments and discussions.

cs.LG↗

Discrete treatment of inverse Compton scattering: implications on parameter estimation in gamma-ray astronomy

In gamma-ray astronomy and cosmic-ray physics, the continuous approximation of inverse Compton scattering (ICS) is widely adopted to model the evolution of electron energy. However, when the initial electron energy approaches $\sim100$ TeV, the discrete nature of ICS becomes prominent, and the energy of evolved electrons should be considered as a broad distribution rather than a deterministic value. By simulating the evolution paths of individual electrons under ICS, we capture this discrete nature and demonstrate that when the electron injection spectrum exhibits a high-energy cutoff, the correct discrete treatment yields a higher cutoff energy in the evolved spectrum compared to the continuous approximation. Applying the discrete ICS treatment to interpret the gamma-ray spectrum of the Geminga pulsar halo measured by HAWC, we find that the inferred cutoff energy of the injection spectrum is correspondingly lower than that derived using the continuous approximation at a $95\%$ confidence level. This suggests that the systematic bias introduced by the approximation has exceeded the measurement precision. We also expect the application of the discrete ICS correction in the PeV regime using the ultra-high-energy gamma-ray source 1LHAASO J1954+2836u as a case study, pointing out that adopting the continuous approximation may considerably overestimate the electron acceleration capability of the source.

astro-ph.HE↗

Prediction of lithium isotope fluxes using data-driven production cross sections

Galactic cosmic rays (CRs) generally share common propagation features, leading to consistent spectral observations of secondary nuclei such as Li, Be, and B. However, the Li spectrum predicted by the CR diffusion coefficient inferred from B/C is significantly lower than the latest measurement of AMS-02. This anomaly may be attributed to the missing contributions from the heavy nuclei components in cosmic rays. By including these missing contributions the excess of the Li spectrum disappears. However, another inconsistency still exists since the calculated Li spectrum is now overestimated compared to the data. In this work, we update the cross-section model used to calculate the Li production according to more cross-section measurements. We find that the cross sections of these added reactions are systematically overestimated, and should be renormalized to the interpolations of available data. As a result, our prediction of the total Li spectrum is consistent with the measurement without discrepancy, and our prediction of the $\rm^6Li$ and $\rm^7Li$ spectra are consistent with the preliminary measurements of AMS-02 within the cross-section uncertainties.

astro-ph.HE↗

Deciphering the spectral bumps of Galactic cosmic rays through gamma-ray observations of nearby molecular clouds

The observed spectral bump in cosmic-ray (CR) proton and helium spectra, along with the phase and amplitude evolution of CR dipole anisotropy, provide plausible yet indirect evidence for the presence of a nearby CR source. This study investigates the potential of giant molecular clouds (GMCs) located near the solar system to act as natural probes of CRs from the nearby source, with their gamma-ray emissions serving as indicators of spatial variations in CR flux within the solar neighborhood resulting from this source. We show that a nearby source, accounting for the CR data, could imprint distinct features on the $γ$-ray spectra of different GMCs. We expect that these features are detectable by LHAASO and upcoming high-energy $γ$-ray observatories, providing a powerful test for the hypothesized nearby source. Notably, we find that determining the energy dependence of the $γ$-ray spectral index offers a promising approach to investigate the nearby source and constrain its distance. Conversely, if the spectral bump is a widespread Galactic phenomenon, the energy dependence would exhibit uniformity across all GMCs, distinguishing the underlying mechanism accounting for the spectral bump from the scenario involving a nearby source.

astro-ph.HE↗

Exploring GPT's Ability as a Judge in Music Understanding

Recent progress in text-based Large Language Models (LLMs) and their extended ability to process multi-modal sensory data have led us to explore their applicability in addressing music information retrieval (MIR) challenges. In this paper, we use a systematic prompt engineering approach for LLMs to solve MIR problems. We convert the music data to symbolic inputs and evaluate LLMs' ability in detecting annotation errors in three key MIR tasks: beat tracking, chord extraction, and key estimation. A concept augmentation method is proposed to evaluate LLMs' music reasoning consistency with the provided music concepts in the prompts. Our experiments tested the MIR capabilities of Generative Pre-trained Transformers (GPT). Results show that GPT has an error detection accuracy of 65.20%, 64.80%, and 59.72% in beat tracking, chord extraction, and key estimation tasks, respectively, all exceeding the random baseline. Moreover, we observe a positive correlation between GPT's error finding accuracy and the amount of concept information provided. The current findings based on symbolic music input provide a solid ground for future LLM-based MIR research.

cs.IR↗

Kernel PCA for Out-of-Distribution Detection

Out-of-Distribution (OoD) detection is vital for the reliability of Deep Neural Networks (DNNs). Existing works have shown the insufficiency of Principal Component Analysis (PCA) straightforwardly applied on the features of DNNs in detecting OoD data from In-Distribution (InD) data. The failure of PCA suggests that the network features residing in OoD and InD are not well separated by simply proceeding in a linear subspace, which instead can be resolved through proper non-linear mappings. In this work, we leverage the framework of Kernel PCA (KPCA) for OoD detection, and seek suitable non-linear kernels that advocate the separability between InD and OoD data in the subspace spanned by the principal components. Besides, explicit feature mappings induced from the devoted task-specific kernels are adopted so that the KPCA reconstruction error for new test samples can be efficiently obtained with large-scale data. Extensive theoretical and empirical results on multiple OoD data sets and network structures verify the superiority of our KPCA detector in efficiency and efficacy with state-of-the-art detection performance.

cs.LG↗

Baichuan Alignment Technical Report

We introduce Baichuan Alignment, a detailed analysis of the alignment techniques employed in the Baichuan series of models. This represents the industry's first comprehensive account of alignment methodologies, offering valuable insights for advancing AI research. We investigate the critical components that enhance model performance during the alignment process, including optimization methods, data strategies, capability enhancements, and evaluation processes. The process spans three key stages: Prompt Augmentation System(PAS), Supervised Fine-Tuning(SFT), and Preference Alignment. The problems encountered, the solutions applied, and the improvements made are thoroughly recorded. Through comparisons across well-established benchmarks, we highlight the technological advancements enabled by Baichuan Alignment. Baichuan-Instruct is an internal model, while Qwen2-Nova-72B and Llama3-PBM-Nova-70B are instruct versions of the Qwen2-72B and Llama-3-70B base models, optimized through Baichuan Alignment. Baichuan-Instruct demonstrates significant improvements in core capabilities, with user experience gains ranging from 17% to 28%, and performs exceptionally well on specialized benchmarks. In open-source benchmark evaluations, both Qwen2-Nova-72B and Llama3-PBM-Nova-70B consistently outperform their respective official instruct versions across nearly all datasets. This report aims to clarify the key technologies behind the alignment process, fostering a deeper understanding within the community. Llama3-PBM-Nova-70B model is available at https://huggingface.co/PKU-Baichuan-MLSystemLab/Llama3-PBM-Nova-70B.

cs.LG↗