arXiv subjects

Kun Chen

Publications and source records attributed to Kun Chen.

At least 91 records · Page 5Linked to original sources

arXiv2025

The Empirical Spectral Distribution of i.i.d. Random Matrices with Random Perturbations

A large i.i.d. random matrix with deterministic low-rank perturbation has been extensively studied, particularly in the aspects of the ESD (Empirical Spectral Distribution) and the outliers of eigenvalues. In this work, we investigate the analogous scenario where the perturbation is random and extend the previous results from the deterministic perturbation to the random case. Specifically, we consider an i.i.d. matrix with random perturbation, $\mathbf{M}$. Our results show that: (i) the eigenvalue outliers of $\mathbf{M}$ converge to the eigenvalues of its perturbation; (ii) the ESD of $\mathbf{M}$ converges to the circular law; (iii) the eigenvector alignment holds for specific perturbations. As an application of the above random matrices, we present the first optimal query complexity lower bound for approximating the top eigenvector of asymmetric matrices. In the inverse polynomial accuracy regime, the complexity matches the upper bounds that can be obtained via the power method. As far as we know, it is the first lower bound for approximating the eigenvector of an asymmetric matrix.

cs.IT↗

arXiv2025

DEMO: Reframing Dialogue Interaction with Fine-grained Element Modeling

Large language models (LLMs) enabled dialogue systems have become one of the central modes in human-machine interaction, which bring about vast amounts of conversation logs and increasing demand for dialogue generation. The dialogue's life-cycle spans from $\textit{Prelude}$ through $\textit{Interlocution}$ to $\textit{Epilogue}$, encompassing rich dialogue elements. Despite large volumes of dialogue-related studies, there is a lack of systematic investigation into the dialogue stages to frame benchmark construction that covers comprehensive dialogue elements. This hinders the precise modeling, generation and assessment of LLMs-based dialogue systems. To bridge this gap, in this paper, we introduce a new research task--$\textbf{D}$ialogue $\textbf{E}$lement $\textbf{MO}$deling, including $\textit{Element Awareness}$ and $\textit{Dialogue Agent Interaction}$, and propose a novel benchmark, $\textbf{DEMO}$, designed for a comprehensive dialogue modeling and assessment. On this basis, we further build the DEMO agent with the adept ability to model dialogue elements via imitation learning. Extensive experiments on DEMO indicate that current representative LLMs still have considerable potential for enhancement, and our DEMO agent performs well in both dialogue element modeling and out-of-domain tasks.

cs.CL↗

arXiv2025

Align-DA: Align Score-based Atmospheric Data Assimilation with Multiple Preferences

Data assimilation (DA) aims to estimate the full state of a dynamical system by combining partial and noisy observations with a prior model forecast, commonly referred to as the background. In atmospheric applications, this problem is fundamentally ill-posed due to the sparsity of observations relative to the high-dimensional state space. Traditional methods address this challenge by simplifying background priors to regularize the solution, which are empirical and require continual tuning for application. Inspired by alignment techniques in text-to-image diffusion models, we propose Align-DA, which formulates DA as a generative process and uses reward signals to guide background priors, replacing manual tuning with data-driven alignment. Specifically, we train a score-based model in the latent space to approximate the background-conditioned prior, and align it using three complementary reward signals for DA: (1) assimilation accuracy, (2) forecast skill initialized from the assimilated state, and (3) physical adherence of the analysis fields. Experiments with multiple reward signals demonstrate consistent improvements in analysis quality across different evaluation metrics and observation-guidance strategies. These results show that preference alignment, implemented as a soft constraint, can automatically adapt complex background priors tailored to DA, offering a promising new direction for advancing the field.

physics.ao-ph↗

arXiv2025

Human-In-The-Loop Software Development Agents: Challenges and Future Directions

Multi-agent LLM-driven systems for software development are rapidly gaining traction, offering new opportunities to enhance productivity. At Atlassian, we deployed Human-in-the-Loop Software Development Agents to resolve Jira work items and evaluated the generated code quality using functional correctness testing and GPT-based similarity scoring. This paper highlights two major challenges: the high computational costs of unit testing and the variability in LLM-based evaluations. We also propose future research directions to improve evaluation frameworks for Human-In-The-Loop software development tools.

cs.SE↗

arXiv2025

Integrative Learning of Quantum Dot Intensity Fluctuations under Excitation via Tailored Dynamic Mixture Modeling

Semiconductor nano-crystals, known as quantum dots (QDs), have attracted significant attention for their unique fluorescence properties. Under continuous excitation, QDs emit photons with intricate intensity fluctuation: the intensity of photon emission fluctuates during the excitation, and such a fluctuation pattern can vary across different QDs even under the same experimental conditions. What adding to the complication is that the processed intensity series are non-Gaussian and truncated due to necessary thresholding and normalization. Conventional normality-based single-dot analysis fall short of addressing these complexities. In collaboration with chemists, we develop an integrative learning approach to simultaneously analyzing intensity series from multiple QDs. Motivated by the unique data structure and the hypothesized behaviors of the QDs, our approach leverages the celebrated hidden Markov model as its structural backbone to characterize individual dot intensity fluctuations, while assuming that, in each state the normalized intensity follows a 0/1 inflated Beta distribution, the state/emission distributions are shared across the QDs, and the state transition dynamics can vary among a few QD clusters. This framework allows for a precise, collective characterization of intensity fluctuation patterns and have the potential to transform current practice in chemistry. Applying our method to experimental data from 128 QDs, we reveal three shared intensity states and capture several distinct intensity transition patterns, underscoring the effectiveness of our approach in providing deeper insights into QD behaviors and their design and application potential.

physics.app-ph↗

arXiv2025

Matsubara-Frequency-Resolved Spin Exchange-Correlation Kernel for the Three-Dimensional Uniform Electron Gas

The spin Coulomb drag effect, arising from the exchange of momentum between electrons of opposite spins, plays a crucial role in the spin transport of interacting electron systems and can be characterized by the exchange-correlation (XC) kernel in the spin channel $K_{\rm XC}^-(q,ω)$. Using the state-of-the-art Variational Diagrammatic Monte Carlo approach, we compute the Matsubara-frequency-resolved spin XC kernel $K_{\rm XC}^-(q,iω_n)$ for the three-dimensional uniform electron gas at sufficiently low temperatures with high precision. In the long-wavelength limit, we identified a singular behavior of the form $A(iω_n)/q^2$, confirming the theoretically predicted ultranonlocal behavior associated with spin Coulomb drag. Analysis of this structure in the low frequency region enables precise determination of two crucial parameters characterizing the spin Coulomb drag effect: the spin mass enhancement factor and spin diffusion relaxation time. We observe a significant trend of increasing enhancement of the spin mass factor with decreasing electron density, and provide clear evidence for the suppression of spin diffusion at low temperatures. These quantitative findings advance our understanding of Coulomb interaction effects on spin transport and provide essential parameters for time-dependent density functional theory and spintronics applications.

cond-mat.str-el↗

arXiv2025

Quantum Phases for Finite-Temperature Gases of Bosonic Polar Molecules Shielded by Dual Microwaves

We investigate the finite-temperature phase diagram of polar molecules shielded by dual microwave fields using the path integral Monte Carlo method combined with the worm algorithm. We determine the critical temperature $T_c$ for Bose-Einstein condensations (BECs) and identify two distinct phases below $T_c$: the expanding gas (EG) phase and the self-bound gas (SBG) phase. We further analyze the temperature and interaction-strength dependence of the condensate and superfluid fractions. Notably, in contrast to dilute atomic BECs, the SBG phase displays a low condensate fraction and a high superfluid fraction, resembling the behavior of strongly correlated $^4$He superfluids. These significant many-body correlations arise from the interplay between long-range dipole-dipole interactions and the short-range shielding potential. Furthermore, we demonstrate that the aspect ratio of the gas provides a characteristic geometric signature to accurately determine the EG-to-SBG transition, robust against external trapping potentials. Our findings provide unbiased and numerically exact results to guide upcoming experiments with polar molecules.

cond-mat.quant-gas↗

arXiv2025

Satellite Observations Guided Diffusion Model for Accurate Meteorological States at Arbitrary Resolution

Accurate acquisition of surface meteorological conditions at arbitrary locations holds significant importance for weather forecasting and climate simulation. Due to the fact that meteorological states derived from satellite observations are often provided in the form of low-resolution grid fields, the direct application of spatial interpolation to obtain meteorological states for specific locations often results in significant discrepancies when compared to actual observations. Existing downscaling methods for acquiring meteorological state information at higher resolutions commonly overlook the correlation with satellite observations. To bridge the gap, we propose Satellite-observations Guided Diffusion Model (SGD), a conditional diffusion model pre-trained on ERA5 reanalysis data with satellite observations (GridSat) as conditions, which is employed for sampling downscaled meteorological states through a zero-shot guided sampling strategy and patch-based methods. During the training process, we propose to fuse the information from GridSat satellite observations into ERA5 maps via the attention mechanism, enabling SGD to generate atmospheric states that align more accurately with actual conditions. In the sampling, we employed optimizable convolutional kernels to simulate the upscale process, thereby generating high-resolution ERA5 maps using low-resolution ERA5 maps as well as observations from weather stations as guidance. Moreover, our devised patch-based method promotes SGD to generate meteorological states at arbitrary resolutions. Experiments demonstrate SGD fulfills accurate meteorological states downscaling to 6.25km.

cs.LG↗

arXiv2025

Salvaging Forbidden Treasure in Medical Data: Utilizing Surrogate Outcomes and Single Records for Rare Event Modeling

The vast repositories of Electronic Health Records (EHR) and medical claims hold untapped potential for studying rare but critical events, such as suicide attempt. Conventional setups often model suicide attempt as a univariate outcome and also exclude any ``single-record'' patients with a single documented encounter due to a lack of historical information. However, patients who were diagnosed with suicide attempts at the only encounter could, to some surprise, represent a substantial proportion of all attempt cases in the data, as high as 70--80%. We innovate a hybrid and integrative learning framework to leverage concurrent outcomes as surrogates and harness the forbidden yet precious information from single-record data. Our approach employs a supervised learning component to learn the latent variables that connect primary (e.g., suicide) and surrogate outcomes (e.g., mental disorders) to historical information. It simultaneously employs an unsupervised learning component to utilize the single-record data, through the shared latent variables. As such, our approach offers a general strategy for information integration that is crucial to modeling rare conditions and events. With hospital inpatient data from Connecticut, we demonstrate that single-record data and concurrent diagnoses indeed carry valuable information, and utilizing them can substantially improve suicide risk modeling.

stat.ME↗

arXiv2025

Human-In-the-Loop Software Development Agents

Recently, Large Language Models (LLMs)-based multi-agent paradigms for software engineering are introduced to automatically resolve software development tasks (e.g., from a given issue to source code). However, existing work is evaluated based on historical benchmark datasets, rarely considers human feedback at each stage of the automated software development process, and has not been deployed in practice. In this paper, we introduce a Human-in-the-loop LLM-based Agents framework (HULA) for software development that allows software engineers to refine and guide LLMs when generating coding plans and source code for a given task. We design, implement, and deploy the HULA framework into Atlassian JIRA for internal uses. Through a multi-stage evaluation of the HULA framework, Atlassian software engineers perceive that HULA can minimize the overall development time and effort, especially in initiating a coding plan and writing code for straightforward tasks. On the other hand, challenges around code quality remain a concern in some cases. We draw lessons learned and discuss opportunities for future work, which will pave the way for the advancement of LLM-based agents in software development.

cs.SE↗

arXiv2025

Majorization-Minimization Dual Stagewise Algorithm for Generalized Lasso

The generalized lasso is a natural generalization of the celebrated lasso approach to handle structural regularization problems. Many important methods and applications fall into this framework, including fused lasso, clustered lasso, and constrained lasso. To elevate its effectiveness in large-scale problems, extensive research has been conducted on the computational strategies of generalized lasso. However, to our knowledge, most studies are under the linear setup, with limited advances in non-Gaussian and non-linear models. We propose a majorization-minimization dual stagewise (MM-DUST) algorithm to efficiently trace out the full solution paths of the generalized lasso problem. The majorization technique is incorporated to handle different convex loss functions through their quadratic majorizers. Utilizing the connection between primal and dual problems and the idea of ``slow-brewing'' from stagewise learning, the minimization step is carried out in the dual space through a sequence of simple coordinate-wise updates on the dual coefficients with a small step size. Consequently, selecting an appropriate step size enables a trade-off between statistical accuracy and computational efficiency. We analyze the computational complexity of MM-DUST and establish the uniform convergence of the approximated solution paths. Extensive simulation studies and applications with regularized logistic regression and Cox model demonstrate the effectiveness of the proposed approach.

stat.ML↗

arXiv2024

GORAM: Graph-oriented ORAM for Efficient Ego-centric Queries on Federated Graphs

Ego-centric queries, focusing on a target vertex and its direct neighbors, are essential for various applications. Enabling such queries on graphs owned by mutually distrustful data providers, without breaching privacy, holds promise for more comprehensive results. In this paper, we propose GORAM, a graph-oriented data structure that enables efficient ego-centric queries on federated graphs with strong privacy guarantees. GORAM is built upon secure multi-party computation (MPC) and ensures that no single party can learn any sensitive information about the graph data or the querying keys during the process. However, achieving practical performance with privacy guaranteed presents a challenge. To overcome this, GORAM is designed to partition the federated graph and construct an Oblivious RAM(ORAM)-inspired index atop these partitions. This design enables each ego-centric query to process only a single partition, which can be accessed fast and securely. To evaluate the performance of GORAM, we developed a prototype querying engine on a real-world MPC framework. We conduct a comprehensive evaluation with five commonly used queries on both synthetic and real-world graphs. Our evaluation shows that all benchmark queries can be completed in just 58.1 milliseconds to 35.7 seconds, even on graphs with up to 41.6 million vertices and 1.4 billion edges. To the best of our knowledge, this represents the first instance of processing billion-scale graphs with practical performance on MPC.

cs.DB↗

arXiv2024

A General PSTD Method to Solve Quantum Scattering in the Fresnel and Far-field regions by A Localized Potential of Arbitrary Form

We present a time domain method to solve quantum scattering by an arbitrary potential of finite range. The scattering wave function in full space can be obtained, including the near field, the mid field (i.e. Fresnel region) and the far field. This is achieved by extending several techniques of FDTD computational electrodynamics into the quantum realm. The total-field/scattered-field scheme naturally incorporates the incidence source condition. The wave function in the internal model, including the interaction region and the close near field, is directly computed through PSTD/FDTD iterations. The quantum version of surface equivalence theorem is proven and links the wave function in the external free space to the PSTD/FDTD solution in the internal model. Parallel implementation of PSTD based on overlapping domain decomposition and FFT on local Fourier-basis is briefly discussed. These building blocks unite into a numerical system that provides a general, robust solver to potential scattering problems. Its accuracy is verified by the established partial wave method, by comparing the predictions of both on the central square potential scattering. Further investigations show the far-field solution is inadequate for simulating Fresnel-region effects.

quant-ph↗

arXiv2024

A Novel Pseudo-Spectral Time-Domain Theory of Magnetic Neutron Scattering Illustrated Using A Uniformly Magnetized Sphere

A universal numerical method is developed for the investigation of magnetic neutron scattering. By applying the pseudospectral-time-domain (PSTD) algorithm to the spinor version of the Schrödinger equation, the evolution of the spin-state of the scattered wave can be solved in full space and time. This extra spin degree of freedom brings some unique new features absent in the numerical theory on the scalar wave scatterings [1]. Different numerical stability condition has to be re-derived due to the coupling between the different spin states. As the simplest application, the neutron scattering by the magnetic field of a uniformly magnetized sphere is studied. The PSTD predictions are compared with those from the Born-approximation. This work not only provides a systematic tool for analyzing spin-matter interactions, but also builds the forward model for testing novel neutron imaging methodologies, such as the newly developed thermal neutron Fourier-transform ghost imaging.

quant-ph↗

arXiv2024

Charge and Entanglement Criticality in a U(1)-Symmetric Hybrid Circuit of Qubits

We study critical properties of the entanglement and charge-sharpening measurement-induced phase transitions in a non-unitary quantum circuit evolving with a U(1) conserved charge. Our numerical estimation of the critical properties of the entanglement transition at finite system sizes appears distinct from the generic non-conserving case and percolation. We provide two possible interpretations of this observation: (a) these two transitions occur at different measurement rates in the thermodynamic limit, but at finite system sizes their critical fans overlap and the critical exponents we probed here show a combination of both the criticality. Nonetheless, the multifractal properties of the entanglement transition remain distinct from the generic case without any symmetry, indicating a unique universality class due to the U(1) symmetry. (b) these two transitions occur at the same measurement rate at any length scale. Within this interpretation, our estimation of all the critical exponents are sharply different than the non-conserving case, again confirming the presence of a new universality class due U(1) symmetry. We compute entanglement critical exponents and correlation functions via various ancilla measures, use a transfer matrix for multifractality, and compute correlators associated with charge sharpening to explain these findings. Through these correlators, we also find evidence consistent with the charge-sharpening transition being of the Berezinskii-Kosterlitz-Thouless type (including the predicted ``jump'' in stiffness), which simultaneously argues for a broad critical fan for this transition. As a result, attempts to measure critical properties in this finite-size system will see anomalously large exponents predicted by our numerical analysis.

cond-mat.dis-nn↗

arXiv2024

The two-dimensional homogeneous electron gas with symmetric dual-gate screening: exchange-correlation functional and other ground-state properties

The two-dimensional (2D) homogeneous electron gas (HEG) is a fundamental model in quantum many-body physics. It is important to theoretical and computational studies, where exchange-correlation energies computed in it serve as the foundation for density-functional calculations. It is also of direct relevance to a variety of experimental settings, especially with the rapid recent growth in 2D materials and moiré systems. In these experiments, metallic gates are often present, which screen the Coulomb interaction between electrons. The effect of the screening can qualitatively change the behavior of the 2D HEG, and requires accurate many-body computations to capture. In this work, we perform state-of-the-art diffusion Monte Carlo (DMC) calculations in the 2D HEG subjected to symmetric dual-gate screening. We systematically compute the correlation energy across a range of densities and gate separations for both spin unpolarized and fully polarized systems. A global fit is obtained for the correlation energy, using these data and imposing various limiting behaviors obtained from perturbation analysis. The new functional will allow density-functional calculations to be performed for a variety of realistic experimental setups which can accurately account for the presence of gates. We also investigate how the gate screening affects the bulk modulus, pair correlation function, and the structure factor of the 2D HEG, which can potentially be probed in experiments.

cond-mat.str-el↗

arXiv2024

PostCast: Generalizable Postprocessing for Precipitation Nowcasting via Unsupervised Blurriness Modeling

Precipitation nowcasting plays a pivotal role in socioeconomic sectors, especially in severe convective weather warnings. Although notable progress has been achieved by approaches mining the spatiotemporal correlations with deep learning, these methods still suffer severe blurriness as the lead time increases, which hampers accurate predictions for extreme precipitation. To alleviate blurriness, researchers explore generative methods conditioned on blurry predictions. However, the pairs of blurry predictions and corresponding ground truth need to be generated in advance, making the training pipeline cumbersome and limiting the generality of generative models within blur modes that appear in training data. By rethinking the blurriness in precipitation nowcasting as a blur kernel acting on predictions, we propose an unsupervised postprocessing method to eliminate the blurriness without the requirement of training with the pairs of blurry predictions and corresponding ground truth. Specifically, we utilize blurry predictions to guide the generation process of a pre-trained unconditional denoising diffusion probabilistic model (DDPM) to obtain high-fidelity predictions with eliminated blurriness. A zero-shot blur kernel estimation mechanism and an auto-scale denoise guidance strategy are introduced to adapt the unconditional DDPM to any blurriness modes varying from datasets and lead times in precipitation nowcasting. Extensive experiments are conducted on 7 precipitation radar datasets, demonstrating the generality and superiority of our method.

cs.CV↗

arXiv2024

Partial Renormalization of Quasiparticle Interactions

Nonlocal effective interactions are inherent to non-relativistic quantum many-body systems, but their systematic resummation poses a significant challenge known as the ``vertex problem" in many-body perturbation theory. We introduce a renormalization scheme based on a projection-based renormalization condition that selectively resums the most essential nonlocal contributions to the effective interaction vertex, avoiding the computational complexity of the full vertex function. This enables us to derive a renormalized Feynman diagrammatic series with large parameters canceled by counter-diagrams, efficiently generated using a perturbative expansion of the parquet equations and computed using a diagrammatic Monte Carlo algorithm. Applying our approach to a 3D Yukawa Fermi liquid, we demonstrate that the renormalized perturbation theory remains predictive even in the strongly correlated regime and uncover significant sign cancellations between different channels contributing to the scattering amplitude. Our work establishes a novel framework for investigating strong correlations in quantum many-body systems, offering a systematic approach to explore nonlocal theories for challenging systems like the electron liquid in material science.

cond-mat.str-el↗