arXiv subjects

Hanlin Yu

Publications and source records attributed to Hanlin Yu.

18 recordsLinked to original sources

arXiv2026

Few-Step Boltzmann Generators via Scalable Likelihood Flow Maps

Recent progress in flow-based generative modeling has led to models that output high-quality samples while using only a small number of function evaluations. However, at present, there is a lack of similar advances in estimating the model likelihood. In particular, most existing methods either rely on restrictive architectures that enable exact calculations, or use stochastic approximations such as Hutchinson's trace estimator that introduce substantial variance. In this work, we introduce SCAlable LikeLihood distillation of flOw maPs (SCALLOP). SCALLOP builds on the recently proposed F2D2, a likelihood flow map model that can generate samples and their densities in a small number of function evaluations. While F2D2 uses Hutchinson's estimator during training, we introduce an alternative and more scalable likelihood distillation objective that is Hutchinson-free and admits a vectorized formulation. Empirically, we demonstrate the effectiveness of SCALLOP as a Boltzmann generator in molecular science, and further validate its benefit on image datasets. SCALLOP significantly reduces both training variance and training time while consistently improving performance compared to F2D2, and is competitive with the state-of-the-art while achieving up to 10x inference speedup over the fastest baseline.

cs.LG↗

arXiv2026

Learning Energy-Based Models from Stochastic Interpolants using Spatiotemporal Differences

Learning an energy-based model from data samples is a central problem in machine learning. Many recent and popular methods, such as denoising score matching for training energy-based diffusion models, use stochastic interpolants to corrupt data samples at different noise levels indexed by a time variable. This defines a joint density over both the data space and time, and most methods learn its energy through either spatial or temporal differences. We identify distinct failure modes for both of these approaches. To solve them, we propose Spatiotemporal Noise-Contrastive Estimation (stNCE), a framework for learning the energy through joint spatiotemporal differences. stNCE unifies many existing methods and leads to new training objectives. Experiments on images and molecules demonstrate performance competitive with state-of-the-art density estimation methods.

cs.LG↗

arXiv2026

RVCBench: Benchmarking the Robustness of Voice Cloning Across Modern Audio Generation Models

Modern voice cloning, also known as zero-shot text-to-speech (TTS), can synthesize speech that closely matches a target speaker from only seconds of reference audio, enabling applications such as personalized speech interfaces and dubbing. In practice, these systems often face noisy reference audio, imperfect text prompts, multilingual and long-form generation, post-processing, and adversarial perturbations, all of which can weaken robustness. Despite rapid progress in codec-token language models and diffusion-based TTS, robustness under realistic deployment shifts remains underexplored. This paper introduces RVCBench, a comprehensive dataset and benchmark for evaluating robustness in voice cloning. RVCBench provides task-aligned tests covering controlled text-audio pairing, multilingual and long-form scenarios, expressive prompts, post-processing conditions, and passive or proactive audio perturbations. Across 18 robustness evaluations, 225 speakers, and 14,370 utterances, RVCBench supports unified evaluation of input sensitivity, generation stability, output resilience, perturbation robustness, speaker similarity, and deepfake detectability. We evaluate 18 representative open-source voice cloning models and reveal systematic vulnerabilities in content consistency, speaker similarity, long-form stability, post-processing resilience, adversarial robustness, and detector-facing separability. We release the code and dataset to support reproducible evaluation and future research on robust voice cloning, speech synthesis, and audio generation. Code: https://github.com/Nanboy-Ronan/RVCBench. Dataset: https://huggingface.co/datasets/Nanboy/RVCBench.

cs.SD↗

arXiv2025

Leveraging Multiple Speech Enhancers for Non-Intrusive Intelligibility Prediction for Hearing-Impaired Listeners

Speech intelligibility evaluation for hearing-impaired (HI) listeners is essential for assessing hearing aid performance, traditionally relying on listening tests or intrusive methods like HASPI. However, these methods require clean reference signals, which are often unavailable in real-world conditions, creating a gap between lab-based and real-world assessments. To address this, we propose a non-intrusive intelligibility prediction framework that leverages speech enhancers to provide a parallel enhanced-signal pathway, enabling robust predictions without reference signals. We evaluate three state-of-the-art enhancers and demonstrate that prediction performance depends on the choice of enhancer, with ensembles of strong enhancers yielding the best results. To improve cross-dataset generalization, we introduce a 2-clips augmentation strategy that enhances listener-specific variability, boosting robustness on unseen datasets. Our approach consistently outperforms the non-intrusive baseline, CPC2 Champion across multiple datasets, highlighting the potential of enhancer-guided non-intrusive intelligibility prediction for real-world applications.

cs.SD↗

arXiv2025

Reference-aware SFM layers for intrusive intelligibility prediction

Intrusive speech-intelligibility predictors that exploit explicit reference signals are now widespread, yet they have not consistently surpassed non-intrusive systems. We argue that a primary cause is the limited exploitation of speech foundation models (SFMs). This work revisits intrusive prediction by combining reference conditioning with multi-layer SFM representations. Our final system achieves RMSE 22.36 on the development set and 24.98 on the evaluation set, ranking 1st on CPC3. These findings provide practical guidance for constructing SFM-based intrusive intelligibility predictors.

eess.AS↗

arXiv2025

Pressure-Induced Low-Spin State Destabilization and Piezo-Chromic Effect in an Iron(II) Spin Crossover Complex with Pyrazol-Pyridine-Triazolate Coordination Core

Rapidly developing science and technology demand new materials with versatile and promising properties for practical applications. In this context, pseudo-octahedral iron(II) spin crossover (SCO) complexes are particularly appealing - not only for their fundamental scientific interest but also for their potential as key components in the development of multifunctional switchable molecular materials and novel technological applications. This work presents the synthesis and structure of a new mononuclear SCO complex [FeII(L)2]0*nMeOH (n = 2, 0) where L is the asymmetrically substituted tridentate ligand [4-trifluoromethylphenyl-(1H-1,2,4-triazol-5-yl)-6-(1H-pyrazol-1-yl)pyridine]. Due to high trigonal distortion, the solvated form (n = 2) remains high spin (HS) at all temperatures. In contrast, the more regular Oh geometry of the unsolvated form, 4CF3, favors a complete spin transition (ST) at room temperature, which has been investigated, in the pressure interval 0-0.64 GPa, by means of its magnetic and optical properties. Contrary to intuition and experience, the increase of pressure on 4CF3 denotes a radically abnormal behavior of this ST, involving: i) decrease of the characteristic temperatures, ii) increase of the high-spin molar fraction in the temperature range where the low-spin state is stable at ambient pressure; iii) increase of the thermal hysteresis width; and iv) above certain threshold pressure, full stabilization of the high-spin state. All these observations have been explained in the framework of a thermodynamic that model based on the elastic interactions.

cond-mat.mtrl-sci↗

arXiv2025

Connecting Neural Models Latent Geometries with Relative Geodesic Representations

Neural models learn representations of high-dimensional data on low-dimensional manifolds. Multiple factors, including stochasticities in the training process, model architectures, and additional inductive biases, may induce different representations, even when learning the same task on the same data. However, it has recently been shown that when a latent structure is shared between distinct latent spaces, relative distances between representations can be preserved, up to distortions. Building on this idea, we demonstrate that exploiting the differential-geometric structure of latent spaces of neural models, it is possible to capture precisely the transformations between representational spaces trained on similar data distributions. Specifically, we assume that distinct neural models parametrize approximately the same underlying manifold, and introduce a representation based on the pullback metric that captures the intrinsic structure of the latent space, while scaling efficiently to large models. We validate experimentally our method on model stitching and retrieval tasks, covering autoencoders and vision foundation discriminative models, across diverse architectures, datasets, and pretraining schemes.

cs.LG↗

arXiv2025

Learning Geometry and Topology via Multi-Chart Flows

Real world data often lie on low-dimensional Riemannian manifolds embedded in high-dimensional spaces. This motivates learning degenerate normalizing flows that map between the ambient space and a low-dimensional latent space. However, if the manifold has a non-trivial topology, it can never be correctly learned using a single flow. Instead multiple flows must be `glued together'. In this paper, we first propose the general training scheme for learning such a collection of flows, and secondly we develop the first numerical algorithms for computing geodesics on such manifolds. Empirically, we demonstrate that this leads to highly significant improvements in topology estimation.

cs.LG↗

arXiv2025

Geodesic Slice Sampler for Multimodal Distributions with Strong Curvature

Traditional Markov Chain Monte Carlo sampling methods often struggle with sharp curvatures, intricate geometries, and multimodal distributions. Slice sampling can resolve local exploration inefficiency issues, and Riemannian geometries help with sharp curvatures. Recent extensions enable slice sampling on Riemannian manifolds, but they are restricted to cases where geodesics are available in a closed form. We propose a method that generalizes Hit-and-Run slice sampling to more general geometries tailored to the target distribution, by approximating geodesics as solutions to differential equations. Our approach enables the exploration of the regions with strong curvature and rapid transitions between modes in multimodal distributions. We demonstrate the advantages of the approach over challenging sampling problems.

cs.LG↗

arXiv2025

Density Ratio Estimation with Conditional Probability Paths

Density ratio estimation in high dimensions can be reframed as integrating a certain quantity, the time score, over probability paths which interpolate between the two densities. In practice, the time score has to be estimated based on samples from the two densities. However, existing methods for this problem remain computationally expensive and can yield inaccurate estimates. Inspired by recent advances in generative modeling, we introduce a novel framework for time score estimation, based on a conditioning variable. Choosing the conditioning variable judiciously enables a closed-form objective function. We demonstrate that, compared to previous approaches, our approach results in faster learning of the time score and competitive or better estimation accuracies of the density ratio on challenging tasks. Furthermore, we establish theoretical guarantees on the error of the estimated density ratio.

cs.LG↗

arXiv2024

Stochastic variance-reduced Gaussian variational inference on the Bures-Wasserstein manifold

Optimization in the Bures-Wasserstein space has been gaining popularity in the machine learning community since it draws connections between variational inference and Wasserstein gradient flows. The variational inference objective function of Kullback-Leibler divergence can be written as the sum of the negative entropy and the potential energy, making forward-backward Euler the method of choice. Notably, the backward step admits a closed-form solution in this case, facilitating the practicality of the scheme. However, the forward step is not exact since the Bures-Wasserstein gradient of the potential energy involves "intractable" expectations. Recent approaches propose using the Monte Carlo method -- in practice a single-sample estimator -- to approximate these terms, resulting in high variance and poor performance. We propose a novel variance-reduced estimator based on the principle of control variates. We theoretically show that this estimator has a smaller variance than the Monte-Carlo estimator in scenarios of interest. We also prove that variance reduction helps improve the optimization bounds of the current analysis. We demonstrate that the proposed estimator gains order-of-magnitude improvements over the previous Bures-Wasserstein methods.

cs.LG↗

arXiv2024

Non-geodesically-convex optimization in the Wasserstein space

We study a class of optimization problems in the Wasserstein space (the space of probability measures) where the objective function is nonconvex along generalized geodesics. Specifically, the objective exhibits some difference-of-convex structure along these geodesics. The setting also encompasses sampling problems where the logarithm of the target distribution is difference-of-convex. We derive multiple convergence insights for a novel semi Forward-Backward Euler scheme under several nonconvex (and possibly nonsmooth) regimes. Notably, the semi Forward-Backward Euler is just a slight modification of the Forward-Backward Euler whose convergence is -- to our knowledge -- still unknown in our very general non-geodesically-convex setting.

math.OC↗

arXiv2023

Riemannian Laplace Approximation with the Fisher Metric

Laplace's method approximates a target density with a Gaussian distribution at its mode. It is computationally efficient and asymptotically exact for Bayesian inference due to the Bernstein-von Mises theorem, but for complex targets and finite-data posteriors it is often too crude an approximation. A recent generalization of the Laplace Approximation transforms the Gaussian approximation according to a chosen Riemannian geometry providing a richer approximation family, while still retaining computational efficiency. However, as shown here, its properties depend heavily on the chosen metric, indeed the metric adopted in previous work results in approximations that are overly narrow as well as being biased even at the limit of infinite data. We correct this shortcoming by developing the approximation family further, deriving two alternative variants that are exact at the limit of infinite data, extending the theoretical analysis of the method, and demonstrating practical improvements in a range of experiments.

cs.LG↗

arXiv2023

Efficient safe learning for controller tuning with experimental validation

Optimization-based controller tuning is challenging because it requires formulating optimization problems explicitly as functions of controller parameters. Safe learning algorithms overcome the challenge by creating surrogate models from measured data. To ensure safety, such data-driven algorithms often rely on exhaustive grid search, which is computationally inefficient. In this paper, we propose a novel approach to safe learning by formulating a series of optimization problems instead of a grid search. We also develop a method for initializing the optimization problems to guarantee feasibility while using numerical solvers. The performance of the new method is first validated in a simulated precision motion system, demonstrating improved computational efficiency, and illustrating the role of exploiting numerical solvers to reach the desired precision. Experimental validation on an industrial-grade precision motion system confirms that the proposed algorithm achieves 30% better tracking at sub-micrometer precision as a state-of-the-art safe learning algorithm, improves the default auto-tuning solution, and reduces the computational cost seven times compared to learning algorithms based on exhaustive search.

eess.SY↗

arXiv2023

Warped geometric information on the optimisation of Euclidean functions

We consider the fundamental task of optimising a real-valued function defined in a potentially high-dimensional Euclidean space, such as the loss function in many machine-learning tasks or the logarithm of the probability distribution in statistical inference. We use Riemannian geometry notions to redefine the optimisation problem of a function on the Euclidean space to a Riemannian manifold with a warped metric, and then find the function's optimum along this manifold. The warped metric chosen for the search domain induces a computational friendly metric-tensor for which optimal search directions associated with geodesic curves on the manifold becomes easier to compute. Performing optimization along geodesics is known to be generally infeasible, yet we show that in this specific manifold we can analytically derive Taylor approximations up to third-order. In general these approximations to the geodesic curve will not lie on the manifold, however we construct suitable retraction maps to pull them back onto the manifold. Therefore, we can efficiently optimize along the approximate geodesic curves. We cover the related theory, describe a practical optimization algorithm and empirically evaluate it on a collection of challenging optimisation benchmarks. Our proposed algorithm, using 3rd-order approximation of geodesics, tends to outperform standard Euclidean gradient-based counterparts in term of number of iterations until convergence.

stat.ML↗

arXiv2023

The multifunctionality of lanthanum-strontium cobaltite nanopowder: high-pressure magnetic and excellent electrocatalytic properties for OER

Simultaneous study of magnetic and electrocatalytic properties of cobaltites under extreme conditions expands understanding of physical and chemical processes proceeding in them with the possibility of their further practical application. Therefore, La0.6Sr0.4CoO3 (LSCO) nanopowders have been synthesized at different annealing temperatures tann = 850, 875, 900 C, and their multifunctional properties have been studied comprehensively. As tann increases, the rhombohedral perovskite structure of the LSCO becomes more single-phase, whereas average particle size and dispersion grow. Co ions are in mixed valence states, including major Co3+ and Co4+ components. It has been found that the LSCO-900 shows two main Curie temperatures, TC1 and TC2, associated with a particle size distribution. As an external hydrostatic pressure P increases, average and increase from 253 and 175 K under ambient pressure to 268 and 180 K under P = 0.8 GPa, respectively. At the same time, the antiferromagnetic temperature TAFM and blocking temperature TB also increase from 145 and 169 K to 158 and 170 K, respectively. The increment of for the smaller and bigger particles is sufficiently high and equals 10 and 13 K/GPa, respectively. The magnetocaloric effect in the LSCO-900 nanopowder is relatively weak but with an extremely wide peak > 50 K that makes this composition interesting to be used as one of the components of the composite expanding its working temperature window. Moreover, all LSCO samples showed excellent electrocatalytic performance for the overall water splitting (OER) process (overpotentials only 265-285 mV at a current density of 10 mA/cm2) with minimal values for LSCO-900. Based on the XPS data, it was found that the formation of a dense amorphous layer on the surface of the particles ensures high stability as a catalyst (at least 24 h) during electrolysis in 1 M KOH electrolyte.

cond-mat.mtrl-sci↗

arXiv2023

Scalable Stochastic Gradient Riemannian Langevin Dynamics in Non-Diagonal Metrics

Stochastic-gradient sampling methods are often used to perform Bayesian inference on neural networks. It has been observed that the methods in which notions of differential geometry are included tend to have better performances, with the Riemannian metric improving posterior exploration by accounting for the local curvature. However, the existing methods often resort to simple diagonal metrics to remain computationally efficient. This loses some of the gains. We propose two non-diagonal metrics that can be used in stochastic-gradient samplers to improve convergence and exploration but have only a minor computational overhead over diagonal metrics. We show that for fully connected neural networks (NNs) with sparsity-inducing priors and convolutional NNs with correlated priors, using these metrics can provide improvements. For some other choices the posterior is sufficiently easy also for the simpler metrics.

cs.LG↗

arXiv2022

A Light Yield Enhancement Method Using Wavelength Shifter for the STCF EMC

Super Tau-Charm Facility (STCF) is a next-generation high luminosity electron-positron collider facility and is currently one of the major options for accelerator-based particle physics experiment in China. The crystal-based electromagnetic calorimeter (EMC) with undoped CsI is a major sub-system of the STCF spectrometer. To fulfill the increasing physics requirements on measurement precision and the suffering of radiation, improving the detected light yield is an important task of STCF EMC R&D. This paper studies a "wavelength shifting in propagation" scheme for STCF EMC using the nanostructured organosilicon luminophore (NOL). The studies are performed by both Monte Carlo simulation and experimental tests. The light yield is proved to be improved by a factor of 1.59 in the experiment. Meanwhile, a study of the NOL's radiation hardness is carried out to verify the reliability of the NOL. No obvious degradation in the performance is observed with the total ionization does up to 100 krad, far beyond the total radiation dose of STCF with ten years of operation.

physics.ins-det↗