arXiv subjects

Frank Hu

Publications and source records attributed to Frank Hu.

10 recordsLinked to original sources

arXiv2026

Training Large Language Models for Small-Molecule Design with Synthetic Task Scaling

Designing viable drug candidates requires searching a combinatorially large and rugged chemical space for molecules that satisfy multiple, often competing, objectives. Large language models (LLMs) provide a useful generative prior for this problem because of their representational capacity, reasoning ability, and flexibility when incorporating information from the external environment. While reinforcement learning from verifiable rewards (RLVR) can be used to improve the capabilities of LLMs, many chemically relevant scoring functions require hours or even days per evaluation, making them prohibitively expensive to use directly during online training. Here, we investigate whether LLMs can learn molecular design strategies from cheaper synthetic tasks that generalize to expensive molecular lead optimization settings. We find that curriculum-based training recipes that gradually incorporate more challenging synthetic design tasks enable strong performance that surpasses that of much larger frontier models on structure-based lead optimization. Our results suggest that scaling post-training using synthetic tasks is an effective strategy for adapting LLMs to high-cost experimental scenarios that are too expensive to directly train on.

cs.LG↗

arXiv2026

Frontier LLMs are effective batch optimizers: Assessing reasoning models in continuous and discrete settings

Frontier large language models (LLMs) have become attractive priors for optimization due to their large-scale pretraining that enables them to navigate a variety of optimization settings. However, the effectiveness of modern reasoning LLMs in batch optimization settings remains underexplored. Here we investigate the performance of the current generation of frontier LLMs as batch optimizers in both continuous and discrete settings. We find that while LLMs are competitive zero-shot batch optimizers for numerical test functions, their performance is brittle compared to classical non-LLM optimization approaches. However, LLM priors are significantly better in semantically rich settings, indicating that their batch optimization behavior is highly effective when navigating and reasoning over the discrete spaces most similar in structure to their pretraining data.

cs.LG↗

arXiv2026

Streamlining Analysis and Design of Two-Dimensional Electronic Spectroscopy using Machine Learning

Two-dimensional electronic spectroscopy (2DES) offers unique insights into the coupling between electronic and nuclear motion and dynamics, making it a key technique in diverse fields, including materials science and biology. Obtaining 2DES data requires a series of measurements that involve multiple pulses to construct the full picture -- a time-consuming task that often necessitates working with limited or noisy data. Here we introduce a machine-learning based framework that aims to maximize the data that can be extracted from 2DES experiments and provides guidance towards the selection of additional experiments. We design a Gaussian mixture model to learn the underlying spectral density of a system, allowing the extraction of reorganization energies and the extrapolation of the 2DES spectra to other time delays beyond those measured, and demonstrate how our framework can be used to select additional measurements to further improve the accuracy. We show that our approach yields accurate results on a variety of systems, including simulations ranging from photoactive yellow protein in the gas phase to Nile red in benzene to the anionic green fluorescent protein chromophore in water, and experiments on Nile blue in ethanol. Our work provides an efficient route to extract maximum insights from 2DES while incurring minimal experimental costs.

physics.chem-ph↗

arXiv2026

Pushing the limits of one-dimensional NMR spectroscopy for automated structure elucidation using artificial intelligence

One-dimensional NMR spectroscopy is one of the most widely used techniques for the characterization of organic compounds and natural products. For molecules with up to 36 non-hydrogen atoms, the number of possible structures has been estimated to range from $10^{20} - 10^{60}$. The task of determining the structure (formula and connectivity) of a molecule of this size using only its one-dimensional $^1$H and/or $^{13}$C NMR spectrum, i.e. de novo structure generation, thus appears completely intractable. Here we show how it is possible to achieve this task for systems with up to 40 non-hydrogen atoms across the full elemental coverage typically encountered in organic chemistry (C, N, O, H, P, S, Si, B, and the halogens) using a deep learning framework, thus covering a vast portion of the drug-like chemical space. Leveraging insights from natural language processing, we show that our transformer-based architecture predicts the correct molecule with 60.4% accuracy within the first 15 predictions using only the $^1$H and $^{13}$C NMR spectra, thus overcoming the combinatorial growth of the chemical space while also being extensible to experimental data via fine-tuning.

physics.chem-ph↗

arXiv2025

Aligning Transformers with Continuous Feedback via Energy Rank Alignment

Searching through chemical space is an exceptionally challenging problem because the number of possible molecules grows combinatorially with the number of atoms. Large, autoregressive models trained on databases of chemical compounds have yielded powerful generators, but we still lack robust strategies for generating molecules with desired properties. This molecular search problem closely resembles the "alignment" problem for large language models, though for many chemical tasks we have a specific and easily evaluable reward function. Here, we introduce an algorithm called energy rank alignment (ERA) that leverages an explicit reward function to produce a gradient-based objective that we use to optimize autoregressive policies. We show theoretically that this algorithm is closely related to proximal policy optimization (PPO) and direct preference optimization (DPO), but has a minimizer that converges to an ideal Gibbs-Boltzmann distribution with the reward playing the role of an energy function. Furthermore, this algorithm is highly scalable, does not require reinforcement learning, and performs well relative to DPO when the number of preference observations per pairing is small. We deploy this approach to align molecular transformers and protein language models to generate molecules and protein sequences, respectively, with externally specified properties and find that it does so robustly, searching through diverse parts of chemical space.

cs.LG↗

arXiv2025

Two-dimensional electronic spectroscopy in the condensed phase using equivariant transformer accelerated molecular dynamics simulations

Two-dimensional electronic spectroscopy (2DES) provides rich information about how the electronic states of molecules, proteins, and solid-state materials interact with each other and their surrounding environment. Atomistic molecular dynamics simulations offer an appealing route to uncover how nuclear motions mediate electronic energy relaxation and their manifestation in electronic spectroscopies, but are computationally expensive. Here we show that, by using an equivariant transformer-based machine learning architecture trained with only ~2500 ground state and ~100 excited state electronic structure calculations, one can construct accurate machine-learned potential energy surfaces for both the ground-state electronic surface and excited-state energy gap. We demonstrate the utility of this approach for simulating the dynamics of Nile blue in ethanol, where we experimentally validate and decompose the simulated 2DES to establish the nuclear motions of the chromophore and the solvent that couple to the excited state, connecting the spectroscopic signals to their molecular origin.

physics.chem-ph↗

arXiv2024

Accurate and efficient structure elucidation from routine one-dimensional NMR spectra using multitask machine learning

Rapid determination of molecular structures can greatly accelerate workflows across many chemical disciplines. However, elucidating structure using only one-dimensional (1D) NMR spectra, the most readily accessible data, remains an extremely challenging problem because of the combinatorial explosion of the number of possible molecules as the number of constituent atoms is increased. Here, we introduce a multitask machine learning framework that predicts the molecular structure (formula and connectivity) of an unknown compound solely based on its 1D 1H and/or 13C NMR spectra. First, we show how a transformer architecture can be constructed to efficiently solve the task, traditionally performed by chemists, of assembling large numbers of molecular fragments into molecular structures. Integrating this capability with a convolutional neural network (CNN), we build an end-to-end model for predicting structure from spectra that is fast and accurate. We demonstrate the effectiveness of this framework on molecules with up to 19 heavy (non-hydrogen) atoms, a size for which there are trillions of possible structures. Without relying on any prior chemical knowledge such as the molecular formula, we show that our approach predicts the exact molecule 69.6% of the time within the first 15 predictions, reducing the search space by up to 11 orders of magnitude.

physics.chem-ph↗

arXiv2023

OpenMM 8: Molecular Dynamics Simulation with Machine Learning Potentials

Machine learning plays an important and growing role in molecular simulation. The newest version of the OpenMM molecular dynamics toolkit introduces new features to support the use of machine learning potentials. Arbitrary PyTorch models can be added to a simulation and used to compute forces and energy. A higher-level interface allows users to easily model their molecules of interest with general purpose, pretrained potential functions. A collection of optimized CUDA kernels and custom PyTorch operations greatly improves the speed of simulations. We demonstrate these features on simulations of cyclin-dependent kinase 8 (CDK8) and the green fluorescent protein (GFP) chromophore in water. Taken together, these features make it practical to use machine learning to improve the accuracy of simulations at only a modest increase in cost.

physics.chem-ph↗

arXiv2023

Adaptive nonequilibrium design of actin-based metamaterials: fundamental and practical limits of control

The adaptive and surprising emergent properties of biological materials self-assembled in far-from-equilibrium environments serve as an inspiration for efforts to design nanomaterials and their properties. In particular, controlling the conditions of self-assembly can modulate material properties, but there is no systematic understanding of either how to parameterize this control or how \emph{controllable} a given material can be. Here, we demonstrate that branched actin networks can be encoded with \textit{metamaterial} properties by dynamically controlling the applied force under which they grow, and that the protocols can be selected using multi-task reinforcement learning. These actin networks have tunable responses over a large dynamic range depending on the chosen external protocol, providing a pathway to encoding ``memory'' within these structures. Interestingly, we show that encoding memory requires dissipation and the rate of encoding is constrained by the flow of entropy -- both physical and information theoretical. Taken together, these results emphasize the utility and necessity of nonequilibrium control for designing self-assembled nanostructures.

cond-mat.stat-mech↗

arXiv2023

Semiempirical Hamiltonians learned from data can have accuracy comparable to Density Functional Theory

Quantum chemistry provides chemists with invaluable information, but the high computational cost limits the size and type of systems that can be studied. Machine learning (ML) has emerged as a means to dramatically lower cost while maintaining high accuracy. However, ML models often sacrifice interpretability by using components, such as the artificial neural networks of deep learning, that function as black boxes. These components impart the flexibility needed to learn from large volumes of data but make it difficult to gain insight into the physical or chemical basis for the predictions. Here, we demonstrate that semiempirical quantum chemical (SEQC) models can learn from large volumes of data without sacrificing interpretability. The SEQC model is that of Density Functional based Tight Binding (DFTB) with fixed atomic orbital energies and interactions that are one-dimensional functions of interatomic distance. This model is trained to ab initio data in a manner that is analogous to that used to train deep learning models. Using benchmarks that reflect the accuracy of the training data, we show that the resulting model maintains a physically reasonable functional form while achieving an accuracy, relative to coupled cluster energies with a complete basis set extrapolation (CCSD(T)*/CBS), that is comparable to that of density functional theory (DFT). This suggests that trained SEQC models can achieve low computational cost and high accuracy without sacrificing interpretability. Use of a physically-motivated model form also substantially reduces the amount of ab initio data needed to train the model compared to that required for deep learning models.

physics.chem-ph↗