arXiv Science⌕ Search

arXiv subjects

Sanghyun Lee

Publications and source records attributed to Sanghyun Lee.

At least 19 recordsLinked to original sources

A Hybrid Quantum-Classical Coarse-to-Fine Finite Element Solver for Heterogeneous Darcy Flow

Quantum linear system algorithms offer theoretical potential for solving large sparse systems from PDE discretizations. However, applying them directly to fine-scale problems remains impractical on near-term hardware because of limited qubits, restricted circuit depth, and noise. They also prepare a quantum state rather than solution coefficients, whose recovery requires measurement and reconstruction. In this work, we develop a hybrid quantum-classical coarse-to-fine finite element framework for heterogeneous Darcy flow. We investigate whether a measured quantum coarse solution improves fine-grid initialization and reduces subsequent classical solver work. Rather than solve the full fine-scale system on a quantum device, we apply a method inspired by the Variational Quantum Linear Solver (VQLS) to the Galerkin coarse system. We reconstruct the approximate coarse solution from measurements, prolongate it to the fine grid, and use it to initialize a classical preconditioned iterative solve.} Numerical experiments on steady heterogeneous Darcy flow and a time-dependent SPE10-based problem show that measured quantum coarse solutions can improve fine-grid initialization, while classical correction recovers accurate pressure fields. The effect on classical solver iterations depends on the problem. All quantum computations were simulated using Qiskit Aer.

math.NA↗

SparseModesNet for coupled thermal-hydraulic-mechanical system in heterogeneous porous media

Coupled thermo-hydro-mechanical (THM) models describe interactions among displacement, fluid pressure, and temperature in geothermal systems. Fine-mesh simulations over many time steps are costly, particularly with heterogeneous permeability and thermal conductivity or fracture networks that alter fluid and heat transport. Proper orthogonal decomposition (POD) reduces the number of unknowns but can require many modes because its reconstruction is linear. We apply SparseModesNet to reconstruct coupled THM solutions using a small set of selected modes and a neural-network nonlinear decoder. Starting from a larger collection of candidate modes, SparseModesNet selects modes to reduce reconstruction error rather than simply retaining those with the highest energy. We compare SparseModesNet with POD on three problems: a two-dimensional heterogeneous medium, a two-dimensional connected fracture network, and a three-dimensional geometry based on Utah FORGE fractures. We evaluate reconstructed displacement, pressure, and temperature fields, as well as pressure- and temperature-based quantities of interest. We also test temporal interpolation by training on a subset of snapshots and reconstructing omitted snapshots within the same time interval. For the same reduced dimension, SparseModesNet achieves smaller reconstruction errors than POD and accurately recovers the solution fields and selected geothermal quantities of interest.

math.NA↗

Optimization-based Cell Average Limiters as Metric Projections: Constrained Evolution and Convergence Analysis for Convection-diffusion Equations

The optimization-based cell average limiter enforces global conservation and bounds, and has been successfully applied to discontinuous Galerkin (DG) discretizations of a wide range of nonlinear systems, from phase-field models to the compressible Navier-Stokes equations. In this paper, taking the heat and convection-diffusion equations as prototypes, we analyze the convergence of the scheme resulting from cell average limiting. Encoding conservation and admissibility in a differential inclusion identifies the limiter as a backward Euler proximal step in a Lie splitting of the constrained evolution. This proximal step is the metric projection onto the convex admissible set, and we prove that it is nonexpansive and stable in the $L^2$ norm, and that it does not increase the total variation of the cell averages. Combined with the standard error analysis, nonexpansiveness yields an $O(τ+h^{k+1})$ estimate for implicit Euler time stepping with DG discretization of polynomial degree $k$ under a reverse CFL condition, together with an unconditional $O(τ+h^{k})$ estimate. Numerical experiments confirm the predicted convergence rates and the enforcement of the bounds.

math.NA↗

An optimization-based property-preserving limiter for two-phase flow in porous media on non-matching meshes

Two-phase flow in porous media arises in a wide range of applications in engineering and science. A fundamental challenge in its numerical simulation is that the approximation of the saturation transport equation can violate the maximum principle, and spurious oscillations can appear even when the solution remains within physical bounds. In this work, we propose a bound-preserving anti-oscillation postprocessing limiter for discontinuous Galerkin discretizations of the two-phase flow system on non-matching meshes. An optimization-based cell average limiter enforces the prescribed bounds on the cell averages while preserving global mass by minimizing the $L^2$ distance to the original cell averages. To suppress the remaining oscillations, the cell average limiter is combined with a minmod limiter, which is activated only in the cells identified by a troubled-cell detector to avoid unnecessary loss of accuracy, and a Zhang-Shu scaling limiter subsequently enforces the bounds on point values. In addition, we prove that the cell average limiter preserves the accuracy of the numerical solution at a fixed time on non-matching meshes. Numerical experiments on homogeneous, non-homogeneous, and fractured porous media demonstrate the accuracy and robustness of the proposed method.

math.NA↗

ReAnchor: Reusing Rejected Verifier States for Diffusion Drafting

Block diffusion drafters accelerate speculative decoding by generating multiple draft tokens in a single forward pass. However, each pass produces only a fixed-length block from a single target-generated anchor, limiting how far the draft can extend. Meanwhile, target verification computes hidden states even at positions beyond the first rejection, but these states are typically discarded rather than reused. We propose ReAnchor, a training-free method that reanchors a pretrained drafter at shifted positions using discarded verifier states to generate parallel draft blocks. These blocks improve predictions within the original block and extend coverage beyond its endpoint. At sampling temperature of T=0, ReAnchor achieves its largest average gains on Gemma 4-12B, improving acceptance length by 19.4% and decoding speed by 17.9% across eight benchmarks. Averaged equally over four target models and eight benchmarks, it improves acceptance length by 15.2% and decoding speed by 13.4% with pretrained DFlash drafters.

cs.CL↗

Reference-Space Reuse for Steady and Transient State-Constrained Conjugate Heat Transfer

Repeated thermal optimization must enforce local temperature limits while solving linear systems whose unknowns change as the constraints activate and release. Zero-extension transfer, which carries correction vectors from one inactive set to the next, assigns zero to the degrees of freedom that a constraint has just released. We construct a spectral reference on the full state domain before optimization and restrict it directly to the current inactive set at each update, so the coarse correction receives reference entries at every released degree of freedom. Spatial and space--time constructions cover steady and transient conjugate heat transfer with prescribed fluid velocity, and a restriction-residual identity yields alignment and deflated-convergence bounds under stated rank and spectral-separation assumptions. In the primary comparisons on body-fitted transformer and bore-in-block models, the resulting reference deflation reduces the median complete optimization time relative to the tested iterative alternatives on the same graphics processor. Complete time includes reference construction. Matched transfer experiments connect the improvement to the reference information retained at released constraints. The lower cost persists on refined Cartesian and bore-in-block meshes, on space--time trajectories and over sequences with changing loads and query order; the margin narrows, and eventually reverses, as a trajectory gains time slabs at a fixed horizon. Full-domain reference retention thus supports repeated evaluation of temperature-constrained heat inputs in engineering thermal models.

cs.CE↗

Optimal (Parallel) Spooky Pebbling on Binary Trees

Pebble games model computations under a fixed space budget. Spooky pebbling allows quantum memory to be released by measurement, with the resulting phases corrected later. We study two-input computations with binary-tree dependencies and determine the optimal work and parallel depth for complete binary trees. Our key idea is to clean up the tree in blocks, reducing repeated recomputation of intermediate values. For the complete tree $B_h$ with $n=2^h-1$ vertices and every space budget $h+1\le s\le n$, we give an algorithm with asymptotically optimal work $Θ(nh/\log(s+1))$. At the minimum budget $s=h+1$, this improves the $O(n\log n)$ bound of Kornerup, Sadun, and Soloveichik to $Θ(n\log n/\log\log n)$, resolving their time-optimality question. We also construct a parallel schedule with optimal depth \[ Θ\!\left(h+\frac ns \max\!\left\{\frac{h}{\log(s+1)},\,1+\log^*h\right\}\right). \] Our lower bounds hold for every full binary tree. We also show that achieving optimal parallel depth can require asymptotically more work than minimizing work alone. Applying our schedule to the RNS point-addition trees in the public implementation of Chevignard, Fouque, and Schrottenloher reduces their Toffoli/AND gate count by $20.86\%$ for a P-224 instance and $22.66\%$ for a P-256 instance, using the same arithmetic circuits and peak workspace.

cs.CC↗

A Monolithic Discontinuous Galerkin Framework for Darcy Optimal Control with Radon-Measure Tracking and Pointwise Control Constraints

We study an elliptic optimal control problem governed by Darcy's equation in heterogeneous porous media, with pointwise box constraints on the control. The objective functional is formulated via a Radon measure, which allows the desired pressure state to be tracked on observation sets of varying dimension, including points, curves, and subdomains, within a single formulation. The state and adjoint equations are discretized by a symmetric interior penalty discontinuous Galerkin method, yielding a locally mass-conservative approximation that is robust across strong permeability discontinuities, while the control is approximated by piecewise constants. The state, adjoint, and control are retained as primary unknowns in a single coupled optimality system and solved monolithically by a primal-dual active set strategy. We establish stability and well-posedness of the discretization and derive a priori $L^2$ error estimates for both variables. The principal difficulty is the reduced regularity of the adjoint state induced by the measure-valued tracking data. The analysis controls the resulting adjoint-control coupling through an intermediate adjoint driven by the continuous optimal state. Numerical experiments confirm the predicted convergence rates for point, curve, and subdomain observations, exhibit mesh-independent primal-dual active set iteration counts, and demonstrate local mass conservation.

math.NA↗

A Conjugate Gradient Formulation of the EnKF Algorithm

Ensemble Kalman Filter (EnKF) based data assimilation algorithms synthesize predictive numerical forecast models with accumulated data as time evolves and account for model uncertainty and noisy measurements. The computational cost of these algorithms can be expensive, in particular for highly dimensional dynamical systems. Often, EnKF based algorithms have traded accuracy for reduced computational cost. In this paper, we present a novel parallelizable Conjugate Gradient-based Ensemble Kalman Filter (CGD-EnKF) algorithm that maintains comparable computational cost to efficient algorithms while realizing better state estimation accuracy in select cases. Here, we established the new approach by reformulating a matrix inverse calculation with a classical Conjugate Gradient (CGD) method. In addition, we discuss the upper error bound under CGD, error convergence to the classical EnKF result, and the computational complexity of the algorithm. We also showcase the CGD-EnKF-Reduced algorithm that is shown to be further computationally efficient for highly dimensional dynamical systems under small ensemble formulation. Numerical examples demonstrate the performance of our proposed algorithms and analytical properties, highlighting their comparability and advantages with respect to some benchmark EnKF algorithms.

math.NA↗

PATTON: Enabling Commodity PIM for Production LLM Serving

Processing-in-Memory (PIM) is promising for accelerating memory-bound decode attention, but attention acceleration alone is insufficient for production LLM serving, where engines dynamically allocate, populate, share, cache, and reclaim logical KV cache blocks. Supporting this lifecycle on commodity PIM requires efficient physical memory allocation, block-to-address mapping, and command generation. For the Value cache, these requirements create a fundamental conflict among GEMV efficiency, single-token write efficiency, and memory capacity: GEMV-optimized layouts scatter newly generated Value vectors across rows, making writes costly, while finer-grained memory sharing improves capacity utilization but fragments GEMV reductions. We present PATTON, a PIM runtime that integrates production LLM serving engines with commodity PIM. PATTON introduces hierarchical granule allocation: block-sized Key and Value granules map one-to-one to logical token blocks, fixing their physical placements and commands, while coarser granules group blocks for efficient GEMV execution and memory utilization. A Commit Zone stages partial Value blocks for efficient single-token writes before committing them to GEMV-optimized locations. PATTON tracks these placements to generate KV cache writes and QK-transpose/SV commands. Across attention execution and runtime-induced prefill recomputation, PATTON achieves an average 1.95x speedup and 4.83x higher energy efficiency over evaluated baselines, requires no PIM processing-unit modifications, and maintains a KV cache hit rate comparable to the native GPU KV cache in vLLM.

cs.AR↗

Understanding and Accelerating the Training of Masked Diffusion Language Models

Masked diffusion models (MDMs) have emerged as a promising alternative to autoregressive models (ARMs) for language modeling. However, MDMs are known to learn substantially more slowly than ARMs, which may become problematic when scaling MDMs to larger models. Therefore, we ask the following question: how can we accelerate standard MDM training while maintaining its final performance? To this end, we first provide a detailed analysis of why MDM training is slow. We find that the main factor is the locality bias of language: the predictive information for a token is concentrated in nearby positions. We further investigate how this bias slows learning and suggest a simple yet effective remedy: bell-shaped time sampling as a training strategy. Notably, MDMs trained with our training recipe reach the same validation negative log-likelihood (NLL) up to $\sim4\times$ faster than standard training on One Billion Word Benchmark (LM1B). We also show faster improvements in generative perplexity, zero-shot perplexity, and downstream task performance on various benchmarks.

cs.LG↗

Optimal mean-time path planning for unmanned underwater vehicles: a Hamilton-Jacobi approach

Unmanned underwater vehicles (UUV) integrate ocean forecasts with path planning algorithms in order to identify energy- or time-minimizing paths that enable mission completion. Typically, a well-defined deterministic ocean forecast is assumed to be available for path planning; however, in practice, different ocean forecasts can disagree. In this paper, we extend previous work on deterministic optimal path planning to identify optimal mean-time paths when presented with an ensemble of possible ocean forecasts. In particular, we formulate a system of time-independent Hamilton-Jacobi partial differential equations that incorporates forecast uncertainty and yields the optimal mean reachability travel time and the necessary controls to find the associated optimal path. An efficient numerical solution of this system of PDEs is obtained through an extension of the Fast Sweeping Method; verification and benchmarking results are provided. Additional numerical examples illustrate the impact uncertainty can have on the optimal path; in particular, these results demonstrate that the vehicle's optimal path can deviate significantly from the deterministic optimal paths associated with the individual ensemble members.

math.OC↗

A Posteriori Error Estimation for Parabolic Equations with Enriched Galerkin Finite Element Methods

This paper introduces a novel a posteriori error estimation framework for the enriched Galerkin (EG) finite element method applied to linear parabolic equations. While the EG method has been recognized for its local conservation property and computational efficiency compared to discontinuous Galerkin methods, its mathematical analysis in the context of a posteriori error estimation for parabolic problems remains unexplored. In this work, we prove reliability and efficiency using the residual-based approach. Furthermore, we integrate these error estimators into an adaptive mesh refinement strategy, demonstrating their effectiveness in achieving efficient and reliable error control through several numerical examples. The proposed approach provides a significant advancement in the mathematical foundation and practical applicability of the EG method for time-dependent problems.

math.NA↗

Enhancing neural network extrapolation in thermo-fluid systems using steady-state solutions

Time-dependent partial differential equations (PDEs) arise in many engineering systems, including thermo-fluid applications. Classical numerical simulations of such systems can become computationally expensive for long-time dynamics because they typically require sequential time integration with time steps constrained by stability, accuracy, or nonlinear solvers. Although scientific machine learning provides an alternative for approximating PDE solutions, standard neural network approximations often degrade when extrapolated beyond the training time interval. In this work, we propose a steady-state-informed neural network representation for dissipative PDE systems whose solutions relax toward a stationary equilibrium. The proposed ansatz decomposes the solution into a steady-state component and a transient correction modulated by a time-dependent decay profile. When the decay profile vanishes at long time and the transient correction remains bounded, the representation embeds convergence to the prescribed steady state directly into the architecture, rather than enforcing it through an additional penalty term. This allows the network to learn the transient dynamics while preserving the correct asymptotic behavior. We implement the approach within a physics-informed neural network (PINN) framework and train the resulting model using the SOAP optimizer. The method is evaluated on a sequence of problems of increasing physical and geometric complexity, ranging from the one-dimensional heat equation to incompressible Navier-Stokes flow in a lid-driven cavity, natural convection in a square cavity, and a full three-dimensional conjugate heat transfer problem. The numerical results show that the steady-state-informed architecture substantially improves temporal extrapolation beyond the training interval compared with architectures that do not explicitly enforce the asymptotic condition.

cs.CE↗

A Parallel and Adaptive Mesh-Free Method for Discontinuous Coefficient Fields in Heterogeneous Porous Media

Discontinuous coefficient fields arise in many computational physics problems and are often represented as cellwise constant data tied to a given spatial discretization. Such representations are inherently mesh-dependent, requiring interpolation or projection whenever they are transferred to a different discretization. In this work, we develop \emph{Parallel and Adaptive Mesh-Free Approximation (PAM)}, a mesh-independent framework that approximates discontinuous data by a continuous, closed-form function. The resulting approximation can be evaluated consistently across different geometries and numerical discretizations, while preserving sharp interface features. The proposed PAM framework employs radial basis functions (RBFs) to construct continuous approximations of discontinuous data. To accurately capture discontinuities, we incorporate Shepard-normalization, which stabilizes the approximation near sharp interfaces. The coefficients of the RBF expansion are determined via sparse regression, enabling automatic selection of the most relevant basis functions and promoting robust representations. In addition, we develop a novel adaptive refinement approach which further enriches the approximation in regions of rapid spatial variation. We provide a theoretical analysis showing that the proposed normalized RBF framework achieves arbitrarily small $L^1$ error in approximating discontinuous step functions. To enhance computational efficiency, the domain is partitioned into subdomains, and the reconstruction problem is solved independently on each subdomain in parallel. Numerical experiments demonstrate the accuracy, adaptivity, scalability, and downstream impact of the proposed method on Darcy flow simulations, including tests on heterogeneous permeability fields, mesh-transfer settings, and the SPE10 benchmark.

math.NA↗

Looped Diffusion Language Models

Masked diffusion models (MDMs) have emerged as a promising alternative to autoregressive models for language modeling, yet the effective design of transformer architectures for MDMs remains underexplored. In this paper, we show that selectively looping the early-middle transformer layers significantly improves both training efficiency and model performance in MDMs. We call this approach LoopMDM(Looped Masked Diffusion Model), which brings two key benefits: looping layers at training-time yields a depth-scaling effect without adding parameters, while varying the number of loops at inference-time enables flexible compute scaling. Despite the simplicity, the results are striking: across multiple pre-training corpora, LoopMDM matches the performance of same-size MDMs with up to 3.3 fewer training FLOPs, while its final performance outperforms them on various reasoning benchmarks, including up to 8.5 points on GSM8K. It even surpasses deeper non-looped MDMs trained with comparable per-step compute, indicating that selective looping is more effective than naive depth scaling. Furthermore, LoopMDM can scale inference-time compute by increasing the number of loops. Adaptively adjusting the number of loops throughout the sampling process further yields additional gains in compute efficiency while maintaining performance. Lastly, with attention analysis, we provide evidence that looping is effective in MDMs by promoting interactions among masked positions. Our code and weights will be publicly released.

cs.LG↗

Unifying Masked Diffusion Models with Various Generation Orders and Beyond

Masked diffusion models (MDMs) are a potential alternative to autoregressive models (ARMs) for language generation, but generation quality depends critically on the generation order. Prior work either hard-codes an ordering (e.g., blockwise left-to-right) or learns an ordering policy for a pretrained MDM, which incurs extra cost and can yield suboptimal solutions due to the two-stage optimization. Motivated by this, we propose order-expressive masked diffusion model (OeMDM) for a broad class of diffusion generative processes with various generation orders, enabling the interpretation of MDM, ARM, and block diffusion in a single framework. Furthermore, building on OeMDM, we introduce learnable-order masked diffusion model (LoMDM), which jointly learns the generation ordering and diffusion backbone through a single objective from scratch, enabling the diffusion model to generate text in context-dependent ordering. Empirically, we confirm that LoMDM outperforms various discrete diffusion models across multiple language modeling benchmarks.

cs.LG↗

Heat Transfer Modeling in Enhanced Geothermal Energy: A Three-Temperature Approach for Solid, Injected, and Residing Fluids

Enhanced geothermal systems (EGS) involve strongly coupled, advection-dominated flow and heat transfer in fractured porous media. Conventional models typically assume local thermal equilibrium with a single effective fluid temperature or, at best, an averaged pore-fluid temperature, so the thermal evolution of injected cold fluid is only inferred indirectly. In this work, we develop a local thermal non-equilibrium (LTNE) model that explicitly resolves the temperature of injected fluid as it moves through the reservoir and exchanges heat with the hot rock and resident fluid. The key ingredient is a concentration variable that tracks the injected fluid and induces a three-way LTNE coupling among rock, resident-fluid, and injected-fluid temperatures. This framework distinguishes, at the continuum scale, how newly injected fluid parcels are heated by conductive and convective exchange, and predicts production-well temperatures without relying on bulk averages. To discretize the resulting nonlinear, advection-dominated system, we employ an enriched Galerkin (EG) finite element method for Darcy flow, temperature, and concentration, providing local mass conservation with relatively few degrees of freedom. We further design a flux-corrected transport (FCT) strategy for the EG concentration and temperature equations to enforce a discrete maximum principle and suppress nonphysical oscillations while preserving local conservation. Time integration uses an IMPES-type splitting combined with a strong-stability-preserving Runge--Kutta scheme. Numerical experiments for fractured EGS problems show that the proposed LTNE--EG--FCT framework captures injected-fluid heating paths and thermal breakthrough behavior not resolved by standard single-temperature or averaged LTNE models.

math.NA↗