arXiv ScienceSearch

arXiv subjects

Jaemin Kim

Publications and source records attributed to Jaemin Kim.

At least 19 recordsLinked to original sources

Robust Ultra Low-Bit Post-Training Quantization via Stable Diagonal Curvature Estimate

Large Language Models (LLMs) are widely used across many domains, but their scale makes deployment challenging. Post-Training Quantization (PTQ) reduces memory footprint without retraining by leveraging a small calibration set. Recent Hessian-based PTQ methods compensate quantization error via cross-channel dependencies, but such approaches degrade at low bit-widths due to noisy curvature estimates from limited calibration data. We propose DASH-Q, a robust PTQ framework using diagonal Hessian approximation and iterative weighted least squares. By discarding noise-prone dependencies, DASH-Q filters sampling noise while prioritizing the preservation of salient feature power. We outperform other PTQ baselines in ultra low-bit regime, improving zero-shot accuracy by 7.01% on average and up to 14.01% over the strongest baselines across five baseline LLM models, while showing robust and stable performance with very small calibration data.

cs.LG

PDE-constrained optimization for virtual sensing in structural dynamics: Full-field displacement and force recovery from sparse sensors

Virtual sensing -- recovering full-field structural response from sparse sensor measurements -- is a fundamental challenge in structural health monitoring (SHM). Fracture assessment, fatigue evaluation and remaining useful life (RUL) prognosis all take the applied load as their input, and that load frequently acts on surfaces that cannot be instrumented. An improved load estimate is therefore of direct practical value for SHM and for prognostics and health management (PHM). The mode-based approach reconstructs the displacement field accurately from a small number of sensors and has been applied successfully for that purpose. The load inferred from this reconstructed displacement is far less reliable, because the residual displacement error is amplified when it is mapped back through the dynamic stiffness. This study therefore formulates virtual sensing as a PDE-constrained optimization (PDE-CO) problem in which the elastodynamic equation is an equality constraint and the applied load is the optimization variable, so that displacement and load are estimated together rather than in sequence. To manage the computational cost, the framework separates offline finite element model preparation from online reconstruction. The assembled matrices are reused during online optimization, and the forward and gradient evaluations can use GPU-based parallel computation. The numerical comparisons support improved noise robustness of PDE-CO displacement reconstruction relative to the mode-based approach within the tested settings. These results provide a theoretical and computational foundation for the development of virtual sensing for SHM and PHM.

math-ph

Where Does Robustness Live? Neuron-Guided Adaptation for Retrieval-Augmented Language Models

Retrieval-Augmented Language Models (RALMs) have shown strong potential in knowledge-intensive tasks, yet they remain vulnerable when retrieved contexts are noisy or irrelevant. Robustness against such contexts requires two distinct capabilities: abstention when contexts are uninformative, and selective extraction when relevant evidence is buried in noise. Yet existing methods face two key limitations: they do not train separately for these two capabilities, and they adapt the model at a coarse layer- or module-level granularity, overlooking that only a small subset of neurons is strongly activated for a given input. We propose NeuRIT, a Neuron-guided Robust Instruction-Tuning framework built on a localization-first perspective. NeuRIT mines context-aware neurons associated with relevant and irrelevant context processing, and uses them as anchors to selectively adapt both the identified neuron groups and the layers in which they concentrate. NeuRIT then performs two-stage instruction tuning that teaches complementary behaviors: suppress generation when there is nothing to extract, and extract relevant evidence when there is. NeuRIT consistently outperforms strong baselines across diverse QA benchmarks and generator backbones. Our code is available at https://github.com/HYU-ARK-Lab/NeuRIT.

cs.CL

Entanglement-swapping measurements for deterministic entanglement distribution

Entanglement swapping is a key primitive for distributing entanglement over quantum networks, but different measurement outcomes can produce end-to-end states with different entanglement, requiring branch-dependent processing or the rejection of unfavorable outcomes. We characterize all projective swapping measurements with full-Schmidt-rank vectors such that, for every pair of pure input links, all outcomes yield the same end-to-end state up to local-unitary corrections. Within this family, the measurements that maximize the average G-concurrence for every input pair are built from complex Hadamard operators, and every outcome individually attains the optimum. Classifying the underlying complex Hadamard operators that preserve optimal deterministic swapping gives one class for $d=2,3$, exactly $72$ classes for $d=5$, and uncountably many whenever $d=4k$. We show further that for $d=2,3$, the corrected end-to-end state in a swapping chain is independent of the swapping order, and discuss noise robustness under depolarizing noise and arbitrary convex input contamination. For pure inputs, these schemes retain every outcome while achieving optimal G-concurrence and therefore eliminate outcome-based postselection.

quant-ph

Coupling-Robust Accuracy in Multiphysics Physics Informed Neural Networks via Kronecker-Preconditioned Optimization

Physics-informed neural networks (PINNs) offer a mesh-free route to solving coupled multiphysics systems, but their accuracy degrades systematically as inter-equation coupling strengthens, and inverse-gradient-norm loss balancing alone does not reliably prevent this failure. This study explains why coupling degrades PINN training and identifies an optimizer structure that removes the dependence, replacing case-by-case tuning with a principled remedy. Through a neural tangent kernel analysis, we prove that the standard kernel's spectral radius grows as $Ω(γ^2)$ with coupling strength $γ$, whereas block-diagonal Gauss-Newton (GN) preconditioning bounds it by the number of networks $S$, independent of $γ$; no diagonal preconditioner recovers this bound for any coupling type or loss weighting. We realize block-diagonal GN preconditioning through the Kronecker-preconditioned optimizer SOAP combined with inverse-gradient-norm loss balancing (SOAP+GradNorm) and evaluate it across 222 experiments on four benchmarks of increasing difficulty. Across all systems, SOAP+GradNorm is the only configuration whose degradation remains bounded in every regime tested: it preserves weak-coupling accuracy in linear problems and limits degradation to $2.3\times$ in the nonlinear Nernst-Planck-Poisson system, whereas Adam-based training leaves the $L_2$ error above the 0.1 failure threshold. The same effect applies to a six-residual, four-network, 2D electro-osmotic flow where the electric double layer is resolved down to a Debye length of $\varepsilon = 0.01$ on an $x$-invariant reference solution. These results recast coupling-induced accuracy loss as a problem of the preconditioner's structure rather than loss weighting and identify Kronecker preconditioning as a structural lever for training PINNs on strongly coupled, stiff multiphysics systems.

cs.LG

AgentPSO: Evolving Agent Reasoning Skill via Multi-agent Particle Swarm Optimization

Multi-agent reasoning has shown promise for improving the problem-solving ability of large language models by allowing multiple agents to explore diverse reasoning paths. However, most existing multi-agent methods rely on inference-time debate or aggregation, which can be vulnerable to incorrect peer influence and biased consensus. Moreover, the agents' reasoning procedures remain static, as they do not accumulate reusable behaviors across tasks. In this paper, we introduce \textbf{AgentPSO}, a particle-swarm-inspired framework for evolving multi-agent reasoning skills. AgentPSO treats each agent as a particle-like reasoner whose state is a natural-language skill and whose velocity is a semantic update direction, iteratively guiding agents toward higher-performing skill configurations. Across training iterations, each agent updates its skill by combining its previous velocity, personal-best skill, global-best skill, and a self-reflective direction derived from peer reasoning trajectories. This enables agents to learn reusable reasoning behaviors by drawing on their own experience and on the strongest skills found by the population, without updating the parameters of the backbone language model. Experiments on mathematical and general reasoning benchmarks show that AgentPSO improves over static single-agent skills and test-time-only multi-agent reasoning baselines. The evolved skills further transfer across benchmarks and to another backbone model, suggesting that AgentPSO captures reusable reasoning procedures rather than merely optimizing benchmark-specific prompts. Code is publicly available at https://github.com/HYUNMIN-HWANG/AgentPSO/.

cs.AI

A priori error estimator for reduced-order models based on the higher-order Craig-Bampton method in dynamic substructuring

The Craig-Bampton (CB) method is a widely used dynamic substructuring technique based on component mode synthesis (CMS). The higher-order Craig-Bampton (HCB) method augments the CB basis with residual modes from a Neumann series expansion of the residual flexibility matrix, where HCB-n retains terms up to the n-th order and is reduced back to the CB size via the System Equivalent Reduction Expansion Process (SEREP), achieving improved accuracy at the same model dimension. However, assessing the accuracy of a reduced model without solving the full-order problem remains a fundamental challenge: if the full-order solution is required to evaluate the error, the purpose of model reduction is defeated. Despite the demonstrated superiority of the HCB method, no a priori error estimator (one that predicts eigenvalue errors without solving the full-order eigenvalue problem) has been proposed for it. The present work addresses this gap with a hierarchical estimation framework that exploits the nested Ritz subspace structure of the HCB method, where each higher-order solution serves as a reference for estimating the error of the preceding order. The framework provides (i) a generalized CB error estimator derived from a Rayleigh quotient perturbation analysis, and (ii) a novel HCB-1 error estimator using the HCB-2 eigensolution as a reference. Numerical examples across models of varying geometric complexity validate both estimators.

math.NA

When Sinks Help or Hurt: Unified Framework for Attention Sink in Large Vision-Language Models

Attention sinks are defined as tokens that attract disproportionate attention. While these have been studied in single modality transformers, their cross-modal impact in Large Vision-Language Models (LVLM) remains largely unexplored: are they redundant artifacts or essential global priors? This paper first categorizes visual sinks into two distinct categories: ViT-emerged sinks (V-sinks), which propagate from the vision encoder, and LLM-emerged sinks (L-sinks), which arise within deep LLM layers. Based on the new definition, our analysis reveals a fundamental performance trade-off: while sinks effectively encode global scene-level priors, their dominance can suppress the fine-grained visual evidence required for local perception. Furthermore, we identify specific functional layers where modulating these sinks most significantly impacts downstream performance. To leverage these insights, we propose Layer-wise Sink Gating (LSG), a lightweight, plug-and-play module that dynamically scales the attention contributions of V-sink and the rest visual tokens. LSG is trained via standard next-token prediction, requiring no task-specific supervision while keeping the LVLM backbone frozen. In most layers, LSG yields improvements on representative multimodal benchmarks, effectively balancing global reasoning and precise local evidence.

cs.CV

A physics-informed neural network for improving surface reconstruction of intracranial saccular aneurysms via variational membrane equilibrium

Intracranial saccular aneurysms (ISAs) pose severe health risks, yet conventional population-based risk stratification scores (PHASES, UIATS, and ELAPSS) offer limited capacity for patient-specific rupture risk assessment. Image-based computational approaches have gained prominence, but traditional surface reconstruction relies on mathematical smoothing (e.g., L-curve criteria) that indiscriminately suppresses both imaging artifacts and genuine pathological features such as rupture-prone blebs. Although Laplace's membrane equilibrium ($κ_1 T_1 + κ_2 T_2 = P$) has long governed aneurysm wall mechanics (Humphrey and Kyriacou [Neurol. Res., 18 (1996)]), its integration into geometric reconstruction pipelines remains unexplored. This work introduces a physics-informed neural network (PINN) framework with B-spline representations, whose key contributions are: (i) embedding the variational equilibrium condition ($δΠ= 0$) as a physics-informed loss that replaces the mathematical L-curve criterion with a biomechanically grounded artifact discrimination, (ii) developing a Manifold-Consistent CNN ansatz that preserves the closed-surface topology of vascular geometries, and (iii) establishing a Laplace equilibrium-driven reconstruction that filters imaging noise while preserving diagnostically critical high-curvature features. Application to patient-specific clinical datasets demonstrates that the framework eliminates non-physical concave artifacts without compromising genuine geometric anomalies. Clinical evaluation by a practicing neurosurgeon confirms that the resulting risk map---with rupture risk concentrated at the dome apex---is consistent with intraoperative observations, establishing a computational biomarker foundation for patient-specific rupture risk assessment of intracranial saccular aneurysms.

math.NA

Ciphertext- and Polynomial-Level Optimization for Fully Homomorphic Encryption

Fully homomorphic encryption (FHE) schemes such as RNS-CKKS enable privacy-preserving services through direct computation on encrypted data. While recent FHE compilers optimize FHE programs, they operate at the coarse-grained ciphertext level, where each ciphertext operation comprises a sequence of polynomial operations. At this granularity, the compilers miss polynomial-level optimization opportunities across ciphertext operations. This work presents Recifhe, a new multi-level compiler that supports both ciphertext-level and polynomial-level optimization. At the ciphertext level, Recifhe transforms a non-FHE input program into an FHE program by inserting ciphertext management operations and applies global optimizations. At the polynomial level, Recifhe eliminates redundant polynomial computations across ciphertext operations. Recifhe achieves a 1.25x speedup over ciphertext-level-only optimization.

cs.CR

Carrier-Assisted Entanglement Purification

Entanglement distillation, a fundamental building block of quantum networks, enables the purification of noisy entangled states shared among distant nodes by local operations and classical communication. Its practical realization presents several technical challenges, including the storage of quantum states in quantum memory and the execution of coherent quantum operations on multiple copies of states within the quantum memory. In this work, we present an entanglement purification protocol via quantum communication, namely a carrier-assisted entanglement purification protocol, which utilizes two elements only: i) quantum memory for a single-copy entangled state shared by parties and ii) single qubits travelling between parties. We show that the protocol, when single-qubit transmission is noiseless, can purify a noisy entangled state shared by parties. When single-qubit transmission is noisy, the purification relies on types of noisy qubit channels; we characterize Pauli channels such that the protocol works for the purification. We address this limitation by using multiple carrier qubits, and show that for any non-entanglement-breaking Pauli channel, the protocol's fixed-point fidelity approaches unity as the number of carriers increases. Our results significantly reduce the experimental overhead required for distilling entanglement: the practical advantage is demonstrated through parameters directly related to the capability of entanglement purification, such as noise in quantum memory, local measurements, channel use, and entanglement fidelity. We envisage that the protocol would make long-distance pure entanglement closer to a practical realization.

quant-ph

Protocol for Purifying Noisy Preparation and Measurements of Qubits

Noise affecting qubit preparation and measurements accounts for a significant fraction of errors in quantum information processing. This is especially critical in tasks like variational quantum algorithms, quantum error correction, and entanglement distribution through repeaters. In this work, we present a protocol to purify noisy SPAM, effectively suppressing these errors to an arbitrarily low level. For instance, in a realistic scenario where qubits contain error rates around $0.05$ in both preparation and measurement, the protocol can suppress error rates up to $10^{-3}$ with two ancillas and $10^{-6}$ with four ancillas. We show how to distill error-free SPAM by repeating noisy SPAMs. The protocol is also feasible with superconducting qubits. We envisage that our results can be used to realize quantum information tasks in computing and communication with negligible SPAM errors.

quant-ph

From Volume to Value: Preference-Aligned Memory Construction for On-Device RAG

With the rapid emergence of personal AI agents based on Large Language Models (LLMs), implementing them on-device has become essential for privacy and responsiveness. To handle the inherently personal and context-dependent nature of real-world requests, such agents must ground their generation in device-resident personal context. However, under tight memory budgets, the core bottleneck is what to store so that retrieval remains aligned with the user. We propose EPIC (Efficient Preference-aligned Index Construction), which focuses on user preferences as a compact and stable form of personal context and integrates them throughout the RAG pipeline. EPIC selectively retains preference-relevant information from raw data and aligns retrieval toward preference-aligned contexts. Across four benchmarks covering conversations, debates, explanations, and recommendations, EPIC reduces indexing memory by 2,404 times, improves preference-following accuracy by 18.79 %p, and achieves 32.17 times lower retrieval latency over the best-performing baseline. In on-device experiments, EPIC maintains under 1 MB memory and achieves 5.21 to 29.35 ms/query latency across three platforms, while supporting streaming updates under preference drift. Our code and data are available at https://github.com/UbiquitousAILab/EPIC.

cs.CL

Detecting Entanglement by State Preparation and Local Measurements

Entanglement witnesses (EWs) are a collection of observables that can characterize separable states and, experimentally, estimating EWs can verify entangled states. In this work, we show that a fixed measurement setting on a multipartite entangled state, which we introduce as a network state for the purpose, can estimate EWs. Namely, entangled states can be fully verified in a measurement-based manner, in which experimenters do not necessarily change measurement settings. We present a fixed measurement setting and network states for estimating decomposable EWs, equivalent to the partial transpose criteria. We also consider non-decomposable EWs that detect bound entangled states beyond the partial transpose criteria. The results can be extended to multipartite states such as graph states, a resource for measurement-based quantum computing, and readily applied to distributed settings such as quantum metrology or sensor networks where multipartite entangled states are resourceful.

quant-ph

Universal Reasoner: A Single, Composable Plug-and-Play Reasoner for Frozen LLMs

Large Language Models (LLMs) have demonstrated remarkable general capabilities, but enhancing skills such as reasoning often demands substantial computational resources and may compromise generalization. While Parameter-Efficient Fine-Tuning (PEFT) methods offer a more resource-conscious alternative, they typically require retraining for each LLM backbone due to architectural dependencies. To address these challenges, we propose Universal Reasoner (UniR)-a modular, composable, and plug-and-play reasoning module that can be used with larger frozen LLMs to provide specialized reasoning capabilities with a shared or aligned token space. Specifically, UniR decomposes the reward into a standalone reasoning module trained in a decoupled manner using verifiable rewards, effectively translating trajectory-level signals into token-level guidance. Once trained, UniR is combined with frozen LLMs at inference time by simply adding its output logits to those of the backbone. This additive structure enables modular composition: multiple UniR modules trained for different tasks can be jointly applied by summing their logits, enabling complex reasoning via composition. Furthermore, UniR demonstrates weak-to-strong generalization, where reasoning modules trained on smaller models effectively guide much larger LLMs in the same model family, and generalize across domains such as in vision language models and medical reasoning. Experiments on mathematical reasoning and machine translation show that UniR surpasses existing fine-tuning methods. Code is open-sourced at https://github.com/hangeol/UniR.

cs.AI

Training-Free Reward-Guided Image Editing via Trajectory Optimal Control

Recent advancements in diffusion and flow-matching models have demonstrated remarkable capabilities in high-fidelity image synthesis. A prominent line of research involves reward-guided guidance, which steers the generation process during inference to align with specific objectives. However, leveraging this reward-guided approach to the task of image editing, which requires preserving the semantic content of the source image while enhancing a target reward, is largely unexplored. In this work, we introduce a novel framework for training-free, reward-guided image editing. We formulate the editing process as a trajectory optimal control problem where the reverse process of a diffusion model is treated as a controllable trajectory originating from the source image, and the adjoint states are iteratively updated to steer the editing process. Through extensive experiments across distinct editing tasks, we demonstrate that our approach significantly outperforms existing inversion-based training-free guidance baselines, achieving a superior balance between reward maximization and fidelity to the source image without reward hacking.

cs.CV

Speculative Verification: Exploiting Information Gain to Refine Speculative Decoding

LLMs have low GPU efficiency and high latency due to autoregressive decoding. Speculative decoding (SD) mitigates this using a small draft model to speculatively generate multiple tokens, which are then verified in parallel by a target model. However, when speculation accuracy is low, the overhead from rejected tokens can offset the benefits, limiting SD's effectiveness, especially at large batch sizes. To address this, we propose Speculative Verification (SV), an efficient augmentation to SD that dynamically predicts speculation accuracy and adapts the verification length to maximize throughput. SV introduces a companion model - a small auxiliary model similar in size to the draft model - to estimate the alignment between draft and target model distributions. By maximizing the information gain from quantifying this alignment, SV refines verification decisions, reducing wasted computation on rejected tokens and improving decoding efficiency. Moreover, SV requires no modifications to the draft or target models and is compatible with existing SD variants. We extensively evaluated SV on publicly available LLMs across three NLP tasks using nine combinations of draft, companion, and target models, including 13B-72B target models and three types of variations: base (no finetuning), instruction-tuned, and task fine-tuned. Across all experiments and batch sizes (4-80), SV consistently outperforms both SD and standard decoding with the target model. It improves SD performance by up to 2$\times$, with an average speedup of 1.4 $\times$ in large-batch settings (batch sizes 32-80). These results demonstrate SV's robustness, scalability, and practical utility for efficient LLM inference.

cs.CL

On the complementary roles of anisotropic crack density and anisotropic crack driving force in phase-field modeling of mixed-mode fracture

Phase-field models for anisotropic fracture employ two complementary mechanisms: (i) the anisotropic crack density function, controlling direction-dependent fracture resistance, and (ii) the anisotropic strain energy, governing the fracture driving force. Although the unified framework was presented in Pranavi et al.[Comput. Mech., 73 (2024)], the distinct roles of these mechanisms and their interaction remain uninvestigated. This work addresses this gap by first validating the formulation against mixed-mode fracture experiments on a soft elastomer (Lu et al. [Extreme Mech. Lett., 48 (2021)]), and then conducting systematic parametric studies on single-edge-notched (SEN) and open-hole tension (OHT) specimens to isolate each mechanism. The SEN studies show that the crack density anisotropy controls the crack path and toughness while leaving the elastic response unchanged, whereas the anisotropic strain energy deflects the crack but saturates rapidly. The OHT studies reveal a geometry-dependent role expansion: the anisotropic strain energy governs fiber-orientation-dependent stiffness, peak force, and fracture displacement. When both mechanisms act together, the combined response exhibits nonlinear synergistic interaction exceeding the linear sum of the individual contributions. These results establish that the crack density anisotropy governs the crack path (fracture resistance), while the anisotropic strain energy governs the driving force and, in stress-concentration geometries, additionally controls the elastic strain energy distribution around the stress concentrator.

cond-mat.mtrl-sci