arXiv subjects

Hyeon Hwang

Publications and source records attributed to Hyeon Hwang.

16 recordsLinked to original sources

arXiv2026

Enhancing Low-Resource Language Reasoning via High-Resource Language Feature Transfer

Large language models exhibit substantial performance variation across languages, even when solving semantically equivalent tasks. Existing analyses often treat this phenomenon as an observational disparity caused by differences in pretraining data, tokenization, or benchmark coverage. We study a complementary hypothesis: high-resource languages (HRLs) may more reliably elicit latent computations useful for task-specific (i.e. mathematical) reasoning, while lower-resource languages (LRLs) may under-activate those computations despite expressing the same task. To test this hypothesis, we introduce a mechanistic intervention framework for identifying and transferring task-relevant sparse latent features across languages. Using sparse autoencoders over residual-stream activations, we isolate features enriched in successful HRL task-specific reasoning while filtering out source-language and generic-generation features. We then construct steering directions from these features and inject them during LRL inference. The resulting interventions test whether the selected features are functionally involved in the observed reasoning gap: suppressing them should impair source-language reasoning, while activating them should partially recover target-language reasoning beyond random and non-task controls. Our framework reframes some cross-lingual reasoning gaps as failures of mechanism elicitation rather than capability absence, and offers a causally testable route to feature-mediated transfer without translation, fine-tuning, or changing the user-facing language.

cs.CL↗

arXiv2026

TheBioCollection: Unified Pre-Training Scale LLM Corpus for Biology

The push toward large language models for biology (BioLM) has created a need for training corpora that can endow models with a genuine understanding of biology. However, existing biological resources, such as molecular databases, protein repositories, genomic annotations, single-cell atlases, and pathway databases, are scattered across heterogeneous formats and remain unorganized into a cohesive corpus for language model training. We present TheBioCollection, a 52.6B-token pre-training-scale corpus that converts these disparate resources into a unified, training-ready form spanning small molecules, proteins, genomic sequences, cells, and pathways. Beyond consolidating existing data, TheBioCollection enriches each record with tool-computed biological properties and introduces new instruction tasks for capabilities that current corpora barely cover. We pair the corpus with TheBioCollection-Eval, a matched suite probing recognition, generation, and prediction across molecular, protein, genomic, cellular, and cross-domain settings. Holding the base Gravity-16B-A3B architecture fixed, training on TheBioCollection more than doubles its overall score on TheBioCollection-Eval with gains in every domain, while leaving general linguistic ability nearly intact.

q-bio.QM↗

arXiv2026

Quantum frequency comb with pump-selectable bin pairing and extraction-aware loading in a lithium niobate microresonator

Integrated quantum photonics requires bright, high-fidelity photon-pair sources capable of spectral multiplexing, correlation control, and circuit-compatible extraction. Cavity-enhanced spontaneous parametric down-conversion (SPDC) increases pair generation, but triply resonant operation imposes stringent pump-signal-idler spectral-alignment constraints. Moreover, the trade-off between intrinsic generation and coincidence-to-accidental ratio (CAR) does not capture the usable output flux, which depends on photon extraction. Here, we demonstrate a single-pass-pumped, resonator-enhanced quantum frequency comb (QFC) source based on a periodically poled lithium niobate photonic-crystal Fabry-P$\'e$rot microresonator. The device yields intrinsic and loaded brightnesses of 69.9 and 1.88 MHz/$\mu$W, respectively, and a maximum CAR of 16,000. Frequency-resolved measurements reveal 461 cavity-defined bins spanning 1495-1570 nm, and loaded spectral brightness approaching $4.29\times10^9$ pairs/(s$\cdot$mW$\cdot$nm). Heralded autocorrelation measurements yield a second-order autocorrelation $g_H^{(2)}(0)$ as low as $4.0\times10^{-4}$ for a selected high-CAR cavity-defined bin pair. In particular, tuning the single-pass pump deterministically selects correlated frequency-bin pairings within the fixed QFC grid while preserving brightness and pairwise coincidence rates. We further separate intrinsic generation from output photon-pair flux, revealing the loaded-brightness-CAR relation. Together, pump-selectable bin pairing and extraction-aware loading point to tailored SPDC QFCs as chip-integrated nonclassical light resources for multichannel quantum-state transport and information processing.

physics.optics↗

arXiv2026

Teaching Language Models to Think in Code

Tool-integrated reasoning (TIR) has emerged as a dominant paradigm for mathematical problem solving in language models, combining natural language (NL) reasoning with code execution. However, this interleaved setup has three key limitations: code often acts as a post-hoc verifier, intermediate NL computations are error-prone, and NL and code play overlapping rather than clearly distinct roles. We propose ThinC (Thinking in Code), a framework in which code itself serves as the reasoner rather than as a tool invoked by NL. A ThinC trajectory begins with a brief NL planning step, after which all reasoning unfolds through code blocks connected only by their execution outputs. We distill 12.2k code-centric trajectories from a teacher model and train ThinC-1.7B and ThinC-4B with supervised fine-tuning followed by reinforcement learning. ThinC-4B consistently outperforms every TIR baseline on five competition-level math benchmarks and even surpasses the much larger Qwen3-235B-A22B-Thinking. Further analysis shows that ThinC reasons through code: 99.2% of its final answers are grounded in interpreter output, and the model recovers reliably from code execution failures without intermediate NL reasoning. Our code and models will be released soon.

cs.CL↗

arXiv2026

A.X K1 Technical Report

We introduce A.X K1, a 519B-parameter Mixture-of-Experts (MoE) language model trained from scratch. Our design leverages scaling laws to optimize training configurations and vocabulary size under fixed computational budgets. A.X K1 is pre-trained on a corpus of approximately 10T tokens, curated by a multi-stage data processing pipeline. Designed to bridge the gap between reasoning capability and inference efficiency, A.X K1 supports explicitly controllable reasoning to facilitate scalable deployment across diverse real-world scenarios. We propose a simple yet effective Think-Fusion training recipe, enabling user-controlled switching between thinking and non-thinking modes within a single unified model. Extensive evaluations demonstrate that A.X K1 achieves performance competitive with leading open-source models, while establishing a distinctive advantage in Korean-language benchmarks.

cs.CL↗

arXiv2025

GraphCliff: Short-Long Range Gating for Modeling Critical Activity Changes Caused by Subtle Molecular Differences

The quantitative structure-activity relationship assumes a smooth mapping between molecular structure and biological activity. However, activity cliffs, defined as pairs of structurally similar compounds with large potency differences, break this continuity. Recent activity cliff benchmarks show that machine learning models with extended connectivity fingerprints outperform graph neural networks. Our analysis shows that the embedding distances of conventional graph neural networks fail to reflect the activity differences, collapsing structurally similar yet functionally divergent molecules into nearly indistinguishable representations. To recover sensitivity to such local changes while preserving global molecular context, we propose GraphCliff, which integrates short and long range information at the node level through a locally conditioned gating mechanism. Experimental results demonstrate that GraphCliff consistently improves performance on both non-cliff and cliff compounds, with layer-wise embedding analyses attributing these gains to sharper discrimination of structurally similar molecules relative to strong baseline graph models.

cs.CE↗

arXiv2025

Assessing LLM Reasoning Steps via Principal Knowledge Grounding

Step-by-step reasoning has become a standard approach for large language models (LLMs) to tackle complex tasks. While this paradigm has proven effective, it raises a fundamental question: How can we verify that an LLM's reasoning is accurately grounded in knowledge? To address this question, we introduce a novel evaluation suite that systematically assesses the knowledge grounding of intermediate reasoning. Our framework comprises three key components. (1) Principal Knowledge Collection, a large-scale repository of atomic knowledge essential for reasoning. Based on the collection, we propose (2) knowledge-grounded evaluation metrics designed to measure how well models recall and apply prerequisite knowledge in reasoning. These metrics are computed by our (3) evaluator LLM, a lightweight model optimized for cost-effective and reliable metric computation. Our evaluation suite demonstrates remarkable effectiveness in identifying missing or misapplied knowledge elements, providing crucial insights for uncovering fundamental reasoning deficiencies in LLMs. Beyond evaluation, we demonstrate how these metrics can be integrated into preference optimization, showcasing further applications of knowledge-grounded evaluation.

cs.CL↗

arXiv2025

Integrated bright source of polarization-entangled photons using lithium niobate photonic chips

Quantum photonics has rapidly advanced as a key area for developing quantum technologies by harnessing photons' inherent quantum characteristics, particularly entanglement. Generation of entangled photon pairs, known as Bell states, is crucial for quantum communications, precision sensing, and quantum computing. While bulk quantum optical setups have provided foundational progress, integrated quantum photonic platforms now offer superior scalability, efficiency, and integrative potential. In this study, we demonstrate a compact and bright source of polarization-entangled Bell state utilizing continuous-wave pumping on thin film lithium niobate (TFLN) integrated photonics. Our periodically poled lithium niobate device achieves on-chip brightness of photon pair generation rate of 508.5 MHz/mW, surpassing other integrated platforms including silicon photonics. This demonstration marks the first realization of polarization entanglement on TFLN platforms. Experimentally measured metrics confirm high-quality entangled photon pairs with a purity of 0.901, a concurrence of 0.9, and a fidelity of 0.944. We expect our compact quantum devices to have great potential for advancing quantum communication systems and photonic quantum technologies.

physics.optics↗

arXiv2025

Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models

Extreme activation outliers in Large Language Models (LLMs) critically degrade quantization performance, hindering efficient on-device deployment. While channel-wise operations and adaptive gradient scaling are recognized causes, practical mitigation remains challenging. We introduce Outlier-Safe Pre-Training (OSP), a practical guideline that proactively prevents outlier formation rather than relying on post-hoc mitigation. OSP combines three key innovations: (1) the Muon optimizer, eliminating privileged bases while maintaining training efficiency; (2) Single-Scale RMSNorm, preventing channel-wise amplification; and (3) a learnable embedding projection, redistributing activation magnitudes originating from embedding matrices. We validate OSP by training a 1.4B-parameter model on 1 trillion tokens, which is the first production-scale LLM trained without such outliers. Under aggressive 4-bit quantization, our OSP model achieves a 35.7 average score across 10 benchmarks (compared to 26.5 for an Adam-trained model), with only a 2% training overhead. Remarkably, OSP models exhibit near-zero excess kurtosis (0.04) compared to extreme values (1818.56) in standard models, fundamentally altering LLM quantization behavior. Our work demonstrates that outliers are not inherent to LLMs but are consequences of training strategies, paving the way for more efficient LLM deployment. The source code and pretrained checkpoints are available at https://github.com/dmis-lab/Outlier-Safe-Pre-Training.

cs.LG↗

arXiv2025

High-Q photonic crystal Fabry-Perot micro-resonator in thin-film lithium niobate

Thin-film lithium niobate (TFLN) has emerged as a powerful platform for integrated nonlinear and quantum photonics, owing to its strong optical nonlinearities, wide transparency window, and electro- and piezo-optic properties. However, conventional traveling-wave resonators, such as micro-rings, disks, and racetracks, suffer from curvature-dependent group dispersion and losses, limited spectral tunability, and parasitic nonlinearities, which constrain their performance, scalability, and operational stability in nonlinear photonic circuits. Here, we present photonic crystal (PhC) Fabry-Perot (FP) micro-resonators in TFLN that address these limitations. The device features a one-dimensional straight cavity bounded by PhC reflectors and supports well-confined standing-wave resonant modes within an engineered photonic bandgap. We achieve intrinsic quality (Q) factors of up to 1.4e6 and demonstrate that both the free spectral range (FSR) and coupling strength can be consistently controlled via cavity length and PhC coupler design, respectively. The photonic bandgap is tunable across the S-, C-, and L-bands without degradation of resonator performance. Spectral confinement of high-Q resonant modes is expected to mitigate parasitic nonlinearities, such as Raman scattering. These advances, together with the one-dimensional geometry, establish PhC FP micro-resonators as compact and scalable building blocks for high-density photonic integrated circuits targeting next-generation nonlinear and quantum applications.

physics.optics↗

arXiv2024

Fabrication of a 3D mode size converter for efficient edge coupling in photonic integrated circuits

We demonstrate efficient edge couplers by fabricating a 3D mode size converter on a lithium niobate-on-insulator photonic platform. The 3D mode size converter is fabricated using an etching process that employs a Si external mask to provide height variation and adjust the width variation through tapering patterns via lithography. The measured edge coupling efficiency with a 3D mode size converter was approximately 1.16 dB/facet for the TE mode and approximately 0.71 dB/facet for the TM mode at a wavelength of 1550 nm.

physics.optics↗

arXiv2024

Rationale-Guided Retrieval Augmented Generation for Medical Question Answering

Large language models (LLM) hold significant potential for applications in biomedicine, but they struggle with hallucinations and outdated knowledge. While retrieval-augmented generation (RAG) is generally employed to address these issues, it also has its own set of challenges: (1) LLMs are vulnerable to irrelevant or incorrect context, (2) medical queries are often not well-targeted for helpful information, and (3) retrievers are prone to bias toward the specific source corpus they were trained on. In this study, we present RAG$^2$ (RAtionale-Guided RAG), a new framework for enhancing the reliability of RAG in biomedical contexts. RAG$^2$ incorporates three key innovations: a small filtering model trained on perplexity-based labels of rationales, which selectively augments informative snippets of documents while filtering out distractors; LLM-generated rationales as queries to improve the utility of retrieved snippets; a structure designed to retrieve snippets evenly from a comprehensive set of four biomedical corpora, effectively mitigating retriever bias. Our experiments demonstrate that RAG$^2$ improves the state-of-the-art LLMs of varying sizes, with improvements of up to 6.1\%, and it outperforms the previous best medical RAG model by up to 5.6\% across three medical question-answering benchmarks. Our code is available at https://github.com/dmis-lab/RAG2.

cs.CL↗

arXiv2024

CompAct: Compressing Retrieved Documents Actively for Question Answering

Retrieval-augmented generation supports language models to strengthen their factual groundings by providing external contexts. However, language models often face challenges when given extensive information, diminishing their effectiveness in solving questions. Context compression tackles this issue by filtering out irrelevant information, but current methods still struggle in realistic scenarios where crucial information cannot be captured with a single-step approach. To overcome this limitation, we introduce CompAct, a novel framework that employs an active strategy to condense extensive documents without losing key information. Our experiments demonstrate that CompAct brings significant improvements in both performance and compression rate on multi-hop question-answering benchmarks. CompAct flexibly operates as a cost-efficient plug-in module with various off-the-shelf retrievers or readers, achieving exceptionally high compression rates (47x).

cs.CL↗

arXiv2024

OLAPH: Improving Factuality in Biomedical Long-form Question Answering

In the medical domain, numerous scenarios necessitate the long-form generation ability of large language models (LLMs). Specifically, when addressing patients' questions, it is essential that the model's response conveys factual claims, highlighting the need for an automated method to evaluate those claims. Thus, we introduce MedLFQA, a benchmark dataset reconstructed using long-form question-answering datasets related to the biomedical domain. We use MedLFQA to facilitate a cost-effective automatic evaluations of factuality. We also propose OLAPH, a simple and novel framework that utilizes cost-effective and multifaceted automatic evaluation to construct a synthetic preference set and answers questions in our preferred manner. Our framework leads us to train LLMs step-by-step to reduce hallucinations and include crucial medical claims. We highlight that, even on evaluation metrics not used during training, LLMs trained with our OLAPH framework demonstrate significant performance improvement in factuality. Our findings reveal that a 7B LLM trained with our OLAPH framework can provide long answers comparable to the medical experts' answers in terms of factuality. We believe that our work could shed light on gauging the long-text generation ability of LLMs in the medical domain. Our code and datasets are available.

cs.CL↗

arXiv2024

Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks

While recent advancements in commercial large language models (LM) have shown promising results in medical tasks, their closed-source nature poses significant privacy and security concerns, hindering their widespread use in the medical field. Despite efforts to create open-source models, their limited parameters often result in insufficient multi-step reasoning capabilities required for solving complex medical problems. To address this, we introduce Meerkat, a new family of medical AI systems ranging from 7 to 70 billion parameters. The models were trained using our new synthetic dataset consisting of high-quality chain-of-thought reasoning paths sourced from 18 medical textbooks, along with diverse instruction-following datasets. Our systems achieved remarkable accuracy across six medical benchmarks, surpassing the previous best models such as MediTron and BioMistral, and GPT-3.5 by a large margin. Notably, Meerkat-7B surpassed the passing threshold of the United States Medical Licensing Examination (USMLE) for the first time for a 7B-parameter model, while Meerkat-70B outperformed GPT-4 by an average of 1.3%. Additionally, Meerkat-70B correctly diagnosed 21 out of 38 complex clinical cases, outperforming humans' 13.8 and closely matching GPT-4's 21.8. Our systems offered more detailed free-form responses to clinical queries compared to existing small models, approaching the performance level of large commercial models. This significantly narrows the performance gap with large LMs, showcasing its effectiveness in addressing complex medical challenges.

cs.CL↗

arXiv2019

Time-resolved imaging of non-diffusive carrier transport in long-lifetime halide perovskite thin films

Owing to their exceptional semiconducting properties, hybrid inorganic-organic perovskites show great promise as photovoltaic absorbers. In these materials, long-range diffusion of charge carriers allows for most of the photogenerated carriers to contribute to the photovoltaic efficiency. Here, time-resolved photoluminescence (PL) microscopy is used to directly probe ambipolar carrier diffusion and recombination kinetics in hybrid perovskites. This technique is applied to thin films of methylammonium lead tri-iodide MAPbI$_3$ obtained with two different fabrication routes, methylammonium lead tribromide (MAPbBr$_3$), and an alloy of formamidinium lead tri-iodide (FAPbI$_3$) and methylammonium lead bromide FA$_{0.85}$MA$_{0.15}$Pb(I$_{0.85}$Br_${0.15}$)$_3$. Average diffusion coefficients in the films leading to the highest device efficiencies and longest lifetimes, i.e., in FA$_{0.85}$MA$_{0.15}$Pb(I$_{0.85}$Br$_{0.15}$)$_3$ and acetonitrile-processed MAPbI$_3$, are found to be several orders of magnitude lower than in the other films. Further examination of the time-dependence shows strong evidence for non-diffusive transport. In particular, acetonitrile-processed MAPbI$_3$ shows distinct diffusion regimes on short and long timescales with an effective diffusion constant varying over 2 orders of magnitude. Our results also highlight the fact that increases in carrier lifetime in this class of materials are not necessarily concomitant with increased diffusion lengths and that the PL quantum efficiency under solar cell operating conditions is a greater indication of material, and ultimately device, quality.

physics.app-ph↗