arXiv ScienceSearch

arXiv subjects

Youngjin Kim

Publications and source records attributed to Youngjin Kim.

15 recordsLinked to original sources

A.X K2 Technical Report

We introduce A.X K2, a 688B-parameter Mixture-of-Experts (MoE) language model trained from scratch as a high-performance foundation for \emph{agentic} applications. Trained on approximately 8.5T tokens---fewer than its predecessor, A.X K1---on a smaller but higher-quality mixture with substantially expanded agentic and software-engineering data, it nonetheless improves over A.X K1 across the board, by over 30 percentage points on some benchmarks, reflecting large gains in token efficiency. To support long contexts efficiently, we introduce Sparse Gated Attention (SGA), which combines sparse attention with gated attention, and adopt Gated Norm (GN) to stabilize large-scale training. SGA is trained natively at 128K through a \emph{sparse} indexer warmup that optimizes the indexer against its own sparse top-$k$ selection rather than the dense attention distribution, making adaptation markedly cheaper: each query reads only 2,048 positions, yet long-context quality is unchanged and A.X K2 scores 94.6 on RULER out to 256K. The outlier suppression of GN in turn keeps 4-bit NVFP4 serving within one point of FP8 accuracy. A simple yet effective Think-Fusion recipe further lets users switch between thinking and non-thinking modes within a single unified model. Extensive evaluations show that A.X K2 performs competitively against strong open-weight baselines, matching or exceeding them on math and Korean-language benchmarks.

cs.AI

CART: Context-Aware Terrain Adaptation using Temporal Sequence Selection for Legged Robots

Animals in nature combine multiple modalities, such as sight and feel, to perceive terrain and develop an understanding of how to walk on uneven terrain in an efficient manner. Similarly, legged robots need to develop their ability to stably walk on complex terrains by developing an understanding of the relationship between vision and proprioception. Most current terrain-adaptation methods remain susceptible to failure on complex off-road terrain because they do not explicitly model the context between exteroceptive terrain appearance and proprioceptive physical interaction. This experience-based learning often creates a Visual-Texture Paradox between what has been seen and how it actually feels. In this work, we introduce CART, a high-level controller built on a context-aware terrain adaptation approach that integrates proprioception and exteroception from onboard sensing to achieve a robust understanding of terrain. We evaluate our method on multiple terrains using the Unitree Go2 and ANYmal-C robot on the IsaacSim simulator and a Boston Dynamics SPOT robot for our real-world experiments. To evaluate whether the learned context improves locomotion behavior under the various paradox circumstances, we measure the robot s stability, traversal success, and task completion time in both simulation and real-world experiments. We compare CART against state-of-the-art locomotion and terrain- adaptation baselines across diverse terrain conditions. CART improves the average success rate by 5% over the baselines in simulation, while improving context-conditioned locomotion behavior, including up to 41% lower base oscillation in simulation and 22% in the real world, without increasing the time required to complete the locomotion tasks.

cs.RO

A.X K1 Technical Report

We introduce A.X K1, a 519B-parameter Mixture-of-Experts (MoE) language model trained from scratch. Our design leverages scaling laws to optimize training configurations and vocabulary size under fixed computational budgets. A.X K1 is pre-trained on a corpus of approximately 10T tokens, curated by a multi-stage data processing pipeline. Designed to bridge the gap between reasoning capability and inference efficiency, A.X K1 supports explicitly controllable reasoning to facilitate scalable deployment across diverse real-world scenarios. We propose a simple yet effective Think-Fusion training recipe, enabling user-controlled switching between thinking and non-thinking modes within a single unified model. Extensive evaluations demonstrate that A.X K1 achieves performance competitive with leading open-source models, while establishing a distinctive advantage in Korean-language benchmarks.

cs.CL

QuayPoints: A Reasoning Framework to Bridge the Information Gap Between Global and Local Planning in Autonomous Racing

Autonomous racing requires tight integration between perception, planning and control to minimize latency as well as timely decision making. A standard autonomy pipeline comprising a global planner, local planner, and controller loses information as the higher-level racing context is sequentially propagated downstream into specific task-oriented context. In particular, the global planner's understanding of optimality is typically reduced to a sparse set of waypoints, leaving the local planner to make reactive decisions with limited context. This paper investigates whether additional global insights, specifically time-optimality information, can be meaningfully passed to the local planner to improve downstream decisions. We introduce a framework that preserves essential global knowledge and conveys it to the local planner through QuayPoints regions where deviations from the optimal raceline result in significant compromises to optimality. QuayPoints enable local planners to make more informed global decisions when deviating from the raceline, such as during strategic overtaking. To demonstrate this, we integrate QuayPoints into an existing planner and show that it consistently overtakes opponents traveling at up to 75% of the ego vehicle's speed across four distinct race tracks.

cs.RO

Active Illumination Control in Low-Light Environments using NightHawk

Subterranean environments such as culverts present significant challenges to robot vision due to dim lighting and lack of distinctive features. Although onboard illumination can help, it introduces issues such as specular reflections, overexposure, and increased power consumption. We propose NightHawk, a framework that combines active illumination with exposure control to optimize image quality in these settings. NightHawk formulates an online Bayesian optimization problem to determine the best light intensity and exposure-time for a given scene. We propose a novel feature detector-based metric to quantify image utility and use it as the cost function for the optimizer. We built NightHawk as an event-triggered recursive optimization pipeline and deployed it on a legged robot navigating a culvert beneath the Erie Canal. Results from field experiments demonstrate improvements in feature detection and matching by 47-197% enabling more reliable visual estimation in challenging lighting conditions.

cs.RO

Pseudoscalar Higgs plus jet production at Next-to-Next-to-Leading Order in QCD

We present a calculation of pseudoscalar Higgs production in association with a jet at Next-to-Next-to Leading Order (NNLO) accuracy in QCD. We work in an effective field theory in which $m_t \rightarrow \infty$ resulting in effective operators which couple the pseudoscalar to gluons and (massless) quarks. We have calculated all of the relevant amplitudes for the two-loop, one-loop and tree-level contributions. As a cross-check of our calculation we have re-calculated all of the scalar Higgs plus parton amplitudes and perform a detailed comparison to the literature. In order to regulate the infra-red singularities present at this order we employ the $N-$jettiness slicing method. In addition to a detailed validation of our calculation at this order we investigate LHC phenomenology for a selection of pseudoscalar Higgs masses. Our results are implemented into the parton-level Monte Carlo code MCFM.

hep-ph

Depolarized Holography with Polarization-multiplexing Metasurface

The evolution of computer-generated holography (CGH) algorithms has prompted significant improvements in the performances of holographic displays. Nonetheless, they start to encounter a limited degree of freedom in CGH optimization and physical constraints stemming from the coherent nature of holograms. To surpass the physical limitations, we consider polarization as a new degree of freedom by utilizing a novel optical platform called metasurface. Polarization-multiplexing metasurfaces enable incoherent-like behavior in holographic displays due to the mutual incoherence of orthogonal polarization states. We leverage this unique characteristic of a metasurface by integrating it into a holographic display and exploiting polarization diversity to bring an additional degree of freedom for CGH algorithms. To minimize the speckle noise while maximizing the image quality, we devise a fully differentiable optimization pipeline by taking into account the metasurface proxy model, thereby jointly optimizing spatial light modulator phase patterns and geometric parameters of metasurface nanostructures. We evaluate the metasurface-enabled depolarized holography through simulations and experiments, demonstrating its ability to reduce speckle noise and enhance image quality.

physics.optics

Energy-Time Optimal Control of Wheeled Mobile Robots

This paper focuses on the energy-time optimal control of wheeled mobile robots undergoing point-to-point transitions in an obstacles free space. Two interchangeable models are used to arrive at the necessary conditions for optimality. The first formulation exploits the Hamiltonian, while the second formulation considers the first variation of the augmented cost to derive the necessary conditions for optimality. Jacobi elliptic functions are shown to parameterize the closed form solutions for the states, control and costates. Analysis of the optimal control reveal that they are constrained to lie on a cylinder whose circular cross-section is a function of the weight penalizing the relative costs of time and energy. The evolving optimal costates for the second formulation are shown to lie on the intersection of two cylinders. The optimal control for the wheeled mobile robot undergoing point-to-point motion is also developed where the linear velocity is constrained to be time-invariant. It is shown that the costates are constrained to lie on the intersection of a cylinder and an extruded parabola. Numerical results for various point-to-point maneuvers are presented to illustrate the change in the structure of the optimal trajectories as a function of the relative location of the terminal and initial states.

cs.RO

Online Learning of Interconnected Neural Networks for Optimal Control of an HVAC System

Optimizing the operation of heating, ventilation, and air-conditioning (HVAC) systems is a challenging task, requiring the modeling of complex nonlinear relationships among HVAC load, indoor temperatures, and outdoor environments. This paper proposes a new strategy for optimal operation of an HVAC system in a commercial building. The system for indoor temperature control is divided into three sub-systems, each of which is modeled using an artificial neural network (ANN). The ANNs are then interconnected and integrated into an optimization problem for temperature set-point scheduling. The problem is reformulated to determine the optimal set-points using a deterministic search algorithm. After the optimal scheduling is initiated, the ANNs undergo online learning repeatedly, mitigating the overfitting. Case studies are performed to analyze the performance of the proposed strategy, compared to the strategies with a pre-determined temperature set-point, an ideal physics-based building model, and conventional ANN-based building models. The case study results confirm that the proposed strategy is effective in terms of the HVAC energy cost, practical applicability, and training data requirement.

eess.SY

Optimal Voltage and Current Control of an HVDC System to Improve Real-Time Frequency Regulation

High-voltage direct-current (HVDC) systems for constant or intermittent power delivery have recently been developed further to support grid frequency regulation (GFR). This paper proposes a new control strategy for a line-commutated converter-based (LCC) HVDC system, wherein the DC-link voltage and current are optimally regulated to improve real-time GFR in both rectifier- and inverter-side AC networks. A dynamic model of an LCC HVDC system is developed using the DC voltage and current as input variables, and is integrated with feedback loops for inertia emulation and droop control. A linear quadratic Gaussian (LQG) controller is also designed for optimal secondary frequency control, while mitigating conflict between the droop controllers of the HVDC converters. An eigenvalue analysis is then conducted, focusing on the effects of model parameters and controller gains on the proposed strategy. Simulation case studies are also performed using the Jeju-Haenam HVDC system as a test bed. The results of the case study confirm that the proposed strategy enables the HVDC system to improve GFR, in coordination with generators in both-side grids, by exploiting the fast dynamics of HVDC converters. The proposed strategy is also effective under various conditions for the LQG weighting coefficients, inertia emulation, and droop control.

eess.SY

Relieving the Need for Bi-Level Decision-Making for Optimal Retail Pricing via Online Meta-Prediction of Data-Driven Demand Response of HVAC Systems

Price-based demand response (DR) of heating, ventilating, and air-conditioning (HVAC) systems is a challenging task, requiring comprehensive models to represent the building thermal dynamics and game theoretic interactions among participants. This paper proposes an online learning-based strategy for a distribution system operator (DSO) to determine optimal electricity prices, considering the optimal DR of HVAC systems in commercial buildings. An artificial neural network (ANN) is trained with building energy data and represented using an explicit set of linear and nonlinear equations, without physics-based model parameters. An optimization problem for price-based DR is then formulated using this equation set and repeatedly solved offline, producing data on optimal DR schedules for various conditions of electricity prices and building thermal environments. Another ANN is then trained online to directly predict DR schedules for day-ahead electricity prices, which is referred to as meta-prediction (MP). By replacing the DR optimization problem with the MP-enabled ANN, an optimal electricity pricing strategy can be implemented using a single-level decision-making structure, which is simpler and more practical than a bi-level one. In simulation case studies, the proposed single-level strategy is verified to successfully reflect the game theoretic relations between the DSO and commercial building operators, so that they effectively exploit the operational flexibility of the HVAC systems to make the DR application profitable, while ensuring the grid voltage stability and occupants thermal comfort.

eess.SY

Supervised-learning-based Optimal Thermal Management in an Electric Vehicle

Due to the increasing market share of electric vehicles (EVs), the optimal thermal management (TM) of batteries has recently received significant attention. Optimal battery temperature control is challenging, requiring a detailed model and numerous parameters of the TM system, which includes fans, pumps, compressors, and heat exchangers. This paper proposes a supervised learning strategy for the optimal operation of the TM system in an EV. Specifically, for TM subsystems, individual artificial neural networks (ANNs) are implemented and trained with data obtained under normal EV driving conditions. The ANNs are then interconnected based on the physical configuration of the TM system. The trained ANNs are replicated using piecewise linear equations, which can be explicitly integrated into an optimization problem for optimal TM scheduling. This approach enables the application of a mixed-integer linear programming solver to the problem, ensuring the global optimality of the solution. Simulation case studies are performed for the two operating modes of the TM system: i.e., integrated and separate modes. The case study results demonstrate that the ANN-based model successfully reflects the operating characteristics of the TM system, enabling accurate battery temperature estimation. The proposed optimal TM strategy using the ANN-based model is verified to be effective in reducing the total energy consumption, while maintaining the battery temperature within an acceptable range.

eess.SY

A supervised-learning-based strategy for optimal demand response of an HVAC System

The large thermal capacity of buildings enables heating, ventilating, and air-conditioning (HVAC) systems to be exploited as demand response (DR) resources. Optimal DR of HVAC units is challenging, particularly for multi-zone buildings, because this requires detailed physics-based models of zonal temperature variations for HVAC system operation and building thermal conditions. This paper proposes a new strategy for optimal DR of an HVAC system in a multi-zone building, based on supervised learning (SL). Artificial neural networks (ANNs) are trained with data obtained under normal building operating conditions. The ANNs are replicated using piecewise linear equations, which are explicitly integrated into an optimal scheduling problem for price-based DR. The optimization problem is solved for various electricity prices and building thermal conditions. The solutions are further used to train a deep neural network (DNN) to directly determine the optimal DR schedule, referred to here as supervised-learning-aided meta-prediction (SLAMP). Case studies are performed using three different methods: explicit ANN replication (EAR), SLAMP, and physics-based modeling. The case study results verify the effectiveness of the proposed SL-based strategy, in terms of both practical applicability and computational time, while also ensuring the thermal comfort of occupants and cost-effective operation of the HVAC system.

cs.LG

Memorization Precedes Generation: Learning Unsupervised GANs with Memory Networks

We propose an approach to address two issues that commonly occur during training of unsupervised GANs. First, since GANs use only a continuous latent distribution to embed multiple classes or clusters of data, they often do not correctly handle the structural discontinuity between disparate classes in a latent space. Second, discriminators of GANs easily forget about past generated samples by generators, incurring instability during adversarial training. We argue that these two infamous problems of unsupervised GAN training can be largely alleviated by a learnable memory network to which both generators and discriminators can access. Generators can effectively learn representation of training samples to understand underlying cluster distributions of data, which ease the structure discontinuity problem. At the same time, discriminators can better memorize clusters of previously generated samples, which mitigate the forgetting problem. We propose a novel end-to-end GAN model named memoryGAN, which involves a memory network that is unsupervisedly trainable and integrable to many existing GAN models. With evaluations on multiple datasets such as Fashion-MNIST, CelebA, CIFAR10, and Chairs, we show that our model is probabilistically interpretable, and generates realistic image samples of high visual fidelity. The memoryGAN also achieves the state-of-the-art inception scores over unsupervised GAN models on the CIFAR10 dataset, without any optimization tricks and weaker divergences.

cs.LG

TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering

Vision and language understanding has emerged as a subject undergoing intense study in Artificial Intelligence. Among many tasks in this line of research, visual question answering (VQA) has been one of the most successful ones, where the goal is to learn a model that understands visual content at region-level details and finds their associations with pairs of questions and answers in the natural language form. Despite the rapid progress in the past few years, most existing work in VQA have focused primarily on images. In this paper, we focus on extending VQA to the video domain and contribute to the literature in three important ways. First, we propose three new tasks designed specifically for video VQA, which require spatio-temporal reasoning from videos to answer questions correctly. Next, we introduce a new large-scale dataset for video VQA named TGIF-QA that extends existing VQA work with our new tasks. Finally, we propose a dual-LSTM based approach with both spatial and temporal attention, and show its effectiveness over conventional VQA techniques through empirical evaluations.

cs.CV