arXiv subjects

Minwoo Kim

Publications and source records attributed to Minwoo Kim.

53 records · Page 3Linked to original sources

arXiv2025

MHTS: Multi-Hop Tree Structure Framework for Generating Difficulty-Controllable QA Datasets for RAG Evaluation

Existing RAG benchmarks often overlook query difficulty, leading to inflated performance on simpler questions and unreliable evaluations. A robust benchmark dataset must satisfy three key criteria: quality, diversity, and difficulty, which capturing the complexity of reasoning based on hops and the distribution of supporting evidence. In this paper, we propose MHTS (Multi-Hop Tree Structure), a novel dataset synthesis framework that systematically controls multi-hop reasoning complexity by leveraging a multi-hop tree structure to generate logically connected, multi-chunk queries. Our fine-grained difficulty estimation formula exhibits a strong correlation with the overall performance metrics of a RAG system, validating its effectiveness in assessing both retrieval and answer generation capabilities. By ensuring high-quality, diverse, and difficulty-controlled queries, our approach enhances RAG evaluation and benchmarking capabilities.

cs.IR↗

arXiv2025

Variable selection and basis learning for ordinal classification

We propose a method for variable selection and basis learning for high-dimensional classification with ordinal responses. The proposed method extends sparse multiclass linear discriminant analysis, with the aim of identifying not only the variables relevant to discrimination but also the variables that are order-concordant with the responses. For this purpose, we compute for each variable an ordinal weight, where larger weights are given to variables with ordered group-means, and penalize the variables with smaller weights more severely. A two-step construction for ordinal weights is developed, and we show that the ordinal weights correctly separate ordinal variables from non-ordinal variables with high probability. The resulting sparse ordinal basis learning method is shown to consistently select either the discriminant variables or the ordinal and discriminant variables, depending on the choice of a tunable parameter. Such asymptotic guarantees are given under a high-dimensional asymptotic regime where the dimension grows much faster than the sample size. We also discuss a two-step procedure of post-screening ordinal variables among the selected discriminant variables. Simulated and real data analyses confirm that the proposed basis learning provides sparse and interpretable basis, as it mostly consists of ordinal variables.

stat.ME↗

arXiv2025

Quantum Linear Multistep Method for Using a Quantum Oracle with Differential Equations

Differential equations are a crucial mathematical tool used in a wide range of applications. If the solution to an initial value problem (IVP) can be transformed into an oracle, it can be utilized in various fields such as search and optimization, achieving quadratic speedup with respect to the number of candidates compared to its classical counterpart. In the past, attempts have been made to implement such an oracle using the Euler method. In this study, we propose a quantum linear multistep method (QLMM) that applies the linear multistep method, commonly used to numerically solve IVPs on classical computers, to generate a numerical solution of the IVP for use in a quantum oracle. We also propose a method to find the optimal form of QLMM for a given IVP. Finally, through computer simulations, we derive the QLMM formulation for an example IVP and show that the solution from the optimized QLMM can be used in an optimization problem.

quant-ph↗

arXiv2024

PBVS 2024 Solution: Self-Supervised Learning and Sampling Strategies for SAR Classification in Extreme Long-Tail Distribution

The Multimodal Learning Workshop (PBVS 2024) aims to improve the performance of automatic target recognition (ATR) systems by leveraging both Synthetic Aperture Radar (SAR) data, which is difficult to interpret but remains unaffected by weather conditions and visible light, and Electro-Optical (EO) data for simultaneous learning. The subtask, known as the Multi-modal Aerial View Imagery Challenge - Classification, focuses on predicting the class label of a low-resolution aerial image based on a set of SAR-EO image pairs and their respective class labels. The provided dataset consists of SAR-EO pairs, characterized by a severe long-tail distribution with over a 1000-fold difference between the largest and smallest classes, making typical long-tail methods difficult to apply. Additionally, the domain disparity between the SAR and EO datasets complicates the effectiveness of standard multimodal methods. To address these significant challenges, we propose a two-stage learning approach that utilizes self-supervised techniques, combined with multimodal learning and inference through SAR-to-EO translation for effective EO utilization. In the final testing phase of the PBVS 2024 Multi-modal Aerial View Image Challenge - Classification (SAR Classification) task, our model achieved an accuracy of 21.45%, an AUC of 0.56, and a total score of 0.30, placing us 9th in the competition.

cs.CV↗

arXiv2024

Modeling High-Resolution Spatio-Temporal Wind with Deep Echo State Networks and Stochastic Partial Differential Equations

In the past decades, clean and renewable energy has gained increasing attention due to a global effort on carbon footprint reduction. In particular, Saudi Arabia is gradually shifting its energy portfolio from an exclusive use of oil to a reliance on renewable energy, and, in particular, wind. Modeling wind for assessing potential energy output in a country as large, geographically diverse and understudied as Saudi Arabia is a challenge which implies highly non-linear dynamic structures in both space and time. To address this, we propose a spatio-temporal model whose spatial information is first reduced via an energy distance-based approach and then its dynamical behavior is informed by a sparse and stochastic recurrent neural network (Echo State Network). Finally, the full spatial data is reconstructed by means of a non-stationary stochastic partial differential equation-based approach. Our model can capture the fine scale wind structure and produce more accurate forecasts of both wind speed and energy in lead times of interest for energy grid management and save annually as much as one million dollar against the closest competitive model.

stat.ML↗

arXiv2024

Distributed Task Offloading and Resource Allocation for Latency Minimization in Mobile Edge Computing Networks

The growth in artificial intelligence (AI) technology has attracted substantial interests in latency-aware task offloading of mobile edge computing (MEC)-namely, minimizing service latency. Additionally, the use of MEC systems poses an additional problem arising from limited battery resources of MDs. This paper tackles the pressing challenge of latency-aware distributed task offloading optimization, where user association (UA), resource allocation (RA), full-task offloading, and battery of mobile devices (MDs) are jointly considered. In existing studies, joint optimization of overall task offloading and UA is seldom considered due to the complexity of combinatorial optimization problems, and in cases where it is considered, linear objective functions such as power consumption are adopted. Revolutionizing the realm of MEC, our objective includes all major components contributing to users' quality of experience, including latency and energy consumption. To achieve this, we first formulate an NP-hard combinatorial problem, where the objective function comprises three elements: communication latency, computation latency, and battery usage. We derive a closed-form RA solution of the problem; next, we provide a distributed pricing-based UA solution. We simulate the proposed algorithm for various resource-intensive tasks. Our numerical results show that the proposed method Pareto-dominates baseline methods. More specifically, the results demonstrate that the proposed method can outperform baseline methods by 1.62 times shorter latency with 41.2% less energy consumption.

eess.SP↗

arXiv2024

Anomalous Water Penetration in $\text{Al}^{3+}$ Dissolution

The physicochemical characterization of trivalent ions is limited due to a lack of accurate force fields. By leveraging the latest machine learning force field to model aqueous $\text{AlCl}_{3}$, we discover that upon dissolution of $\text{Al}^{3+}$, water molecules beyond the second hydration shell involve in the hydration process. A combination of scissoring of coordinating water is followed by synchronized secondary motion of water in the second solvation shell due to hydrogen bonding. Consequently, the water beyond the second solvation penetrates through the second solvation shell and coordinates to the $\text{Al}^{3+}$. Our study reveals a novel microscopic understanding of solvation dynamics for trivalent ion.

physics.chem-ph↗

arXiv2023

A Neural Network-Based Approach to Normality Testing for Dependent Data

There is a wide availability of methods for testing normality under the assumption of independent and identically distributed data. When data are dependent in space and/or time, however, assessing and testing the marginal behavior is considerably more challenging, as the marginal behavior is impacted by the degree of dependence. We propose a new approach to assess normality for dependent data by non-linearly incorporating existing statistics from normality tests as well as sample moments such as skewness and kurtosis through a neural network. We calibrate (deep) neural networks by simulated normal and non-normal data with a wide range of dependence structures and we determine the probability of rejecting the null hypothesis. We compare several approaches for normality tests and demonstrate the superiority of our method in terms of statistical power through an extensive simulation study. A real world application to global temperature data further demonstrates how the degree of spatio-temporal aggregation affects the marginal normality in the data.

stat.ME↗

arXiv2023

Analyzing Norm Violations in Live-Stream Chat

Toxic language, such as hate speech, can deter users from participating in online communities and enjoying popular platforms. Previous approaches to detecting toxic language and norm violations have been primarily concerned with conversations from online forums and social media, such as Reddit and Twitter. These approaches are less effective when applied to conversations on live-streaming platforms, such as Twitch and YouTube Live, as each comment is only visible for a limited time and lacks a thread structure that establishes its relationship with other comments. In this work, we share the first NLP study dedicated to detecting norm violations in conversations on live-streaming platforms. We define norm violation categories in live-stream chats and annotate 4,583 moderated comments from Twitch. We articulate several facets of live-stream data that differ from other forums, and demonstrate that existing models perform poorly in this setting. By conducting a user study, we identify the informational context humans use in live-stream moderation, and train models leveraging context to identify norm violations. Our results show that appropriate contextual information can boost moderation performance by 35\%.

cs.CL↗

arXiv2023

1st Place Solution to MultiEarth 2023 Challenge on Multimodal SAR-to-EO Image Translation

The Multimodal Learning for Earth and Environment Workshop (MultiEarth 2023) aims to harness the substantial amount of remote sensing data gathered over extensive periods for the monitoring and analysis of Earth's ecosystems'health. The subtask, Multimodal SAR-to-EO Image Translation, involves the use of robust SAR data, even under adverse weather and lighting conditions, transforming it into high-quality, clear, and visually appealing EO data. In the context of the SAR2EO task, the presence of clouds or obstructions in EO data can potentially pose a challenge. To address this issue, we propose the Clean Collector Algorithm (CCA), designed to take full advantage of this cloudless SAR data and eliminate factors that may hinder the data learning process. Subsequently, we applied pix2pixHD for the SAR-to-EO translation and Restormer for image enhancement. In the final evaluation, the team 'CDRL' achieved an MAE of 0.07313, securing the top rank on the leaderboard.

cs.CV↗

arXiv2023

Differentially Private Multivariate Statistics with an Application to Contingency Table Analysis

Differential privacy (DP) has become a rigorous central concept for privacy protection in the past decade. We use Gaussian differential privacy (GDP) in gauging the level of privacy protection for releasing statistical summaries from data. The GDP is a natural and easy-to-interpret differential privacy criterion based on the statistical hypothesis testing framework. The Gaussian mechanism is a natural and fundamental mechanism that can be used to perturb multivariate statistics to satisfy a $μ$-GDP criterion, where $μ>0$ stands for the level of privacy protection. Requiring a certain level of differential privacy inevitably leads to a loss of statistical utility. We improve ordinary Gaussian mechanisms by developing rank-deficient James-Stein Gaussian mechanisms for releasing private multivariate statistics, and show that the proposed mechanisms have higher statistical utilities. Laplace mechanisms, the most commonly used mechanisms in the pure DP framework, are also investigated under the GDP criterion. We show that optimal calibration of multivariate Laplace mechanisms requires more information on the statistic than just the global sensitivity, and derive the minimal amount of Laplace perturbation for releasing $μ$-GDP contingency tables. Gaussian mechanisms are shown to have higher statistical utilities than Laplace mechanisms, except for very low levels of privacy. The utility of proposed multivariate mechanisms is further demonstrated using differentially private hypotheses tests on contingency tables. Bootstrap-based goodness-of-fit and homogeneity tests, utilizing the proposed rank-deficient James--Stein mechanisms, exhibit higher powers than natural competitors.

stat.ME↗

arXiv2022

Stochastic fluctuation and transport of tokamak edge plasmas with the resonant magnetic perturbation field

We present that a statistical method known as the Complexity-Entropy analysis is useful to characterize a state of plasma turbulence and flux in the resonant magnetic perturbation (RMP) edge localized mode (ELM) control experiment. The RMP ELM suppression phase with the stochastic pedestal top temperature fluctuation can be distinguished from the natural ELM free phase with the chaotic fluctuation. It is discussed that the stochastic temperature fluctuation localized near the pedestal top can be originated from the narrow layer of the field penetration near the pedestal top. The forced magnetic island can emit the resonant drift wave of comparable sizes (relatively low-k) in the RMP ELM suppression phase, and it can results in the generation of stochastic higher wavenumber fluctuations coupled to tangled fields around the island. The analysis of the ion saturation current measurement around the main outer striking point on the divertor shows that it also becomes more stochastic as the stronger plasma response to the RMP field is expected.

physics.plasm-ph↗

arXiv2022

Exploration in Deep Reinforcement Learning: A Survey

This paper reviews exploration techniques in deep reinforcement learning. Exploration techniques are of primary importance when solving sparse reward problems. In sparse reward problems, the reward is rare, which means that the agent will not find the reward often by acting randomly. In such a scenario, it is challenging for reinforcement learning to learn rewards and actions association. Thus more sophisticated exploration methods need to be devised. This review provides a comprehensive overview of existing exploration approaches, which are categorized based on the key contributions as follows reward novel states, reward diverse behaviours, goal-based methods, probabilistic methods, imitation-based methods, safe exploration and random-based methods. Then, the unsolved challenges are discussed to provide valuable future research directions. Finally, the approaches of different categories are compared in terms of complexity, computational effort and overall performance.

cs.LG↗

arXiv2021

Effects of Phase Difference between Instability Modes on Boundary Layer Transition

Phase effect on the modal interaction of flow instabilities is investigated for laminar-to-turbulent transition in a flat-plate boundary layer flow. Primary and secondary instabilities are numerically studied with 2D Tollmien-Schlichting wave and subharmonic 3D oblique waves at various initial phase differences between these two instability modes. Three numerical methods are used for a systematic approach for the entire transition process, i.e., before the onset of transition well into fully turbulent flow. The Floquet analysis predicts the subharmonic resonance where a subharmonic mode locally resonates for a given basic flow composed of the steady laminar flow and the fundamental mode. Because the Floquet analysis is limited to the resonating subharmonic mode, nonlinear parabolized stability equations (PSE) simulation is conducted with various phase shifts of the subharmonic mode with respect to the given fundamental mode. PSE offers insights on the modal interaction affected by the phase difference up to the weakly nonlinear stage of transition. Large-eddy simulation (LES) is conducted for a complete transition to turbulent boundary layer because PSE becomes prohibitively expensive in the late nonlinear stage of transition. The modulation of the subharmonic resonance with the initial phase difference leads to a significant delay in the transition location up to $ΔRe_{x, tr} \simeq 4\times 10^5$ as predicted by the current LES. Effects of the initial phase difference on the spatial evolution of the modal shape of the subharmonic mode are further investigated. The mechanism of the phase evolution is discussed, based on current numerical results and relevant literature data.

physics.flu-dyn↗

arXiv2021

Variational Bayes algorithm and posterior consistency of Ising model parameter estimation

Ising models originated in statistical physics and are widely used in modeling spatial data and computer vision problems. However, statistical inference of this model remains challenging due to intractable nature of the normalizing constant in the likelihood. Here, we use a pseudo-likelihood instead to study the Bayesian estimation of two-parameter, inverse temperature, and magnetization, Ising model with a fully specified coupling matrix. We develop a computationally efficient variational Bayes procedure for model estimation. Under the Gaussian mean-field variational family, we derive posterior contraction rates of the variational posterior obtained under the pseudo-likelihood. We also discuss the loss incurred due to variational posterior over true posterior for the pseudo-likelihood approach. Extensive simulation studies validate the efficacy of mean-field Gaussian and bivariate Gaussian families as the possible choices of the variational family for inference of Ising model parameters.

stat.ME↗

arXiv2020

Geometric series expansion of the Neumann-Poincaré operator: application to composite materials

The Neumann-Poincaré operator, a singular integral operator on the boundary of a domain, naturally appears when one solves a conductivity transmission problem via the boundary integral formulation. Recently, a series expression of the Neumann-Poincaré operator was developed in two dimensions based on geometric function theory. In this paper, we investigate geometric properties of composite materials by using this series expansion. In particular, we obtain explicit formulas for the polarization tensor and the effective conductivity for an inclusion or a periodic array of inclusions of arbitrary shape with extremal conductivity, in terms of the associated exterior conformal mapping. Also, we observe by numerical computations that the spectrum of the Neumann--Poincaré operator has a monotonic behavior with respect to the shape deformation of the inclusion. Additionally, we derive inequality relations of the coefficients of the Riemann mapping of an arbitrary Lipschitz domain by using the properties of the polarization tensor corresponding to the domain.

math.AP↗

arXiv2020

Drop Impact on Hot Plates: Contact times, Lift-off and the Lamella Rupture

When a liquid drop impacts on a heated substrate, it can remain deposited, or violently boil in contact, or lift off with or without ever touching the surface. The latter is known as the Leidenfrost effect. The duration and area of the liquid--substrate contact is highly relevant for the heat transfer, as well as other effects such as corrosion. However, most experimental studies rely on side view imaging to determine contact times, and those are often mixed with the time until the drop lifts off from the substrate. Here, we develop and validate a reliable method of contact time determination using high-speed X-ray and Total Internal Reflection measurements. We exemplarily compare contact and lift-off times on flat silicon and sapphire substrates. We show that drops can rebound even without formation of a complete vapor layer, with a wide range of lift-off times. On sapphire, we find a local minimum of lift-off times much shorter than by capillary rebound in the comparatively low-temperature regime of transition boiling / thermal atomization. We elucidate the underlying mechanism related to spontaneous rupture of the lamella and receding of the contact area.

physics.flu-dyn↗