arXiv subjects

Wonjun Lee

Publications and source records attributed to Wonjun Lee.

At least 55 records · Page 3Linked to original sources

arXiv2024

SAFIRE: Segment Any Forged Image Region

Most techniques approach the problem of image forgery localization as a binary segmentation task, training neural networks to label original areas as 0 and forged areas as 1. In contrast, we tackle this issue from a more fundamental perspective by partitioning images according to their originating sources. To this end, we propose Segment Any Forged Image Region (SAFIRE), which solves forgery localization using point prompting. Each point on an image is used to segment the source region containing itself. This allows us to partition images into multiple source regions, a capability achieved for the first time. Additionally, rather than memorizing certain forgery traces, SAFIRE naturally focuses on uniform characteristics within each source region. This approach leads to more stable and effective learning, achieving superior performance in both the new task and the traditional binary forgery localization.

cs.CV↗

arXiv2024

Fast pseudothermalization

Quantum resources like entanglement and magic are essential for characterizing the complexity of quantum states. However, when the number of copies of quantum states and the computational time are limited by numbers polynomial in the system size $n$, accurate estimation of the amount of these resources becomes difficult. This makes it impossible to distinguish between ensembles of states with relatively small resources and one that has nearly maximal resources. Such ensembles with small resources are referred to as "pseudo-quantum" ensembles. Recent studies have introduced an ensemble known as the random subset phase state ensemble, which is pseudo-entangled, pseudo-magical, and pseudorandom. While the current state-of-the-art implementation of this ensemble is conjectured to be realized by a circuit with $O(nt)$ depth, it is still too deep for near-term quantum devices to execute for small $t$. In addition, the strict linear dependence on $t$ has only been established as a lower bound on the circuit depth. In this work, we present significantly improved implementations that only require $ω(\log n)\cdot O(t[\log t]^2)$ depth circuits, which almost saturates the theoretical lower bound. This is also the fastest known for generating pseudorandom states to the best of our knowledge. We believe that our findings will facilitate the implementation of pseudo-ensembles on near-term devices, allowing executions of tasks that would otherwise require ensembles with maximal quantum resources, by generating pseudo-ensembles at a super-polynomially fewer number of entangling and non-Clifford gates.

quant-ph↗

arXiv2024

Enhancing Dialogue Speech Recognition with Robust Contextual Awareness via Noise Representation Learning

Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue context from user and agent interactions for transcribing subsequent utterances has been proposed. This method incorporates the transcription of the user's speech and the agent's response as model input, using the accumulated context generated by each turn. However, this context is susceptible to ASR errors because it is generated by the ASR model in an auto-regressive fashion. Such noisy context can further degrade the benefits of context input, resulting in suboptimal ASR performance. In this paper, we introduce Context Noise Representation Learning (CNRL) to enhance robustness against noisy context, ultimately improving dialogue speech recognition accuracy. To maximize the advantage of context awareness, our approach includes decoder pre-training using text-based dialogue data and noise representation learning for a context encoder. Based on the evaluation of speech dialogues, our method shows superior results compared to baselines. Furthermore, the strength of our approach is highlighted in noisy environments where user speech is barely audible due to real-world noise, relying on contextual information to transcribe the input accurately.

cs.CL↗

arXiv2024

An Investigation Into Explainable Audio Hate Speech Detection

Research on hate speech has predominantly revolved around detection and interpretation from textual inputs, leaving verbal content largely unexplored. While there has been limited exploration into hate speech detection within verbal acoustic speech inputs, the aspect of interpretability has been overlooked. Therefore, we introduce a new task of explainable audio hate speech detection. Specifically, we aim to identify the precise time intervals, referred to as audio frame-level rationales, which serve as evidence for hate speech classification. Towards this end, we propose two different approaches: cascading and End-to-End (E2E). The cascading approach initially converts audio to transcripts, identifies hate speech within these transcripts, and subsequently locates the corresponding audio time frames. Conversely, the E2E approach processes audio utterances directly, which allows it to pinpoint hate speech within specific time frames. Additionally, due to the lack of explainable audio hate speech datasets that include audio frame-level rationales, we curated a synthetic audio dataset to train our models. We further validated these models on actual human speech utterances and found that the E2E approach outperforms the cascading method in terms of the audio frame Intersection over Union (IoU) metric. Furthermore, we observed that including frame-level rationales significantly enhances hate speech detection accuracy for the E2E approach. \textbf{Disclaimer} The reader may encounter content of an offensive or hateful nature. However, given the nature of the work, this cannot be avoided.

cs.CL↗

arXiv2024

Improving Hyperbolic Representations via Gromov-Wasserstein Regularization

Hyperbolic representations have shown remarkable efficacy in modeling inherent hierarchies and complexities within data structures. Hyperbolic neural networks have been commonly applied for learning such representations from data, but they often fall short in preserving the geometric structures of the original feature spaces. In response to this challenge, our work applies the Gromov-Wasserstein (GW) distance as a novel regularization mechanism within hyperbolic neural networks. The GW distance quantifies how well the original data structure is maintained after embedding the data in a hyperbolic space. Specifically, we explicitly treat the layers of the hyperbolic neural networks as a transport map and calculate the GW distance accordingly. We validate that the GW distance computed based on a training set well approximates the GW distance of the underlying data distribution. Our approach demonstrates consistent enhancements over current state-of-the-art methods across various tasks, including few-shot image classification, as well as semi-supervised graph link prediction and node classification.

cs.LG↗

arXiv2024

Non-Abelian Fractional Quantum Anomalous Hall States and First Landau Level Physics in Second Moiré Band of Twisted Bilayer MoTe2

Utilizing the realistic continuum description of twisted bilayer MoTe2 and many-body exact diagonalization calculation, we establish that the second moiré band of twisted bilayer MoTe2, at a small twist angle of approximately 2°, serves as an optimal platform for achieving the long-sought non-Abelian fractional quantum anomalous Hall states without the need for external magnetic fields. Across a wide parameter range, our exact diagonalization calculations reveal that the half-filled second moiré band demonstrates the ground state degeneracy and spectral flows, which are consistent with the pfaffian state in the first Landau level. We further elucidate that the emergence of the non-Abelian state is deeply connected to the remarkable similarity between the second moiré band and the first Landau level. Essentially, the band not only exhibits characteristics akin to the first Landau level, $\frac{1}{2π}\int_\mathrm{BZ}\mathrm{d}^2\mathbf{k}\:\mathrm{tr}\:η(\mathbf{k}) \approx 3$ where $η_{ab}(\mathbf{k})$ is the Fubini-Study metric of the band, but also that its projected Coulomb interaction closely mirrors the Haldane pseudopotentials of the first Landau level. Motivated from this observation, we introduce a novel metric of "first Landau level"-ness of a band, which quantitatively measures the alignment of the projected Coulomb interaction with the Haldane pseudopotentials in Landau levels. This metric is then compared with the global phase diagram of the half-filled second moiré band, revealing its utility in predicting the parameter region of the non-Abelian state. In addition, we uncover that the first and third moiré bands closely resemble the lowest and second Landau levels, revealing a remarkable sequential equivalence between the moiré bands and Landau levels. We finally discuss the potential implications on experiments.

cond-mat.str-el↗

arXiv2024

Monotone Generative Modeling via a Gromov-Monge Embedding

Generative adversarial networks (GANs) are popular for generative tasks; however, they often require careful architecture selection, extensive empirical tuning, and are prone to mode collapse. To overcome these challenges, we propose a novel model that identifies the low-dimensional structure of the underlying data distribution, maps it into a low-dimensional latent space while preserving the underlying geometry, and then optimally transports a reference measure to the embedded distribution. We prove three key properties of our method: 1) The encoder preserves the geometry of the underlying data; 2) The generator is $c$-cyclically monotone, where $c$ is an intrinsic embedding cost employed by the encoder; and 3) The discriminator's modulus of continuity improves with the geometric preservation of the data. Numerical experiments demonstrate the effectiveness of our approach in generating high-quality images and exhibiting robustness to both mode collapse and training instability.

cs.LG↗

arXiv2024

Acoustic Feature Mixup for Balanced Multi-aspect Pronunciation Assessment

In automated pronunciation assessment, recent emphasis progressively lies on evaluating multiple aspects to provide enriched feedback. However, acquiring multi-aspect-score labeled data for non-native language learners' speech poses challenges; moreover, it often leads to score-imbalanced distributions. In this paper, we propose two Acoustic Feature Mixup strategies, linearly and non-linearly interpolating with the in-batch averaged feature, to address data scarcity and score-label imbalances. Primarily using goodness-of-pronunciation as an acoustic feature, we tailor mixup designs to suit pronunciation assessment. Further, we integrate fine-grained error-rate features by comparing speech recognition results with the original answer phonemes, giving direct hints for mispronunciation. Effective mixing of the acoustic features notably enhances overall scoring performances on the speechocean762 dataset, and detailed analysis highlights our potential to predict unseen distortions.

cs.CL↗

arXiv2023

Quantum spin nematic phase in a square-lattice iridate

Spin nematic (SN) is a magnetic analog of classical liquid crystals, a fourth state of matter exhibiting characteristics of both liquid and solid. Particularly intriguing is a valence-bond SN, in which spins are quantum entangled to form a multi-polar order without breaking time-reversal symmetry, but its unambiguous experimental realization remains elusive. Here, we establish a SN phase in the square-lattice iridate Sr$_2$IrO$_4$, which approximately realizes a pseudospin one-half Heisenberg antiferromagnet (AF) in the strong spin-orbit coupling limit. Upon cooling, the transition into the SN phase at T$_C$ $\approx$ 263 K is marked by a divergence in the static spin quadrupole susceptibility extracted from our Raman spectra, and concomitant emergence of a collective mode associated with the spontaneous breaking of rotational symmetries. The quadrupolar order persists in the antiferromagnetic (AF) phase below T$_N$ $\approx$ 230 K, and becomes directly observable through its interference with the AF order in resonant x-ray diffraction, which allows us to uniquely determine its spatial structure. Further, we find using resonant inelastic x-ray scattering a complete breakdown of coherent magnon excitations at short-wavelength scales, suggesting a resonating-valence-bond-like quantum entanglement in the AF state. Taken together, our results reveal a quantum order underlying the Néel AF that is widely believed to be intimately connected to the mechanism of high temperature superconductivity (HTSC).

cond-mat.str-el↗

arXiv2023

Optimizing Two-Pass Cross-Lingual Transfer Learning: Phoneme Recognition and Phoneme to Grapheme Translation

This research optimizes two-pass cross-lingual transfer learning in low-resource languages by enhancing phoneme recognition and phoneme-to-grapheme translation models. Our approach optimizes these two stages to improve speech recognition across languages. We optimize phoneme vocabulary coverage by merging phonemes based on shared articulatory characteristics, thus improving recognition accuracy. Additionally, we introduce a global phoneme noise generator for realistic ASR noise during phoneme-to-grapheme training to reduce error propagation. Experiments on the CommonVoice 12.0 dataset show significant reductions in Word Error Rate (WER) for low-resource languages, highlighting the effectiveness of our approach. This research contributes to the advancements of two-pass ASR systems in low-resource languages, offering the potential for improved cross-lingual transfer learning.

cs.CL↗

arXiv2023

Controllable Andreev Bound States in Bilayer Graphene Josephson Junction from Short to Long Junction Limits

We demonstrate that the mode number of Andreev bound states in bilayer graphene Josephson junctions can be modulated by in situ control of the superconducting coherence length. By exploiting the quadratic band dispersion of bilayer graphene, we control the Fermi velocity and thus the coherence length by the application of the electrostatic gating. Tunneling spectroscopy of Andreev bound states reveals a crossover from short to long Josephson junction regimes as the gate voltage is approached near the charge neutral point of bilayer graphene. Furthermore, quantitative analysis of Andreev spectrums for different mode numbers allows us to quantitatively estimate the phase-dependent Josephson current. Our work paves a new way to study multi-mode Andreev levels and to engineer Fermi velocity with bilayer graphene.

cond-mat.mes-hall↗

arXiv2023

Exploring the Viability of Synthetic Audio Data for Audio-Based Dialogue State Tracking

Dialogue state tracking plays a crucial role in extracting information in task-oriented dialogue systems. However, preceding research are limited to textual modalities, primarily due to the shortage of authentic human audio datasets. We address this by investigating synthetic audio data for audio-based DST. To this end, we develop cascading and end-to-end models, train them with our synthetic audio dataset, and test them on actual human speech data. To facilitate evaluation tailored to audio modalities, we introduce a novel PhonemeF1 to capture pronunciation similarity. Experimental results showed that models trained solely on synthetic datasets can generalize their performance to human voice data. By eliminating the dependency on human speech data collection, these insights pave the way for significant practical advancements in audio-based DST. Data and code are available at https://github.com/JihyunLee1/E2E-DST.

cs.SD↗

arXiv2023

Few-Shot Anomaly Detection with Adversarial Loss for Robust Feature Representations

Anomaly detection is a critical and challenging task that aims to identify data points deviating from normal patterns and distributions within a dataset. Various methods have been proposed using a one-class-one-model approach, but these techniques often face practical problems such as memory inefficiency and the requirement of sufficient data for training. In particular, few-shot anomaly detection presents significant challenges in industrial applications, where limited samples are available before mass production. In this paper, we propose a few-shot anomaly detection method that integrates adversarial training loss to obtain more robust and generalized feature representations. We utilize the adversarial loss previously employed in domain adaptation to align feature distributions between source and target domains, to enhance feature robustness and generalization in few-shot anomaly detection tasks. We hypothesize that adversarial loss is effective when applied to features that should have similar characteristics, such as those from the same layer in a Siamese network's parallel branches or input-output pairs of reconstruction-based methods. Experimental results demonstrate that the proposed method generally achieves better performance when utilizing the adversarial loss.

cs.LG↗

arXiv2023

Monotone discretizations of levelset convex geometric PDEs

We introduce a novel algorithm that converges to level-set convex viscosity solutions of high-dimensional Hamilton-Jacobi equations. The algorithm is applicable to a broad class of curvature motion PDEs, as well as a recently developed Hamilton-Jacobi equation for the Tukey depth, which is a statistical depth measure of data points. A main contribution of our work is a new monotone scheme for approximating the direction of the gradient, which allows for monotone discretizations of pure partial derivatives in the direction of, and orthogonal to, the gradient. We provide a convergence analysis of the algorithm on both regular Cartesian grids and unstructured point clouds in any dimension and present numerical experiments that demonstrate the effectiveness of the algorithm in approximating solutions of the affine flow in two dimensions and the Tukey depth measure of high-dimensional datasets such as MNIST and FashionMNIST.

math.NA↗

arXiv2023

Deep JKO: time-implicit particle methods for general nonlinear gradient flows

We develop novel neural network-based implicit particle methods to compute high-dimensional Wasserstein-type gradient flows with linear and nonlinear mobility functions. The main idea is to use the Lagrangian formulation in the Jordan--Kinderlehrer--Otto (JKO) framework, where the velocity field is approximated using a neural network. We leverage the formulations from the neural ordinary differential equation (neural ODE) in the context of continuous normalizing flow for efficient density computation. Additionally, we make use of an explicit recurrence relation for computing derivatives, which greatly streamlines the backpropagation process. Our methodology demonstrates versatility in handling a wide range of gradient flows, accommodating various potential functions and nonlinear mobility scenarios. Extensive experiments demonstrate the efficacy of our approach, including an illustrative example from Bayesian inverse problems. This underscores that our scheme provides a viable alternative solver for the Kalman-Wasserstein gradient flow.

math.NA↗

arXiv2023

Measuring Non-local Brane Order with Error-corrected Parity Snapshots

Exotic quantum many-body states, such as Haldane and spin liquid phases, can exhibit remarkable features like fractional excitations and non-abelian statistics and offer new understandings of quantum entanglement in many-body quantum systems. These phases are classified by non-local correlators that can be directly measured in atomic analog quantum simulating platforms, such as optical lattices and Rydberg atom arrays. However, characterizing these phases in large systems is experimentally challenging because they are sensitive to local errors like atom loss, which suppress its signals exponentially. Additionally, protocols for systematically identifying and mitigating uncorrelated errors in analog quantum simulators are lacking. Here, we address these challenges by developing an error correction method for large-scale neutral atom quantum simulators using optical lattices. Our error correction method can distinguish correlated particle-hole pairs from uncorrelated holes in the Mott insulator. After removing the uncorrelated errors, we observe a dramatic improvement in the non-local parity correlator and find the perimeter scaling law. Furthermore, the error model provides a statistical estimation of fluctuations in site occupation, from which we measure the generalized brane correlator and confirm that it can be an order parameter for Mott insulators in two dimensions. Our work provides a promising avenue for investigating and characterizing exotic phases of matters in large-scale quantum simulators.

cond-mat.quant-gas↗

arXiv2023

Kernel-level Rootkit Detection, Prevention and Behavior Profiling: A Taxonomy and Survey

One of the most elusive types of malware in recent times that pose significant challenges in the computer security system is the kernel-level rootkits. The kernel-level rootkits can hide its presence and malicious activities by modifying the kernel control flow, by hooking in the kernel space, or by manipulating the kernel objects. As kernel-level rootkits change the kernel, it is difficult for user-level security tools to detect the kernel-level rootkits. In the past few years, many approaches have been proposed to detect kernel-level rootkits. It is not much difficult for an attacker to evade the signature-based kernel-level rootkit detection system by slightly modifying the existing signature. To detect the evolving kernel-level rootkits, researchers have proposed and experimented with many detection systems. In this paper, we survey traditional kernel-level rootkit detection mechanisms in literature and propose a structured kernel-level rootkit detection taxonomy. We have discussed the strength and weaknesses or challenges of each detection approach. The prevention techniques and profiling kernel-level rootkit behavior affiliated literature are also included in this survey. The paper ends with future research directions for kernel-level rootkit detection.

cs.CR↗

arXiv2022

Mean field control problems for vaccine distribution

With the invention of the COVID-19 vaccine, shipping and distributing are crucial in controlling the pandemic. In this paper, we build a mean-field variational problem in a spatial domain, which controls the propagation of pandemic by the optimal transportation strategy of vaccine distribution. Here we integrate the vaccine distribution into the mean-field SIR model designed in our previous paper arXiv:2006.01249. Numerical examples demonstrate that the proposed model provides practical strategies in vaccine distribution on a spatial domain.

math.OC↗