arXiv subjects

Minseok Kim

Publications and source records attributed to Minseok Kim.

82 records · Page 5Linked to original sources

arXiv2021

AMSS-Net: Audio Manipulation on User-Specified Sources with Textual Queries

This paper proposes a neural network that performs audio transformations to user-specified sources (e.g., vocals) of a given audio track according to a given description while preserving other sources not mentioned in the description. Audio Manipulation on a Specific Source (AMSS) is challenging because a sound object (i.e., a waveform sample or frequency bin) is `transparent'; it usually carries information from multiple sources, in contrast to a pixel in an image. To address this challenging problem, we propose AMSS-Net, which extracts latent sources and selectively manipulates them while preserving irrelevant sources. We also propose an evaluation benchmark for several AMSS tasks, and we show that AMSS-Net outperforms baselines on several AMSS tasks via objective metrics and empirical verification.

eess.AS↗

arXiv2021

LaSAFT: Latent Source Attentive Frequency Transformation for Conditioned Source Separation

Recent deep-learning approaches have shown that Frequency Transformation (FT) blocks can significantly improve spectrogram-based single-source separation models by capturing frequency patterns. The goal of this paper is to extend the FT block to fit the multi-source task. We propose the Latent Source Attentive Frequency Transformation (LaSAFT) block to capture source-dependent frequency patterns. We also propose the Gated Point-wise Convolutional Modulation (GPoCM), an extension of Feature-wise Linear Modulation (FiLM), to modulate internal features. By employing these two novel methods, we extend the Conditioned-U-Net (CUNet) for multi-source separation, and the experimental results indicate that our LaSAFT and GPoCM can improve the CUNet's performance, achieving state-of-the-art SDR performance on several MUSDB18 source separation tasks.

cs.SD↗

arXiv2021

Functionality-Driven Musculature Retargeting

We present a novel retargeting algorithm that transfers the musculature of a reference anatomical model to new bodies with different sizes, body proportions, muscle capability, and joint range of motion while preserving the functionality of the original musculature as closely as possible. The geometric configuration and physiological parameters of musculotendon units are estimated and optimized to adapt to new bodies. The range of motion around joints is estimated from a motion capture dataset and edited further for individual models. The retargeted model is simulation-ready, so we can physically simulate muscle-actuated motor skills with the model. Our system is capable of generating a wide variety of anatomical bodies that can be simulated to walk, run, jump and dance while maintaining balance under gravity. We will also demonstrate the construction of individualized musculoskeletal models from bi-planar X-ray images and medical examinations.

cs.GR↗

arXiv2020

Carpe Diem, Seize the Samples Uncertain "At the Moment" for Adaptive Batch Selection

The accuracy of deep neural networks is significantly affected by how well mini-batches are constructed during the training step. In this paper, we propose a novel adaptive batch selection algorithm called Recency Bias that exploits the uncertain samples predicted inconsistently in recent iterations. The historical label predictions of each training sample are used to evaluate its predictive uncertainty within a sliding window. Then, the sampling probability for the next mini-batch is assigned to each training sample in proportion to its predictive uncertainty. By taking advantage of this design, Recency Bias not only accelerates the training step but also achieves a more accurate network. We demonstrate the superiority of Recency Bias by extensive evaluation on two independent tasks. Compared with existing batch selection methods, the results showed that Recency Bias reduced the test error by up to 20.97% in a fixed wall-clock training time. At the same time, it improved the training time by up to 59.32% to reach the same test error

cs.LG↗

arXiv2020

Investigating U-Nets with various Intermediate Blocks for Spectrogram-based Singing Voice Separation

Singing Voice Separation (SVS) tries to separate singing voice from a given mixed musical signal. Recently, many U-Net-based models have been proposed for the SVS task, but there were no existing works that evaluate and compare various types of intermediate blocks that can be used in the U-Net architecture. In this paper, we introduce a variety of intermediate spectrogram transformation blocks. We implement U-nets based on these blocks and train them on complex-valued spectrograms to consider both magnitude and phase. These networks are then compared on the SDR metric. When using a particular block composed of convolutional and fully-connected layers, it achieves state-of-the-art SDR on the MUSDB singing voice separation task by a large margin of 0.9 dB. Our code and models are available online.

eess.AS↗

arXiv2020

How does Early Stopping Help Generalization against Label Noise?

Noisy labels are very common in real-world training data, which lead to poor generalization on test data because of overfitting to the noisy labels. In this paper, we claim that such overfitting can be avoided by "early stopping" training a deep neural network before the noisy labels are severely memorized. Then, we resume training the early stopped network using a "maximal safe set," which maintains a collection of almost certainly true-labeled samples at each epoch since the early stop point. Putting them all together, our novel two-phase training method, called Prestopping, realizes noise-free training under any type of label noise for practical use. Extensive experiments using four image benchmark data sets verify that our method significantly outperforms four state-of-the-art methods in test error by 0.4-8.2 percent points under existence of real-world noise.

cs.LG↗

arXiv2020

Time-resolved resonant elastic soft X-ray scattering at Pohang Accelerator Laboratory X-ray Free Electron Laser

Resonant elastic X-ray scattering has been widely employed for exploring complex electronic ordering phenomena, like charge, spin, and orbital order, in particular in strongly correlated electronic systems. In addition, recent developments of pump-probe X-ray scattering allow us to expand the investigation of the temporal dynamics of such orders. Here, we introduce a new time-resolved Resonant Soft X-ray Scattering (tr-RSXS) endstation developed at the Pohang Accelerator Laboratory X-ray Free Electron Laser (PAL-XFEL). This endstation has an optical laser (wavelength of 800 nm plus harmonics) as the pump source. Based on the commissioning results, the tr-RSXS at PAL-XFEL can deliver a soft X-ray probe (400-1300 eV) with a time resolution about ~100 fs without jitter correction. As an example, the temporal dynamics of a charge density wave on a high-temperature cuprate superconductor is demonstrated.

physics.ins-det↗

arXiv2020

Design and experimental demonstration of impedance-matched circular polarization selective surfaces with spin-selective phase modulations

This paper presents the design and experimental demonstration of an impedance-matched circular polarization selective surface which also offers spin-selective phase modulations at microwave frequencies. We achieve this by leveraging the theory of Pancharatnam-Berry phase and cascading four tensor impedance layers, each comprising an array of crossed meander lines. These meander lines are precisely tuned and rotated to implement particular tensor surface impedance values to satisfy the impedance-matching condition for the transmitted right-handed circularly-polarized field while inducing Pancharatnam-Berry phase shift for the reflected left-handed circularly-polarized field. We present a detailed numerical synthesis technique to obtain the required impedance values for satisfying the impedance matching condition, and demonstrate spin-selective phase modulations based on Pancharatnam-Berry phase shifts. To verify the proposed idea, we experimentally demonstrate nearly-reflectionless transmission of right-handed circular polarization at broadside and reflection of left-handed circular polarization at 30 degrees off broadside at 12 GHz. For this purpose, a free-space quasi-optical set up and a near-field measurement system are respectively employed for measuring the transmitted and reflected circularly-polarized fields.

physics.app-ph↗

arXiv2016

Training IBM Watson using Automatically Generated Question-Answer Pairs

IBM Watson is a cognitive computing system capable of question answering in natural languages. It is believed that IBM Watson can understand large corpora and answer relevant questions more effectively than any other question-answering system currently available. To unleash the full power of Watson, however, we need to train its instance with a large number of well-prepared question-answer pairs. Obviously, manually generating such pairs in a large quantity is prohibitively time consuming and significantly limits the efficiency of Watson's training. Recently, a large-scale dataset of over 30 million question-answer pairs was reported. Under the assumption that using such an automatically generated dataset could relieve the burden of manual question-answer generation, we tried to use this dataset to train an instance of Watson and checked the training efficiency and accuracy. According to our experiments, using this auto-generated dataset was effective for training Watson, complementing manually crafted question-answer pairs. To the best of the authors' knowledge, this work is the first attempt to use a large-scale dataset of automatically generated question-answer pairs for training IBM Watson. We anticipate that the insights and lessons obtained from our experiments will be useful for researchers who want to expedite Watson training leveraged by automatically generated question-answer pairs.

cs.CL↗

arXiv2015

Two Polarization Entangled Sources from the Same Semiconductor Chip

Generating nonclassical states of photons such as polarization entangled states on a monolithic chip is a crucial step towards practical applications of optical quantum information processing such as quantum computing and quantum key distribution. Here we demonstrate two polarization entangled photon sources in a single monolithic semiconductor waveguide. The first source is achieved through the concurrent utilization of two spontaneous parametric down-conversion (SPDC) processes, namely type-0 and type-I SPDC processes. The chip can also generate polarization entangled photons via the type-II SPDC process, enabling the generation of both co-polarized and cross-polarized entangled photons in the same device. In both cases, polarization entanglement is generated directly on the chip without the use of any off-chip compensation, interferometry or bandpass filtering. This enables direct, chip-based generation of both Bell states $(|H,H\rangle+|V,V\rangle)/\sqrt{2}$ and $(|H,V\rangle+|V,H\rangle)/\sqrt{2}$ simultaneously utilizing the same pump source. In addition, based on compound semiconductors, this chip can be directly integrated with it own pump laser. This technique ushers an era of self-contained, integrated, electrically pumped, room-temperature polarization entangled photon sources.

quant-ph↗