arXiv subjects

Taekyung Kim

Publications and source records attributed to Taekyung Kim.

71 records · Page 4Linked to original sources

arXiv2020

Learning to Align Multi-Camera Domains using Part-Aware Clustering for Unsupervised Video Person Re-Identification

Most video person re-identification (re-ID) methods are mainly based on supervised learning, which requires cross-camera ID labeling. Since the cost of labeling increases dramatically as the number of cameras increases, it is difficult to apply the re-identification algorithm to a large camera network. In this paper, we address the scalability issue by presenting deep representation learning without ID information across multiple cameras. Technically, we train neural networks to generate both ID-discriminative and camera-invariant features. To achieve the ID discrimination ability of the embedding features, we maximize feature distances between different person IDs within a camera by using a metric learning approach. At the same time, considering each camera as a different domain, we apply adversarial learning across multiple camera domains for generating camera-invariant features. We also propose a part-aware adaptation module, which effectively performs multi-camera domain invariant feature learning in different spatial regions. We carry out comprehensive experiments on three public re-ID datasets (i.e., PRID-2011, iLIDS-VID, and MARS). Our method outperforms state-of-the-art methods by a large margin of about 20\% in terms of rank-1 accuracy on the large-scale MARS dataset.

cs.CV↗

arXiv2020

Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification

Visible-infrared person re-identification (VI-ReID) is an important task in night-time surveillance applications, since visible cameras are difficult to capture valid appearance information under poor illumination conditions. Compared to traditional person re-identification that handles only the intra-modality discrepancy, VI-ReID suffers from additional cross-modality discrepancy caused by different types of imaging systems. To reduce both intra- and cross-modality discrepancies, we propose a Hierarchical Cross-Modality Disentanglement (Hi-CMD) method, which automatically disentangles ID-discriminative factors and ID-excluded factors from visible-thermal images. We only use ID-discriminative factors for robust cross-modality matching without ID-excluded factors such as pose or illumination. To implement our approach, we introduce an ID-preserving person image generation network and a hierarchical feature learning module. Our generation network learns the disentangled representation by generating a new cross-modality image with different poses and illuminations while preserving a person's identity. At the same time, the feature learning module enables our model to explicitly extract the common ID-discriminative characteristic between visible-infrared images. Extensive experimental results demonstrate that our method outperforms the state-of-the-art methods on two VI-ReID datasets. The source code is available at: https://github.com/bismex/HiCMD.

cs.CV↗

arXiv2019

RPM-Net: Robust Pixel-Level Matching Networks for Self-Supervised Video Object Segmentation

In this paper, we introduce a self-supervised approach for video object segmentation without human labeled data.Specifically, we present Robust Pixel-level Matching Net-works (RPM-Net), a novel deep architecture that matches pixels between adjacent frames, using only color information from unlabeled videos for training. Technically, RPM-Net can be separated in two main modules. The embed-ding module first projects input images into high dimensional embedding space. Then the matching module with deformable convolution layers matches pixels between reference and target frames based on the embedding features.Unlike previous methods using deformable convolution, our matching module adopts deformable convolution to focus on similar features in spatio-temporally neighboring pixels.Our experiments show that the selective feature sampling improves the robustness to challenging problems in video object segmentation such as camera shake, fast motion, deformation, and occlusion. Also, we carry out comprehensive experiments on three public datasets (i.e., DAVIS-2017,SegTrack-v2, and Youtube-Objects) and achieve state-of-the-art performance on self-supervised video object seg-mentation. Moreover, we significantly reduce the performance gap between self-supervised and fully-supervised video object segmentation (41.0% vs. 52.5% on DAVIS-2017 validation set)

cs.CV↗

arXiv2019

CNN-based Semantic Segmentation using Level Set Loss

Thesedays, Convolutional Neural Networks are widely used in semantic segmentation. However, since CNN-based segmentation networks produce low-resolution outputs with rich semantic information, it is inevitable that spatial details (e.g., small bjects and fine boundary information) of segmentation results will be lost. To address this problem, motivated by a variational approach to image segmentation (i.e., level set theory), we propose a novel loss function called the level set loss which is designed to refine spatial details of segmentation results. To deal with multiple classes in an image, we first decompose the ground truth into binary images. Note that each binary image consists of background and regions belonging to a class. Then we convert level set functions into class probability maps and calculate the energy for each class. The network is trained to minimize the weighted sum of the level set loss and the cross-entropy loss. The proposed level set loss improves the spatial details of segmentation results in a time and memory efficient way. Furthermore, our experimental results show that the proposed loss function achieves better performance than previous approaches.

cs.CV↗

arXiv2019

Self-Ensembling with GAN-based Data Augmentation for Domain Adaptation in Semantic Segmentation

Deep learning-based semantic segmentation methods have an intrinsic limitation that training a model requires a large amount of data with pixel-level annotations. To address this challenging issue, many researchers give attention to unsupervised domain adaptation for semantic segmentation. Unsupervised domain adaptation seeks to adapt the model trained on the source domain to the target domain. In this paper, we introduce a self-ensembling technique, one of the successful methods for domain adaptation in classification. However, applying self-ensembling to semantic segmentation is very difficult because heavily-tuned manual data augmentation used in self-ensembling is not useful to reduce the large domain gap in the semantic segmentation. To overcome this limitation, we propose a novel framework consisting of two components, which are complementary to each other. First, we present a data augmentation method based on Generative Adversarial Networks (GANs), which is computationally efficient and effective to facilitate domain alignment. Given those augmented images, we apply self-ensembling to enhance the performance of the segmentation network on the target domain. The proposed method outperforms state-of-the-art semantic segmentation methods on unsupervised domain adaptation benchmarks.

cs.CV↗

arXiv2019

Self-Training and Adversarial Background Regularization for Unsupervised Domain Adaptive One-Stage Object Detection

Deep learning-based object detectors have shown remarkable improvements. However, supervised learning-based methods perform poorly when the train data and the test data have different distributions. To address the issue, domain adaptation transfers knowledge from the label-sufficient domain (source domain) to the label-scarce domain (target domain). Self-training is one of the powerful ways to achieve domain adaptation since it helps class-wise domain adaptation. Unfortunately, a naive approach that utilizes pseudo-labels as ground-truth degenerates the performance due to incorrect pseudo-labels. In this paper, we introduce a weak self-training (WST) method and adversarial background score regularization (BSR) for domain adaptive one-stage object detection. WST diminishes the adverse effects of inaccurate pseudo-labels to stabilize the learning procedure. BSR helps the network extract discriminative features for target backgrounds to reduce the domain shift. Two components are complementary to each other as BSR enhances discrimination between foregrounds and backgrounds, whereas WST strengthen class-wise discrimination. Experimental results show that our approach effectively improves the performance of the one-stage object detection in unsupervised domain adaptation setting.

cs.CV↗

arXiv2019

Pseudo-Labeling Curriculum for Unsupervised Domain Adaptation

To learn target discriminative representations, using pseudo-labels is a simple yet effective approach for unsupervised domain adaptation. However, the existence of false pseudo-labels, which may have a detrimental influence on learning target representations, remains a major challenge. To overcome this issue, we propose a pseudo-labeling curriculum based on a density-based clustering algorithm. Since samples with high density values are more likely to have correct pseudo-labels, we leverage these subsets to train our target network at the early stage, and utilize data subsets with low density values at the later stage. We can progressively improve the capability of our network to generate pseudo-labels, and thus these target samples with pseudo-labels are effective for training our model. Moreover, we present a clustering constraint to enhance the discriminative power of the learned target features. Our approach achieves state-of-the-art performance on three benchmarks: Office-31, imageCLEF-DA, and Office-Home.

cs.CV↗

arXiv2019

Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detection

We introduce a novel unsupervised domain adaptation approach for object detection. We aim to alleviate the imperfect translation problem of pixel-level adaptations, and the source-biased discriminativity problem of feature-level adaptations simultaneously. Our approach is composed of two stages, i.e., Domain Diversification (DD) and Multi-domain-invariant Representation Learning (MRL). At the DD stage, we diversify the distribution of the labeled data by generating various distinctive shifted domains from the source domain. At the MRL stage, we apply adversarial learning with a multi-domain discriminator to encourage feature to be indistinguishable among the domains. DD addresses the source-biased discriminativity, while MRL mitigates the imperfect image translation. We construct a structured domain adaptation framework for our learning paradigm and introduce a practical way of DD for implementation. Our method outperforms the state-of-the-art methods by a large margin of 3%~11% in terms of mean average precision (mAP) on various datasets.

cs.CV↗

arXiv2018

The action of the Hecke operators on the component groups of modular Jacobian varieties

For a prime number $q\geq 5$ and a positive integer $N$ prime to $q$, Ribet proved the action of the Hecke algebra on the component group of the Jacobian variety of the modular curve of level $Nq$ at $q$ is "Eisenstein", which means the Hecke operator $T_\ell$ acts by $\ell+1$ when $\ell$ is a prime number not dividing the level. In this paper, we completely compute the action of the Hecke algebra on this component group by a careful study of supersingular points with extra automorphisms.

math.NT↗

arXiv2015

On a conjecture of Gross and Zagier

Gross and Zagier conjectured that if the analytic rank of a rational elliptic curve is 1, then the order of the rational torsion subgroup of the elliptic curve divides the product of Tamagawa number, Manin constant, and the square root of the order of Tate--Shafarevich group over an imaginary quadratic field. In this paper, we show that this conjecture is true.

math.NT↗

arXiv2010

Constraints on Flows in Horava-Lifshitz Gravity by Classical Solutions

We find exact static stringy solutions of Horava-Lifshitz gravity with the projectability condition but imposing the detailed balance condition near the UV fixed point, and propose a method on constraining the possible pattern of flows in Horava-Lifshitz gravity by using the obtained classical solutions. In the obtained vacuum solutions, the parameters related to the speed of the graviton and the coefficients of quartic spatial derivative terms lead to intriguing effects: the change of graviton speed yields a surplus angle and the quartic derivatives make the square of effective electric charge negative. The result of a few tests based on the geometries of a cone, an excess cone, a black string, and a charged (black) string seems suggestive. For example, the flow of constant graviton speed and variable Newton's coupling can be favored in the vicinity of IR fixed point, but the conclusion is indistinct and far from definite yet. Together with the numerous classical solutions, static or time-dependent, which have already been found, the accumulated data from various future tests will give some hints in constraining the flow patterns more deterministic.

hep-th↗

arXiv2010

Electrical transport in small bundles of single-walled carbon nanotubes: intertube interaction and effects of tube deformation

We report a combined electronic transport and structural characterization study of small carbon nanotube bundles in field-effect transistors (FET). The atomic structures of the bundles are determined by electron diffraction using an observation window built in the FET. The single-walled nanotube bundles exhibit electrical transport characteristics sensitively dependent on the structure of individual tubes, their arrangements in the bundle, deformation due to intertube interaction, and the orientation with respect to the gate electric field. Our ab-initio simulation shows that tube deformation in the bundle induces a bandgap opening in a metallic tube. These results show the importance of intertube interaction in electrical transport of bundled nanotubes.

cond-mat.mes-hall↗

arXiv2010

Solutions in IR modified Horava-Lifshitz Gravity

In order to allow the asymptotically flat, we consider Hořava-Lifshitz gravity theory with a soft violation of the detailed balance condition and obtain various solutions. In particular, we find that such theory coupled to a global monopole leads to a solution representing a space with deficit solid angle, which is well matched with genuine feature of GR.

hep-th↗

arXiv2009

Surplus Solid Angle as an Imprint of Horava-Lifshitz Gravity

We consider the electrostatic field of a point charge coupled to Horava-Lifshitz gravity and find an exact solution describing the space with a surplus (or deficit) solid angle. Although, theoretically in general relativity, a surplus angle is hardly to be obtained in the presence of ordinary matter with positive energy distribution, it seems natural in Horava-Lifshitz gravity. We present the sudden disappearance and reappearance of a star image as an astrophysical effect of a surplus angle. We also consider matter configurations of all possible power law behaviors coupled to Horava-Lifshitz gravity and obtain a series of exact solutions.

hep-th↗

arXiv2008

Multi-BPS D-vortices

We investigate the BPS configuration of the multi D-vortices produced from the D2${\bar {\rm D}}$2 system. Based on the DBI-type action with a Gaussian-type runaway potential for a complex tachyon field, the BPS limit is achieved when the tachyon profile is thin. The solution states randomly-distributed $n$ static D-vortices with zero interaction. With the obtained BPS configuration, we derive the relativistic Lagrangian which describes the dynamics of free massive D-vortices. We also discuss the 90${}^{\circ}$ and 180${}^{\circ}$ scattering of two identical D-vortices, and present its implications on the reconnection in the dynamics of cosmic superstrings.

hep-th↗

arXiv2008

Relativistic Dynamics of Multi-BPS D-vortices and Straight BPS D-strings

Moduli space dynamics of multi-D-vortices from D2${\bar {\rm D}}$ (equivalently, parallel straight D-strings from D3${\bar {\rm D}}$3) is systematically studied. For the BPS D-vortices, we show through exact calculations that the classical motion of randomly-distributed $n$ D-vortices is governed by a relativistic Lagrangian of free massive point-particles. When the head-on collision of two identical BPS D-vortices of zero radius is considered, it predicts either 90${}^{\circ}$ scattering or 0${}^{\circ}$ scattering equivalent to 180${}^{\circ}$ scattering. Since the former leads to a reconnection of two identical D-strings and the latter does to a case of their passing through each other, two possibilities are consistent with the prediction of string theory. It is also shown that the force between two non-BPS vortices is repulsive. Although the obtained moduli space dynamics of multi-BPS-D-vortices is exact in classical regime, the quantum effect of an F-string pair production should be included in determining the probabilities of the reconnection and the passing through for fast-moving cosmic superstrings.

hep-th↗

arXiv2007

Cosmic D- and DF-strings from D3Dbar3: Black Strings and BPS Limit

We study D- and DF-strings in a D3${\bar {\rm D}}3$ system by using Dirac-Born-Infeld type action. In the presence of an electric flux from the transverse direction, we discuss gravitating thick D-string solutions of a spatial manifold, ${\rm S}^{2}\times {\rm R}^{1}$, in which straight D-strings stretched along the R${}^{1}$ direction are attached to the south and north poles of the two-sphere. There is a horizon along its equator, which means the structure of black strings is formed. We also discuss the BPS limit for thin parallel D- and DF-strings in both flat and curved spacetime. We obtain the BPS sum rule for an arbitrarily-separated multi-string configuration with a Gaussian type tachyon potential. At the site of each thin BPS D(F)-string, the pressure takes a finite value. We find that there exists a maximum deficit angle $π$ in the conical geometry induced by thin BPS D- and DF-strings.

hep-th↗