arXiv ScienceSearch

arXiv subjects

Ildoo Kim

Publications and source records attributed to Ildoo Kim.

At least 19 recordsLinked to original sources

Well-Posedness for Cauchy Problems with Singular Time-Measurable Pseudo-Differential Operators in Quasi-decreasing Weighted $\mathrm{L}_2$-Spaces

This study examines Cauchy problems governed by highly singular, time-measurable pseudo-differential operators (singular measurable families of Fourier multipliers). We show that the symbols of these operators can exhibit arbitrary blow-up behavior. In particular, we prove the existence and uniqueness of solutions even when the symbols grow super-exponentially in time and frequency. As a concrete application, we solve evolutionary equations driven by fractional Laplacians of any negative order. Additionally, we establish unique strong solutions under the sole condition that the symbol is locally integrable in frequency, even in the presence of severe blow-up at the initial time.

math.AP

Size distribution of decaying foam bubbles

The most studies on the stability of foam bubbles investigated the mechanical stability of thin films between bubbles due to the drainage by gravity. In the current work, we take an alternative approach by assuming the rupture of bubbles as a series of random events and by investigating the time evolution of the size distribution of foam bubbles over a long time up to several hours. For this purpose, we first prepared layers of bubbles on Petri dishes by shaking soap solutions of a few different concentrations, and then we monitored the Petri dishes by using a time-lapse video imaging technique. We analyzed the captured images by custom software to count the bubble size distribution with respect to the initial concentration and elapsed time. From the statistics on our data, we find that the total bubble volume decreases exponentially in time, and the exponent, i.e. the mean lifetime, is a function of the bubble size. The mean lifetimes of larger bubbles are observed to be shorter than those of smaller bubbles, by approximately a factor of 2.

physics.flu-dyn

An existence and uniqueness theory to stochastic partial differential equations involving pseudo-differential operators driven by space-time white noise

In this paper, we aim to develop a new weak formulation that ensures well-posedness for a broad range of stochastic partial differential equations with pseudo-differential operators whose symbols depend only on time and spatial frequencies. The main focus of this paper is to relax the conditions on the symbols of pseudo-differential operators and data while still ensuring that the stochastic partial differential equations remain well-posed in a weak sense. Specifically, we allow symbols to be random and remove all regularity and ellipticity conditions on them. As a result, our main operators include many interesting rough operators that cannot generate any regularity gain or integrability improvement from the equations. In addition, our data do not need to be regular or possess finite stochastic moments.

math.PR

An existence and uniqueness result to evolution equations with sign-changing pseudo-differential operators and its applications to logarithmic Laplacian operators and second-order differential operators without ellipticity

We broaden the domain of the Fourier transform to contain all distributions without using the Paley-Wiener theorem and devise a new weak formulation built upon this extension. This formulation is applicable to evolution equations involving pseudo-differential operators, even when the signs of their symbols may vary over time. Notably, our main operator includes the logarithmic Laplacian operator $\log (-\Delta)$ and a second-order differential operator whose leading coefficients are not positive semi-definite.

math.AP

The effect of menisci on vortex streets on soap film flows

In soap film experiments, the insertion of an external object is necessary to produce vorticity. However, this insertion causes local thickness changes, or simply {\it meniscus}, near the object. Because the meniscus formation may alter the flow near the object, the characterization of meniscus is of considerable importance for the accurate interpretation of data. In this study, we insert cylindrical cones made of aluminum, titanium, and glass to measure the size of the menisci by using a long-range microscope. In all material tested, we find that the size of meniscus is less than 0.2 mm, much shorter than the capillary length. In addition, by comparing the formation of vortex streets behind objects of different materials, we conclude that the meniscus acts as an added length to the size of the object itself. This added length effect can be non-negligible if the size of object is comparable to the size of meniscus.

physics.flu-dyn

A regularity theory for an initial value problem with a time-measurable pseudo-differential operator in a weighted $L_p$-space

In this study, we investigate the existence, uniqueness, and maximal regularity estimates of solutions to homogeneous initial value problems involving time-measurable pseudo-differential operators within the framework of weighted mixed norm Lebesgue spaces. The class of temporal weights in our regularity estimates contains Muckenhoupt's class, and the initial data is in weighted Besov spaces with variable order.

math.AP

A weighted $L_q(L_p)$-theory for fully degenerate second-order evolution equations with unbounded time-measurable coefficients

We study the fully degenerate second-order evolution equation $u_t=a^{ij}(t)u_{x^ix^j} +b^i(t) u_{x^i} + c(t)u+f, \quad t>0, x\in \mathbb{R}^d$ given with the zero initial data. Here $a^{ij}(t)$, $b^i(t)$, $c(t)$ are merely locally integrable functions, and $(a^{ij}(t))_{d \times d}$ is a nonnegative symmetric matrix with the smallest eigenvalue $\delta(t)\geq 0$. We show that there is a positive constant $N$ such that $\int_0^{T} \left(\int_{\mathbb{R}^d} \left(|u|+|u_{xx} |\right)^{p} dx \right)^{q/p} e^{-q\int_0^t c(s)ds} w(\alpha(t)) \delta(t) dt \leq N \int_0^{T} \left(\int_{\mathbb{R}^d} \left|f\left(t,x\right)\right|^{p} dx \right)^{q/p} e^{-q\int_0^t c(s)ds} w(\alpha(t)) (\delta(t))^{1-q} dt,$ where $p,q \in (1,\infty)$, $\alpha(t)=\int_0^t \delta(s)ds$, and $w$ is a Muckenhoupt's weight.

math.AP

A weighted $L_p$-regularity theory for parabolic partial differential equations with time measurable pseudo-differential operators

We obtain the existence, uniqueness, and regularity estimates of the following Cauchy problem \begin{equation}\label{ab eqn} \begin{cases} \partial_t u(t,x)=\psi(t,-i\nabla)u(t,x)+f(t,x),\quad &(t,x)\in(0,T)\times\mathbb{R}^d,\\ u(0,x)=0,\quad & x\in\mathbb{R}^d \end{cases} \end{equation} in (Muckenhoupt) weighted $L_p$-spaces with time-measurable pseudo-differential operators \begin{equation} \label{ab op} \psi(t,-i\nabla)u(t,x):=\mathcal{F}^{-1}\left[\psi(t,\cdot)\mathcal{F}[u](t,\cdot)\right](x). \end{equation} More precisely, we find sufficient conditions of the symbol $\psi(t,\xi)$ (especially depending on the smoothness of the symbol with respect to $\xi$) to guarantee that equation is well-posed in (Muckenhoupt) weighted $L_p$-spaces. Here the symbol $\psi(t,\xi)$ is merely measurable with respect to $t$, and the sufficient smoothness of $\psi(t,\xi)$ with respect to $\xi$ is characterized by a property of each weight. In particular, we prove the existence of a positive constant $N$ such that for any solution $u$ to the equation, \begin{equation} \label{ab est} \int_0^T \int_{\mathbb{R}^d} |(-\Delta)^{\gamma/2} u(t,x) |^p (t^2 + |x|^2)^{\alpha/2} \mathrm{d}x\mathrm{d}t \leq N\int_0^T \int_{\mathbb{R}^d} |f(t,x)|^p (t^2 + |x|^2)^{\alpha/2} \mathrm{d}x\mathrm{d}t \end{equation} and \begin{equation} \label{ab est 2} \int_0^T \left(\int_{\mathbb{R}^d} |(-\Delta)^{\gamma/2} u(t,x) |^p |x|^{\alpha_2} \mathrm{d}x \right)^{q/p} t^{\alpha_1}\mathrm{d}t \leq N\int_0^T \left(\int_{\mathbb{R}^d} |f(t,x) |^p |x|^{\alpha_2} \mathrm{d}x \right)^{q/p} t^{\alpha_1}\mathrm{d}t, \end{equation} where $p,q\in(1,\infty)$, $-d-1<\alpha < (d+1)(p-1)$, $-1 < \alpha_1 < q-1$, $-d <\alpha_2< d(p-1)$, and $\gamma$ is the order of the operator $\psi(t,-i\nabla)$.

math.AP

Contrastive Regularization for Semi-Supervised Learning

Consistency regularization on label predictions becomes a fundamental technique in semi-supervised learning, but it still requires a large number of training iterations for high performance. In this study, we analyze that the consistency regularization restricts the propagation of labeling information due to the exclusion of samples with unconfident pseudo-labels in the model updates. Then, we propose contrastive regularization to improve both efficiency and accuracy of the consistency regularization by well-clustered features of unlabeled data. In specific, after strongly augmented samples are assigned to clusters by their pseudo-labels, our contrastive regularization updates the model so that the features with confident pseudo-labels aggregate the features in the same cluster, while pushing away features in different clusters. As a result, the information of confident pseudo-labels can be effectively propagated into more unlabeled samples during training by the well-clustered features. On benchmarks of semi-supervised learning tasks, our contrastive regularization improves the previous consistency-based methods and achieves state-of-the-art results, especially with fewer training iterations. Our method also shows robust performance on open-set semi-supervised learning where unlabeled data includes out-of-distribution samples.

cs.LG

The Medical Segmentation Decathlon

International challenges have become the de facto standard for comparative assessment of image analysis algorithms given a specific task. Segmentation is so far the most widely investigated medical image processing task, but the various segmentation challenges have typically been organized in isolation, such that algorithm development was driven by the need to tackle a single specific clinical problem. We hypothesized that a method capable of performing well on multiple tasks will generalize well to a previously unseen task and potentially outperform a custom-designed solution. To investigate the hypothesis, we organized the Medical Segmentation Decathlon (MSD) - a biomedical image analysis challenge, in which algorithms compete in a multitude of both tasks and modalities. The underlying data set was designed to explore the axis of difficulties typically encountered when dealing with medical images, such as small data sets, unbalanced labels, multi-site data and small objects. The MSD challenge confirmed that algorithms with a consistent good performance on a set of tasks preserved their good average performance on a different set of previously unseen tasks. Moreover, by monitoring the MSD winner for two years, we found that this algorithm continued generalizing well to a wide range of other clinical problems, further confirming our hypothesis. Three main conclusions can be drawn from this study: (1) state-of-the-art image segmentation algorithms are mature, accurate, and generalize well when retrained on unseen tasks; (2) consistent algorithmic performance across multiple tasks is a strong surrogate of algorithmic generalizability; (3) the training of accurate AI segmentation models is now commoditized to non AI experts.

eess.IV

Spatially Consistent Representation Learning

Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While these contrastive methods mainly focus on generating invariant global representations at the image-level under semantic-preserving transformations, they are prone to overlook spatial consistency of local representations and therefore have a limitation in pretraining for localization tasks such as object detection and instance segmentation. Moreover, aggressively cropped views used in existing contrastive methods can minimize representation distances between the semantically different regions of a single image. In this paper, we propose a spatially consistent representation learning algorithm (SCRL) for multi-object and location-specific tasks. In particular, we devise a novel self-supervised objective that tries to produce coherent spatial representations of a randomly cropped local region according to geometric translations and zooming operations. On various downstream localization tasks with benchmark datasets, the proposed SCRL shows significant performance improvements over the image-level supervised pretraining as well as the state-of-the-art self-supervised learning methods. Code is available at https://github.com/kakaobrain/scrl

cs.CV

ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision

Vision-and-Language Pre-training (VLP) has improved performance on various joint vision-and-language downstream tasks. Current approaches to VLP heavily rely on image feature extraction processes, most of which involve region supervision (e.g., object detection) and the convolutional architecture (e.g., ResNet). Although disregarded in the literature, we find it problematic in terms of both (1) efficiency/speed, that simply extracting input features requires much more computation than the multimodal interaction steps; and (2) expressive power, as it is upper bounded to the expressive power of the visual embedder and its predefined visual vocabulary. In this paper, we present a minimal VLP model, Vision-and-Language Transformer (ViLT), monolithic in the sense that the processing of visual inputs is drastically simplified to just the same convolution-free manner that we process textual inputs. We show that ViLT is up to tens of times faster than previous VLP models, yet with competitive or better downstream task performance. Our code and pre-trained weights are available at https://github.com/dandelin/vilt.

stat.ML

An $L_p$-maximal regularity estimate of moments of solutions to second-order stochastic partial differential equations

We obtain uniqueness and existence of a solution $u$ to the following second-order stochastic partial differential equation (SPDE) : \begin{align} \label{abs eqn} du= \left( \bar a^{ij}(\omega,t)u_{x^ix^j}+ f \right)dt + g^k dw^k_t, \quad t \in (0,T); \quad u(0,\cdot)=0, \end{align} where $T \in (0,\infty)$, $w^k$ $(k=1,2,\ldots)$ are independent Wiener processes, $(\bar a^{ij}(\omega,t))$ is a (predictable) nonnegative symmetric matrix valued stochastic process such that $$ \kappa |\xi|^2 \leq \bar a^{ij}(\omega,t) \xi^i \xi^j \leq K |\xi|^2 \qquad \forall (\omega,t,\xi) \in \Omega \times (0,T) \times {\mathbf{R}}^d $$ for some $\kappa, K \in (0,\infty)$, $$ f \in L_p\left( (0,T) \times {\mathbf{R}}^d, dt \times dx ; L_r(\Omega, {\mathscr{F}} ,dP) \right), $$ and $$ g, g_x \in L_p\left( (0,T) \times {\mathbf{R}}^d, dt \times dx ; L_r(\Omega, {\mathscr{F}} ,dP; l_2) \right) $$ with $2 \leq r \leq p < \infty$ and appropriate measurable conditions.

math.PR

Learning Loss for Test-Time Augmentation

Data augmentation has been actively studied for robust neural networks. Most of the recent data augmentation methods focus on augmenting datasets during the training phase. At the testing phase, simple transformations are still widely used for test-time augmentation. This paper proposes a novel instance-level test-time augmentation that efficiently selects suitable transformations for a test input. Our proposed method involves an auxiliary module to predict the loss of each possible transformation given the input. Then, the transformations having lower predicted losses are applied to the input. The network obtains the results by averaging the prediction results of augmented inputs. Experimental results on several image classification benchmarks show that the proposed instance-aware test-time augmentation improves the model's robustness against various corruptions.

cs.CV

A maximal $L_p$-regularity theory to initial value problems with time measurable nonlocal operators generated by additive processes

Let $Z=(Z_t)_{t\geq0}$ be an additive process with a bounded triplet $(0,0,\Lambda_t)_{t\geq0}$. Suppose that for any Schwartz function $\varphi$ on $\mathbb{R}^d$ whose Fourier transform is in $C_c^{\infty}(B_{c_s} \setminus B_{c_s^{-1}} )$, there exist positive constants $N_0$, $N_1$, and $N_2$ such that \begin{equation*} \int_{\mathbb{R}^d}|\mathbb{E}[\varphi(x+r^{-1}Z_t)]|dx\leq N_0 e^{- \frac{N_1 t}{s(r)}},\quad \forall (r,t)\in(0,1)\times[0,T], \end{equation*} and $$ \|\psi^{\mu}(r^{-1}D)\varphi\|_{L_1(\mathbb{R}^d)}\leq \frac{N_2}{s(r)},\quad \forall r\in(0,1). $$ where $s$ is a scaling function (Definition 2.4), $c_s$ is a positive constant related to $s$, $\mu$ is a symmetric L\'evy measure on $\mathbb{R}^d$, $\psi^{\mu}(r^{-1}D)\varphi(x)= \mathcal{F}^{-1} \left[ \psi^{\mu}(r^{-1}\xi) \mathcal{F}[\varphi]\right](x)$ and $$\psi^{\mu}(\xi):=\int_{\mathbb{R}^d}(e^{iy\cdot\xi}-1-iy\cdot\xi 1_{|y|\leq 1})\mu(dy).$$ In this paper, we establish the $L_p$-solvability to the initial value problem \begin{equation} \frac{\partial u}{\partial t}(t,x)=\mathcal{A}_Z(t)u(t,x),\quad u(0,\cdot)=u_0,\quad (t,x)\in(0,T)\times\mathbb{R}^d, \end{equation} In other words, there exists a unique solution $u$ to equation satisfying $$ \|u\|_{L_q((0,T);H_p^{\mu;\gamma}(\mathbb{R}^d))}\leq N\|u_0\|_{B_{p,q}^{s;\gamma-\frac{2}{q}}(\mathbb{R}^d)}, $$ where $N$ is independent of $u$ and $u_0$, and the spaces $B_{p,q}^{s;\gamma-\frac{2}{q}}(\mathbb{R}^d)$ and $H_p^{\mu;\gamma}(\mathbb{R}^d)$ are scaled Besov spaces (see Definition 2.8) and generalized Bessel potential spaces (see Definition 2.3), respectively.

math.PR

AutoCLINT: The Winning Method in AutoCV Challenge 2019

NeurIPS 2019 AutoDL challenge is a series of six automated machine learning competitions. Particularly, AutoCV challenges mainly focused on classification tasks on visual domain. In this paper, we introduce the winning method in the competition, AutoCLINT. The proposed method implements an autonomous training strategy, including efficient code optimization, and applies an automated data augmentation to achieve the fast adaptation of pretrained networks. We implement a light version of Fast AutoAugment to search for data augmentation policies efficiently for the arbitrarily given image domains. We also empirically analyze the components of the proposed method and provide ablation studies focusing on AutoCV datasets.

cs.LG