arXiv subjects

Mocho Go

Publications and source records attributed to Mocho Go.

4 recordsLinked to original sources

arXiv2022

gSwin: Gated MLP Vision Model with Hierarchical Structure of Shifted Window

Following the success in language domain, the self-attention mechanism (transformer) is adopted in the vision domain and achieving great success recently. Additionally, as another stream, multi-layer perceptron (MLP) is also explored in the vision domain. These architectures, other than traditional CNNs, have been attracting attention recently, and many methods have been proposed. As one that combines parameter efficiency and performance with locality and hierarchy in image recognition, we propose gSwin, which merges the two streams; Swin Transformer and (multi-head) gMLP. We showed that our gSwin can achieve better accuracy on three vision tasks, image classification, object detection and semantic segmentation, than Swin Transformer, with smaller model size.

cs.CV↗

arXiv2021

Quasi-Taylor Samplers for Diffusion Generative Models based on Ideal Derivatives

Diffusion generative models have emerged as a new challenger to popular deep neural generative models such as GANs, but have the drawback that they often require a huge number of neural function evaluations (NFEs) during synthesis unless some sophisticated sampling strategies are employed. This paper proposes new efficient samplers based on the numerical schemes derived by the familiar Taylor expansion, which directly solves the ODE/SDE of interest. In general, it is not easy to compute the derivatives that are required in higher-order Taylor schemes, but in the case of diffusion models, this difficulty is alleviated by the trick that the authors call ``ideal derivative substitution,'' in which the higher-order derivatives are replaced by tractable ones. To derive ideal derivatives, the authors argue the ``single point approximation,'' in which the true score function is approximated by a conditional one, holds in many cases, and considered the derivatives of this approximation. Applying thus obtained new quasi-Taylor samplers to image generation tasks, the authors experimentally confirmed that the proposed samplers could synthesize plausible images in small number of NFEs, and that the performance was better or at the same level as DDIM and Runge-Kutta methods. The paper also argues the relevance of the proposed samplers to the existing ones mentioned above.

stat.ML↗

arXiv2020

An Automated Generation of Bootstrap Equations for Numerical Study of Critical Phenomena

In this thesis, we introduce new tools for the conformal bootstrap, autoboot and qboot. Each tool solves a different step in the whole computational stack, and combined with an existing efficient tool SDPB which solves semidefinite programming (SDP), our tools make it easier to study conformal field theories with more complicated global symmetries and with more general spectra. In the introduction, we review how the conformal bootstrap method gives rich information about the theory at the fixed point of renormalization group, or in other words, the critical phenomena such as the Ising model at criticality. The following three sections focus on the theories behind the implementation of autoboot and qboot, and the explicit implementation, freely available at https://github.com/selpoG/autoboot/ and https://github.com/selpoG/qboot/, is discussed in section 5. We also have two applications in the last section, the Ising model and the O(2) vector model in three dimensions, each of them has close relationship with a physical system in the real world.

hep-th↗

arXiv2019

autoboot: A generator of bootstrap equations with global symmetry

We introduce autoboot, a Mathematica program which automatically generates mixed-correlator bootstrap equations of an arbitrary number of scalar external operators, given the global symmetry group and the representations of the operators. The output is a Python program which uses Ohtsuki's cboot which in turn uses Simmons-Duffin's sdpb. In an appendix we also discuss a simple technique to significantly reduce the time to run sdpb, which we call hot-starting.

hep-th↗