arXiv subjects

Abhinav Gupta

Publications and source records attributed to Abhinav Gupta.

At least 199 records · Page 11Linked to original sources

arXiv2016

"What happens if..." Learning to Predict the Effect of Forces in Images

What happens if one pushes a cup sitting on a table toward the edge of the table? How about pushing a desk against a wall? In this paper, we study the problem of understanding the movements of objects as a result of applying external forces to them. For a given force vector applied to a specific location in an image, our goal is to predict long-term sequential movements caused by that force. Doing so entails reasoning about scene geometry, objects, their attributes, and the physical rules that govern the movements of objects. We design a deep neural network model that learns long-term sequential dependencies of object movements while taking into account the geometry and appearance of the scene by combining Convolutional and Recurrent Neural Networks. Training our model requires a large-scale dataset of object movements caused by external forces. To build a dataset of forces in scenes, we reconstructed all images in SUN RGB-D dataset in a physics simulator to estimate the physical movements of objects caused by external forces applied to them. Our Forces in Scenes (ForScene) dataset contains 10,335 images in which a variety of external forces are applied to different types of objects resulting in more than 65,000 object movements represented in 3D. Our experimental evaluations show that the challenging task of predicting long-term movements of objects as their reaction to external forces is possible from a single image.

cs.CV↗

arXiv2016

Unsupervised Visual Representation Learning by Context Prediction

This work explores the use of spatial context as a source of free and plentiful supervisory signal for training a rich visual representation. Given only a large, unlabeled image collection, we extract random pairs of patches from each image and train a convolutional neural net to predict the position of the second patch relative to the first. We argue that doing well on this task requires the model to learn to recognize objects and their parts. We demonstrate that the feature representation learned using this within-image context indeed captures visual similarity across images. For example, this representation allows us to perform unsupervised visual discovery of objects like cats, people, and even birds from the Pascal VOC 2011 detection dataset. Furthermore, we show that the learned ConvNet can be used in the R-CNN framework and provides a significant boost over a randomly-initialized ConvNet, resulting in state-of-the-art performance among algorithms which use only Pascal-provided training set annotations.

cs.CV↗

arXiv2015

Dense Optical Flow Prediction from a Static Image

Given a scene, what is going to move, and in what direction will it move? Such a question could be considered a non-semantic form of action prediction. In this work, we present a convolutional neural network (CNN) based approach for motion prediction. Given a static image, this CNN predicts the future motion of each and every pixel in the image in terms of optical flow. Our CNN model leverages the data in tens of thousands of realistic videos to train our model. Our method relies on absolutely no human labeling and is able to predict motion based on the context of the scene. Because our CNN model makes no assumptions about the underlying scene, it can predict future optical flow on a diverse set of scenarios. We outperform all previous approaches by large margins.

cs.CV↗

arXiv2015

Webly Supervised Learning of Convolutional Networks

We present an approach to utilize large amounts of web data for learning CNNs. Specifically inspired by curriculum learning, we present a two-step approach for CNN training. First, we use easy images to train an initial visual representation. We then use this initial CNN and adapt it to harder, more realistic images by leveraging the structure of data and categories. We demonstrate that our two-stage CNN outperforms a fine-tuned CNN trained on ImageNet on Pascal VOC 2012. We also demonstrate the strength of webly supervised learning by localizing objects in web images and training a R-CNN style detector. It achieves the best performance on VOC 2007 where no VOC training data is used. Finally, we show our approach is quite robust to noise and performs comparably even when we use image search results from March 2013 (pre-CNN image search era).

cs.CV↗

arXiv2015

Unsupervised Learning of Visual Representations using Videos

Is strong supervision necessary for learning a good visual representation? Do we really need millions of semantically-labeled images to train a Convolutional Neural Network (CNN)? In this paper, we present a simple yet surprisingly powerful approach for unsupervised learning of CNN. Specifically, we use hundreds of thousands of unlabeled videos from the web to learn visual representations. Our key idea is that visual tracking provides the supervision. That is, two patches connected by a track should have similar visual representation in deep feature space since they probably belong to the same object or object part. We design a Siamese-triplet network with a ranking loss function to train this CNN representation. Without using a single image from ImageNet, just using 100K unlabeled videos and the VOC 2012 dataset, we train an ensemble of unsupervised networks that achieves 52% mAP (no bounding box regression). This performance comes tantalizingly close to its ImageNet-supervised counterpart, an ensemble which achieves a mAP of 54.4%. We also show that our unsupervised network can perform competitively in other tasks such as surface-normal estimation.

cs.CV↗

arXiv2015

Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hours

Current learning-based robot grasping approaches exploit human-labeled datasets for training the models. However, there are two problems with such a methodology: (a) since each object can be grasped in multiple ways, manually labeling grasp locations is not a trivial task; (b) human labeling is biased by semantics. While there have been attempts to train robots using trial-and-error experiments, the amount of data used in such experiments remains substantially low and hence makes the learner prone to over-fitting. In this paper, we take the leap of increasing the available training data to 40 times more than prior work, leading to a dataset size of 50K data points collected over 700 hours of robot grasping attempts. This allows us to train a Convolutional Neural Network (CNN) for the task of predicting grasp locations without severe overfitting. In our formulation, we recast the regression problem to an 18-way binary classification over image patches. We also present a multi-stage learning approach where a CNN trained in one stage is used to collect hard negatives in subsequent stages. Our experiments clearly show the benefit of using large-scale datasets (and multi-stage training) for the task of grasping. We also compare to several baselines and show state-of-the-art performance on generalization to unseen objects for grasping.

cs.LG↗

arXiv2015

In Defense of the Direct Perception of Affordances

The field of functional recognition or affordance estimation from images has seen a revival in recent years. As originally proposed by Gibson, the affordances of a scene were directly perceived from the ambient light: in other words, functional properties like sittable were estimated directly from incoming pixels. Recent work, however, has taken a mediated approach in which affordances are derived by first estimating semantics or geometry and then reasoning about the affordances. In a tribute to Gibson, this paper explores his theory of affordances as originally proposed. We propose two approaches for direct perception of affordances and show that they obtain good results and can out-perform mediated approaches. We hope this paper can rekindle discussion around direct perception and its implications in the long term.

cs.CV↗

arXiv2015

Mid-level Elements for Object Detection

Building on the success of recent discriminative mid-level elements, we propose a surprisingly simple approach for object detection which performs comparable to the current state-of-the-art approaches on PASCAL VOC comp-3 detection challenge (no external data). Through extensive experiments and ablation analysis, we show how our approach effectively improves upon the HOG-based pipelines by adding an intermediate mid-level representation for the task of object detection. This representation is easily interpretable and allows us to visualize what our object detector "sees". We also discuss the insights our approach shares with CNN-based methods, such as sharing representation between categories helps.

cs.CV↗

arXiv2015

Transferring Rich Feature Hierarchies for Robust Visual Tracking

Convolutional neural network (CNN) models have demonstrated great success in various computer vision tasks including image classification and object detection. However, some equally important tasks such as visual tracking remain relatively unexplored. We believe that a major hurdle that hinders the application of CNN to visual tracking is the lack of properly labeled training data. While existing applications that liberate the power of CNN often need an enormous amount of training data in the order of millions, visual tracking applications typically have only one labeled example in the first frame of each video. We address this research issue here by pre-training a CNN offline and then transferring the rich feature hierarchies learned to online tracking. The CNN is also fine-tuned during online tracking to adapt to the appearance of the tracked target specified in the first video frame. To fit the characteristics of object tracking, we first pre-train the CNN to recognize what is an object, and then propose to generate a probability map instead of producing a simple class label. Using two challenging open benchmarks for performance evaluation, our proposed tracker has demonstrated substantial improvement over other state-of-the-art trackers.

cs.CV↗

arXiv2014

Designing Deep Networks for Surface Normal Estimation

In the past few years, convolutional neural nets (CNN) have shown incredible promise for learning visual representations. In this paper, we use CNNs for the task of predicting surface normals from a single image. But what is the right architecture we should use? We propose to build upon the decades of hard work in 3D scene understanding, to design new CNN architecture for the task of surface normal estimation. We show by incorporating several constraints (man-made, manhattan world) and meaningful intermediate representations (room layout, edge labels) in the architecture leads to state of the art performance on surface normal estimation. We also show that our network is quite robust and show state of the art results on other datasets as well without any fine-tuning.

cs.CV↗

arXiv2012

Unsupervised Discovery of Mid-Level Discriminative Patches

The goal of this paper is to discover a set of discriminative patches which can serve as a fully unsupervised mid-level visual representation. The desired patches need to satisfy two requirements: 1) to be representative, they need to occur frequently enough in the visual world; 2) to be discriminative, they need to be different enough from the rest of the visual world. The patches could correspond to parts, objects, "visual phrases", etc. but are not restricted to be any one of them. We pose this as an unsupervised discriminative clustering problem on a huge dataset of image patches. We use an iterative procedure which alternates between clustering and training discriminative classifiers, while applying careful cross-validation at each step to prevent overfitting. The paper experimentally demonstrates the effectiveness of discriminative patches as an unsupervised mid-level visual representation, suggesting that it could be used in place of visual words for many tasks. Furthermore, discriminative patches can also be used in a supervised regime, such as scene classification, where they demonstrate state-of-the-art performance on the MIT Indoor-67 dataset.

cs.CV↗

arXiv2002

Contribution of Kaluza-Klein modes to vacuum energy in models with large extra dimensions $&$ the Cosmological constant

In this paper, the generation of topological energy in models with large extra dimensions is investigated. The origin of this energy is attributed to a topological deformation of the standard Minkowski vacuum due to compactification of extra dimensions. This deformation is seen to give rise to an effective, finite energy density due to massive Kaluza-Klein modes of gravitation. It's renormalized value is seen to depend on the size of the extra dimensions instead of the UV cut-off of the theory. It is shown that if this energy density is to contribute to the observed cosmological constant, there will be extremely stringent bounds on the number of extra dimensions and their size.

hep-th↗

arXiv2002

Neutrino Masses from Non-minimal Gravitational Interactions of Massive Neutral Fermions

A new mechanism is proposed for generating neutrino masses radiatively through a non-minimal coupling to gravity of fermionic bilinears involving massive neutral fermions. Such coupling terms can arise in theories where the gravity sector is augmented by a scalar field. They necessarily violate the principle of equivalence, but such violations are not ruled out by present experiments. It is shown that the proposed mechanism is realised most convincingly in theories of the Randall- Sundrum type, where gravity couples strongly in the TeV range. The mechanism has the potential for solving both the solar and atmospheric neutrino problems. The smallness of neutrino masses in this scenario is due to the fact that the interaction of the massive neutral fermions arises entirely from higher-dimensional operators in the effective Lagrangian.

hep-ph↗

arXiv2002

Unitarity constraints on the stabilized Randall-Sundrum scenario

Recently proposed stabilization mechanism of the Randall-Sundrum metric gives rise to a scalar radion, which couples universally to matter with a weak interaction ($\simeq 1$ TeV) scale. Demanding that gauge boson scattering as described by the effective low enerrgy theory be unitary upto a given scale leads to significant constraints on the mass of such a radion.

hep-ph↗

arXiv2002

Two loop radion correction to $K_L$ - $K_S$ mass difference in the stabilised Randall-Sundrum brane world scenario

In the stabilised Randall-Sundrum brane world scenario, the radion can have phenomenologically testable effects, which can be measured against precisely measured electroweak physics data. We investigate the effect of two loop radion corrections to $K_L$ - $K_S$ mass difference to set a bound on the radion mass and vacuum expectation value. It is found that the leading two loop corrections are of the order $[Log(\frac{Λ^2}{m_ϕ^2}) ]^2$ where $Λ$ is the cut-off scale ${\cal O}(\sim$TeV) and $m_ϕ$ is the radion mass.

hep-ph↗

arXiv2000

Neutrinos as Source of Ultra High Energy Cosmic Rays in Extra Dimensions

If the neutrinos are to be identified with the primary source of ultra-high energy cosmic rays(UHECR), their interaction on relic neutrinos is of great importance in understanding their long intergalactic journey. In theories with large compact dimensions, the exchange of a tower of massive spin-2 gravitons (Kaluza-Klein excitations) gives extra contribution to $ν\barν \longrightarrow f\bar{f}$ and $γγ$ processes along with the opening of a new channel for the neutrinos to annihilate with the relic cosmic neutrino background $ν\barν \longrightarrow G_{kk}$ to produce bulk gravitons in the extra dimensions. This will affect their attenuation. We compute the contribution of these Kaluza-Klein excitations to the above processes and find that for parameters of the theory constrained by supernova cooling, the contribution does indeed become the dominant contribution above $\sqrt{s} \simeq 300$ GeV.

hep-ph↗

arXiv2000

Longitudinal Polarization in $K_L \to μ^+ μ^-$ in MSSM with large $tanβ$

A complete experiment on decay $K_L \to l^+ l^-$ will not only consist of measurement of the decay rates but also lepton polarization etc. These additional observations will yield tests of CP invariance in these decays. In $K_L$ and $K_S$ decays, the e mode is slower than the $μ$ mode by roughly $(m_e/m_μ)^2$ \cite{sehgal1}. As well discussed in literature \cite{herczeg} the Standard Model contribution to the lepton polarization is of order $2 \times \sim 10^{-3}$. We show that in MSSM with large \tanbeta and light higgs masses ($\sim 2 M_W$), the longitudinal lepton polarization in $K_L \to μ^+ μ^-$ can be enhanced to a higher value, of about $10^{-2}$.

hep-ph↗

arXiv1999

τPolarization asymmetry in $B \to X_s τ^+ τ^-$ in SUSY models with large $tanβ$

Rare B decays provides an opportunity to probe for new physics beyond the standard model. the effective Hamiltonian for the decay $b \to s l^+ l^-$ predicts the characteristic polarization for the final state lepton. Lepton polarization has, in addition to a longitudinal component $P_L$, two orthogonal components $P_T$ and $P_N$ lying in and perpendicular to the decay plane. In this article we perform a study of the $τ$-polarisation asymmetry in the case of SUSY models with large $\tanβ$ in the inclusive decay $B \to X_s τ^+ τ^-$.

hep-ph↗