arXiv subjects

He Wang

Publications and source records attributed to He Wang.

At least 397 records · Page 22Linked to original sources

arXiv2020

SAPIEN: A SimulAted Part-based Interactive ENvironment

Building home assistant robots has long been a pursuit for vision and robotics researchers. To achieve this task, a simulated environment with physically realistic simulation, sufficient articulated objects, and transferability to the real robot is indispensable. Existing environments achieve these requirements for robotics simulation with different levels of simplification and focus. We take one step further in constructing an environment that supports household tasks for training robot learning algorithm. Our work, SAPIEN, is a realistic and physics-rich simulated environment that hosts a large-scale set for articulated objects. Our SAPIEN enables various robotic vision and interaction tasks that require detailed part-level understanding.We evaluate state-of-the-art vision algorithms for part detection and motion attribute recognition as well as demonstrate robotic interaction tasks using heuristic approaches and reinforcement learning algorithms. We hope that our SAPIEN can open a lot of research directions yet to be explored, including learning cognition through interaction, part motion discovery, and construction of robotics-ready simulated game environment.

cs.CV↗

arXiv2020

SMART: Skeletal Motion Action Recognition aTtack

Adversarial attack has inspired great interest in computer vision, by showing that classification-based solutions are prone to imperceptible attack in many tasks. In this paper, we propose a method, SMART, to attack action recognizers which rely on 3D skeletal motions. Our method involves an innovative perceptual loss which ensures the imperceptibility of the attack. Empirical studies demonstrate that SMART is effective in both white-box and black-box scenarios. Its generalizability is evidenced on a variety of action recognizers and datasets. Its versatility is shown in different attacking strategies. Its deceitfulness is proven in extensive perceptual studies. Finally, SMART shows that adversarial attack on 3D skeletal motion, one type of time-series data, is significantly different from traditional adversarial attack problems.

cs.CV↗

arXiv2020

Human-like Planning for Reaching in Cluttered Environments

Humans, in comparison to robots, are remarkably adept at reaching for objects in cluttered environments. The best existing robot planners are based on random sampling of configuration space -- which becomes excessively high-dimensional with large number of objects. Consequently, most planners often fail to efficiently find object manipulation plans in such environments. We addressed this problem by identifying high-level manipulation plans in humans, and transferring these skills to robot planners. We used virtual reality to capture human participants reaching for a target object on a tabletop cluttered with obstacles. From this, we devised a qualitative representation of the task space to abstract the decision making, irrespective of the number of obstacles. Based on this representation, human demonstrations were segmented and used to train decision classifiers. Using these classifiers, our planner produced a list of waypoints in task space. These waypoints provided a high-level plan, which could be transferred to an arbitrary robot model and used to initialise a local trajectory optimiser. We evaluated this approach through testing on unseen human VR data, a physics-based robot simulation, and a real robot (dataset and code are publicly available). We found that the human-like planner outperformed a state-of-the-art standard trajectory optimisation algorithm, and was able to generate effective strategies for rapid planning -- irrespective of the number of obstacles in the environment.

cs.RO↗

arXiv2020

Predicting the Physical Dynamics of Unseen 3D Objects

Machines that can predict the effect of physical interactions on the dynamics of previously unseen object instances are important for creating better robots and interactive virtual worlds. In this work, we focus on predicting the dynamics of 3D objects on a plane that have just been subjected to an impulsive force. In particular, we predict the changes in state - 3D position, rotation, velocities, and stability. Different from previous work, our approach can generalize dynamics predictions to object shapes and initial conditions that were unseen during training. Our method takes the 3D object's shape as a point cloud and its initial linear and angular velocities as input. We extract shape features and use a recurrent neural network to predict the full change in state at each time step. Our model can support training with data from both a physics engine or the real world. Experiments show that we can accurately predict the changes in state for unseen object geometries and initial conditions.

cs.CV↗

arXiv2019

Taylor expansions of groups and filtered-formality

Let $G$ be a finitely generated group, and let $\Bbbk{G}$ be its group algebra over a field of characteristic $0$. A Taylor expansion is a certain type of map from $G$ to the degree completion of the associated graded algebra of $\Bbbk{G}$ which generalizes the Magnus expansion of a free group. The group $G$ is said to be filtered-formal if its Malcev Lie algebra is isomorphic to the degree completion of its associated graded Lie algebra. We show that $G$ is filtered-formal if and only if it admits a Taylor expansion, and derive some consequences.

math.GR↗

arXiv2019

Gravitational wave signal recognition of O1 data by deep learning

Deep learning method develops very fast as a tool for data analysis these years. Such a technique is quite promising to treat gravitational wave detection data. There are many works already in the literature which used deep learning technique to process simulated gravitational wave data. In this paper we apply deep learning to LIGO O1 data. In order to improve the weak signal recognition we adjust the convolutional neural network (CNN) a little bit. Our adjusted convolutional neural network admits comparable accuracy and efficiency of signal recognition as other deep learning works published in the literature. Based on our adjusted CNN, we can clearly recognize the eleven confirmed gravitational wave events included in O1 and O2. And more we find about 2000 gravitational wave triggers in O1 data.

astro-ph.IM↗

arXiv2019

Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modeling

Data-driven modeling of human motions is ubiquitous in computer graphics and computer vision applications, such as synthesizing realistic motions or recognizing actions. Recent research has shown that such problems can be approached by learning a natural motion manifold using deep learning to address the shortcomings of traditional data-driven approaches. However, previous methods can be sub-optimal for two reasons. First, the skeletal information has not been fully utilized for feature extraction. Unlike images, it is difficult to define spatial proximity in skeletal motions in the way that deep networks can be applied. Second, motion is time-series data with strong multi-modal temporal correlations. A frame could be followed by several candidate frames leading to different motions; long-range dependencies exist where a number of frames in the beginning correlate to a number of frames later. Ineffective modeling would either under-estimate the multi-modality and variance, resulting in featureless mean motion or over-estimate them resulting in jittery motions. In this paper, we propose a new deep network to tackle these challenges by creating a natural motion manifold that is versatile for many applications. The network has a new spatial component for feature extraction. It is also equipped with a new batch prediction model that predicts a large number of frames at once, such that long-term temporally-based objective functions can be employed to correctly learn the motion multi-modality and variances. With our system, long-duration motions can be predicted/synthesized using an open-loop setup where the motion retains the dynamics accurately. It can also be used for denoising corrupted motions and synthesizing new motions with given control signals. We demonstrate that our system can create superior results comparing to existing work in multiple applications.

cs.GR↗

arXiv2019

Competing Against Equilibria in Zero-Sum Games with Evolving Payoffs

We study the problem of repeated play in a zero-sum game in which the payoff matrix may change, in a possibly adversarial fashion, on each round; we call these Online Matrix Games. Finding the Nash Equilibrium (NE) of a two player zero-sum game is core to many problems in statistics, optimization, and economics, and for a fixed game matrix this can be easily reduced to solving a linear program. But when the payoff matrix evolves over time our goal is to find a sequential algorithm that can compete with, in a certain sense, the NE of the long-term-averaged payoff matrix. We design an algorithm with small NE regret--that is, we ensure that the long-term payoff of both players is close to minimax optimum in hindsight. Our algorithm achieves near-optimal dependence with respect to the number of rounds and depends poly-logarithmically on the number of available actions of the players. Additionally, we show that the naive reduction, where each player simply minimizes its own regret, fails to achieve the stated objective regardless of which algorithm is used. We also consider the so-called bandit setting, where the feedback is significantly limited, and we provide an algorithm with small NE regret using one-point estimates of each payoff matrix.

cs.LG↗

arXiv2019

Chen ranks and resonance varieties of the upper McCool groups

The group of basis-conjugating automorphisms of the free group of rank $n$, also known as the McCool group or the welded braid group $PΣ_n$, contains a much-studied subgroup, called the upper McCool group $PΣ_n^+$. Starting from the cohomology ring of $PΣ_n^+$, we find, by means of a Gröbner basis computation, a simple presentation for the infinitesimal Alexander invariant of this group, from which we determine the resonance varieties and the Chen ranks of the upper McCool groups. These computations reveal that, unlike for the pure braid group $P_n$ and the full McCool group $PΣ_n$, the Chen ranks conjecture does not hold for $PΣ_n^+$, for any $n\ge 4$. Consequently, $PΣ_n^+$ is not isomorphic to $P_n$ in that range, thus answering a question of Cohen, Pakianathan, Vershinin, and Wu. We also determine the scheme structure of the resonance varieties $\mathcal{R}_1(PΣ_n^+)$, and show that these schemes are not reduced for $n\geq 4$.

math.GR↗

arXiv2019

Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimation

The goal of this paper is to estimate the 6D pose and dimensions of unseen object instances in an RGB-D image. Contrary to "instance-level" 6D pose estimation tasks, our problem assumes that no exact object CAD models are available during either training or testing time. To handle different and unseen object instances in a given category, we introduce a Normalized Object Coordinate Space (NOCS)---a shared canonical representation for all possible object instances within a category. Our region-based neural network is then trained to directly infer the correspondence from observed pixels to this shared object representation (NOCS) along with other object information such as class label and instance mask. These predictions can be combined with the depth map to jointly estimate the metric 6D pose and dimensions of multiple objects in a cluttered scene. To train our network, we present a new context-aware technique to generate large amounts of fully annotated mixed reality data. To further improve our model and evaluate its performance on real data, we also provide a fully annotated real-world dataset with large environment and instance variation. Extensive experiments demonstrate that the proposed method is able to robustly estimate the pose and size of unseen object instances in real environments while also achieving state-of-the-art performance on standard 6D pose estimation benchmarks.

cs.CV↗

arXiv2019

Warm inflation with a generalized Langevin equation scenario

In this paper, we discuss the warm inflation model with both a Langevin equation and a generalized Langevin equation scenario. As a brief picture to illustrate the basic properties of stochastic differential equation in warm inflation, this paper is started from a simple condition with constant dissipative coefficient. In this model, we prove the perturbed inflaton field exhibits a stationary process on large scale, so the perturbed field has a scale-invariant power spectrum. Then we study the warm inflation with a generalized Langevin equation scenario. The perturbed field in such model also shows a stationary process and the power spectrum is quite similar to the one in cold inflation. If choosing an appropriate fluctuation-dissipation relation, we can get a spectrum same as the cold inflation. In a word, we attempt to show the rationality of warm inflationary scenario via statistical physics method.

gr-qc↗

arXiv2019

Large Scale Markov Decision Processes with Changing Rewards

We consider Markov Decision Processes (MDPs) where the rewards are unknown and may change in an adversarial manner. We provide an algorithm that achieves state-of-the-art regret bound of $O( \sqrt{τ(\ln|S|+\ln|A|)T}\ln(T))$, where $S$ is the state space, $A$ is the action space, $τ$ is the mixing time of the MDP, and $T$ is the number of periods. The algorithm's computational complexity is polynomial in $|S|$ and $|A|$ per period. We then consider a setting often encountered in practice, where the state space of the MDP is too large to allow for exact solutions. By approximating the state-action occupancy measures with a linear architecture of dimension $d\ll|S|$, we propose a modified algorithm with computational complexity polynomial in $d$. We also prove a regret bound for this modified algorithm, which to the best of our knowledge this is the first $\tilde{O}(\sqrt{T})$ regret bound for large scale MDPs with changing rewards.

cs.LG↗

arXiv2019

DADA-2000: Can Driving Accident be Predicted by Driver Attention? Analyzed by A Benchmark

Driver attention prediction is currently becoming the focus in safe driving research community, such as the DR(eye)VE project and newly emerged Berkeley DeepDrive Attention (BDD-A) database in critical situations. In safe driving, an essential task is to predict the incoming accidents as early as possible. BDD-A was aware of this problem and collected the driver attention in laboratory because of the rarity of such scenes. Nevertheless, BDD-A focuses the critical situations which do not encounter actual accidents, and just faces the driver attention prediction task, without a close step for accident prediction. In contrast to this, we explore the view of drivers' eyes for capturing multiple kinds of accidents, and construct a more diverse and larger video benchmark than ever before with the driver attention and the driving accident annotation simultaneously (named as DADA-2000), which has 2000 video clips owning about 658,476 frames on 54 kinds of accidents. These clips are crowd-sourced and captured in various occasions (highway, urban, rural, and tunnel), weather (sunny, rainy and snowy) and light conditions (daytime and nighttime). For the driver attention representation, we collect the maps of fixations, saccade scan path and focusing time. The accidents are annotated by their categories, the accident window in clips and spatial locations of the crash-objects. Based on the analysis, we obtain a quantitative and positive answer for the question in this paper.

cs.CV↗

arXiv2019

Formality properties of finitely generated groups and Lie algebras

We explore the graded and filtered formality properties of finitely generated groups by studying the various Lie algebras over a field of characteristic 0 attached to such groups, including the Malcev Lie algebra, the associated graded Lie algebra, the holonomy Lie algebra, and the Chen Lie algebra. We explain how these notions behave with respect to split injections, coproducts, direct products, as well as field extensions, and how they are inherited by solvable and nilpotent quotients. A key tool in this analysis is the 1-minimal model of the group, and the way this model relates to the aforementioned Lie algebras. Another approach to formality is provided by Taylor expansions from the group to the completion of the associated graded algebra of the group ring. We illustrate our approach with examples drawn from a variety of group-theoretic and topological contexts, such as finitely generated torsion-free nilpotent groups, link groups, and fundamental groups of Seifert fibered manifolds.

math.GR↗

arXiv2019

A setup for extreme-ultraviolet ultrafast angle-resolved photoelectron spectroscopy at 50-kHz repetition rate

Time- and angle-resolved photoelectron spectroscopy (trARPES) is a powerful method to track the ultrafast dynamics of quasiparticles and electronic bands in energy and momentum space. We present a setup for trARPES with 22.3 eV extreme-ultraviolet (XUV) femtosecond pulses at 50-kHz repetition rate, which enables fast data acquisition and access to dynamics across momentum space with high sensitivity. The design and operation of the XUV beamline, pump-probe setup, and UHV endstation are described in detail. By characterizing the effect of space-charge broadening, we determine an ultimate source-limited energy resolution of 60 meV, with typically 80-100 meV obtained at 1-2e10 photons/s probe flux on the sample. The instrument capabilities are demonstrated via both equilibrium and time-resolved ARPES studies of transition-metal dichalcogenides. The 50-kHz repetition rate enables sensitive measurements of quasiparticles at low excitation fluences in semiconducting MoSe$_2$, with an instrumental time resolution of 65 fs. Moreover, photo-induced phase transitions can be driven with the available pump fluence, as shown by charge density wave melting in 1T-TiSe$_2$. The high repetition-rate setup thus provides a versatile platform for sensitive XUV trARPES, from quenching of electronic phases down to the perturbative limit.

physics.ins-det↗

arXiv2019

Learning Generalizable Physical Dynamics of 3D Rigid Objects

Humans have a remarkable ability to predict the effect of physical interactions on the dynamics of objects. Endowing machines with this ability would allow important applications in areas like robotics and autonomous vehicles. In this work, we focus on predicting the dynamics of 3D rigid objects, in particular an object's final resting position and total rotation when subjected to an impulsive force. Different from previous work, our approach is capable of generalizing to unseen object shapes - an important requirement for real-world applications. To achieve this, we represent object shape as a 3D point cloud that is used as input to a neural network, making our approach agnostic to appearance variation. The design of our network is informed by an understanding of physical laws. We train our model with data from a physics engine that simulates the dynamics of a large number of shapes. Experiments show that we can accurately predict the resting position and total rotation for unseen object geometries.

cs.CV↗

arXiv2018

A Re-solving Heuristic with Uniformly Bounded Loss for Network Revenue Management

We consider the canonical (quantity-based) network revenue management problem, where a firm accepts or rejects incoming customer requests irrevocably in order to maximize expected revenue given limited resources. Due to the curse of dimensionality, the exact solution to this problem by dynamic programming is intractable when the number of resources is large. We study a family of re-solving heuristics that periodically re-optimize an approximation to the original problem known as the deterministic linear program (DLP), where random customer arrivals are replaced by their expectations. We find that, in general, frequently re-solving the DLP produces the same order of revenue loss as one would get without re-solving, which scales as the square root of the time horizon length and resource capacities. By re-solving the DLP at a few selected points in time and applying thresholds to the customer acceptance probabilities, we design a new re-solving heuristic whose revenue loss is uniformly bounded by a constant that is independent of the time horizon and resource capacities.

math.OC↗

arXiv2018

GSPN: Generative Shape Proposal Network for 3D Instance Segmentation in Point Cloud

We introduce a novel 3D object proposal approach named Generative Shape Proposal Network (GSPN) for instance segmentation in point cloud data. Instead of treating object proposal as a direct bounding box regression problem, we take an analysis-by-synthesis strategy and generate proposals by reconstructing shapes from noisy observations in a scene. We incorporate GSPN into a novel 3D instance segmentation framework named Region-based PointNet (R-PointNet) which allows flexible proposal refinement and instance segmentation generation. We achieve state-of-the-art performance on several 3D instance segmentation tasks. The success of GSPN largely comes from its emphasis on geometric understandings during object proposal, which greatly reducing proposals with low objectness.

cs.CV↗