arXiv subjects

Zhe Wang

Publications and source records attributed to Zhe Wang.

At least 487 records · Page 27Linked to original sources

arXiv2021

SpecBox: A Label-Based Transparent Speculation Scheme Against Transient Execution Attacks

Speculative execution techniques have been a cornerstone of modern processors to improve instruction-level parallelism. However, recent studies showed that this kind of techniques could be exploited by attackers to leak secret data via transient execution attacks, such as Spectre. Many defenses are proposed to address this problem, but they all face various challenges: (1) Tracking data flow in the instruction pipeline could comprehensively address this problem, but it could cause pipeline stalls and incur high performance overhead; (2) Making side effect of speculative execution imperceptible to attackers, but it often needs additional storage components and complicated data movement operations. In this paper, we propose a label-based transparent speculation scheme called SpecBox. It dynamically partitions the cache system to isolate speculative data and non-speculative data, which can prevent transient execution from being observed by subsequent execution. Moreover, it uses thread ownership semaphores to prevent speculative data from being accessed across cores. In addition, SpecBox also enhances the auxiliary components in the cache system against transient execution attacks, such as hardware prefetcher. Our security analysis shows that SpecBox is secure and the performance evaluation shows that the performance overhead on SPEC CPU 2006 and PARSEC-3.0 benchmarks is small.

cs.CR↗

arXiv2021

Magnetization dependent tunneling conductance of ferromagnetic barriers

Recent experiments on van der Waals antiferrmagnets such as CrI3, CrCl3 and MnPS3 have shown that using atomically thin layers as tunnel barriers and measuring the temperature ($T$) and magnetic field ($H$) dependence of the conductance allows their magnetic phase diagram to be mapped. In contrast, barriers made of CrBr3 -- the sole van der Waals ferromagnet investigated in this way -- were found to exhibit small and featureless magnetoconductance, seemingly carrying little information about magnetism. Here we show that -- despite these early results -- the conductance of CrBr3 tunnel barriers does provide detailed information about the magnetic state of atomically thin CrBr3 crystals for $T$ both above and below the Curie temperature ($T_C = 32$ K). Our analysis establishes that the tunneling conductance depends on $H$ and $T$ exclusively through the magnetization $M(H,T)$, over the entire temperature range investigated (2-50 K). The phenomenon is reproduced in detail by the spin-dependent Fowler-Nordheim model for tunneling, and is a direct manifestation of the spin splitting of the CrBr3 conduction band. These findings demonstrate that the investigation of magnetism by tunneling conductance measurements is not limited to antiferromagnets, but can also be applied to ferromagnetic materials.

cond-mat.mtrl-sci↗

arXiv2021

Federated Learning Over Wireless Channels: Dynamic Resource Allocation and Task Scheduling

With the development of federated learning (FL), mobile devices (MDs) are able to train their local models with private data and sends them to a central server for aggregation, thereby preventing sensitive raw data leakage. In this paper, we aim to improve the training performance of FL systems in the context of wireless channels and stochastic energy arrivals of MDs. To this purpose, we dynamically optimize MDs' transmission power and training task scheduling. We first model this dynamic programming problem as a constrained Markov decision process (CMDP). Due to high dimensions rooted from our CMDP problem, we propose online stochastic learning methods to simplify the CMDP and design online algorithms to obtain an efficient policy for all MDs. Since there are long-term constraints in our CMDP, we utilize Lagrange multipliers approach to tackle this issue. Furthermore, we prove the convergence of the proposed online stochastic learning algorithm. Numerical results indicate that the proposed algorithms can achieve better performance than the benchmark algorithms.

cs.DC↗

arXiv2021

Time-series Imputation of Temporally-occluded Multiagent Trajectories

In multiagent environments, several decision-making individuals interact while adhering to the dynamics constraints imposed by the environment. These interactions, combined with the potential stochasticity of the agents' decision-making processes, make such systems complex and interesting to study from a dynamical perspective. Significant research has been conducted on learning models for forward-direction estimation of agent behaviors, for example, pedestrian predictions used for collision-avoidance in self-driving cars. However, in many settings, only sporadic observations of agents may be available in a given trajectory sequence. For instance, in football, subsets of players may come in and out of view of broadcast video footage, while unobserved players continue to interact off-screen. In this paper, we study the problem of multiagent time-series imputation, where available past and future observations of subsets of agents are used to estimate missing observations for other agents. Our approach, called the Graph Imputer, uses forward- and backward-information in combination with graph networks and variational autoencoders to enable learning of a distribution of imputed trajectories. We evaluate our approach on a dataset of football matches, using a projective camera module to train and evaluate our model for the off-screen player state estimation setting. We illustrate that our method outperforms several state-of-the-art approaches, including those hand-crafted for football.

cs.LG↗

arXiv2021

Neutron diffraction of field-induced magnon condensation in the spin-dimerized antiferromagnet Sr$_{3}$Cr$_{2}$O$_{8}$

In this work, we investigate the evolution and settling of magnon condensation in the spin-1/2 dimer system Sr$_{3}$Cr$_{2}$O$_{8}$ using a combination of magnetostriction in pulsed fields and inelastic neutron scattering in a continuous magnetic field. The magnetic structure in the Bose-Einstein condensation (BEC) phase was probed by neutron diffraction in pulsed magnetic fields up to 39~T. The magnetic structure in this phase was confirmed to be an XY-antiferromagnetic structure validated by irreducible representational analysis. The magnetic phase diagram as a function of an applied magnetic field for this system is presented. Furthermore, zero-field neutron diffraction results indicate that dimerization plays an important role in stabilizing the low-temperature crystal structure.

cond-mat.str-el↗

arXiv2021

From Motor Control to Team Play in Simulated Humanoid Football

Intelligent behaviour in the physical world exhibits structure at multiple spatial and temporal scales. Although movements are ultimately executed at the level of instantaneous muscle tensions or joint torques, they must be selected to serve goals defined on much longer timescales, and in terms of relations that extend far beyond the body itself, ultimately involving coordination with other agents. Recent research in artificial intelligence has shown the promise of learning-based approaches to the respective problems of complex movement, longer-term planning and multi-agent coordination. However, there is limited research aimed at their integration. We study this problem by training teams of physically simulated humanoid avatars to play football in a realistic virtual environment. We develop a method that combines imitation learning, single- and multi-agent reinforcement learning and population-based training, and makes use of transferable representations of behaviour for decision making at different levels of abstraction. In a sequence of stages, players first learn to control a fully articulated body to perform realistic, human-like movements such as running and turning; they then acquire mid-level football skills such as dribbling and shooting; finally, they develop awareness of others and play as a team, bridging the gap between low-level motor control at a timescale of milliseconds, and coordinated goal-directed behaviour as a team at the timescale of tens of seconds. We investigate the emergence of behaviours at different levels of abstraction, as well as the representations that underlie these behaviours using several analysis techniques, including statistics from real-world sports analytics. Our work constitutes a complete demonstration of integrated decision-making at multiple scales in a physically embodied multi-agent setting. See project video at https://youtu.be/KHMwq9pv7mg.

cs.AI↗

arXiv2021

Deep learning in physics: a study of dielectric quasi-cubic particles in a uniform electric field

Solving physics problems for which we know the equations, boundary conditions and symmetries can be done by deep learning. The constraints can be either imposed as terms in a loss function or used to formulate a neural ansatz. In the present case study, we calculate the induced field inside and outside a dielectric cube placed in a uniform electric field, wherein the dielectric mismatch at edges and corners of the cube makes accurate calculations numerically challenging. The electric potential is expressed as an ansatz incorporating neural networks with known leading order behaviors and symmetries and the Laplace's equation is then solved with boundary conditions at the dielectric interface by minimizing a loss function. The loss function ensures that both Laplace's equation and boundary conditions are satisfied everywhere inside a large solution domain. We study how the electric potential inside and outside a quasi-cubic particle evolves through a sequence of shapes from a sphere to a cube. The neural network being differentiable, it is straightforward to calculate the electric field over the whole domain, the induced surface charge distribution and the polarizability. The neural network being retentive, one can efficiently follow how the field changes upon particle's shape or dielectric constant by iterating from any previously converged solution. The present work's objective is two-fold, first to show how an a priori knowledge can be incorporated into neural networks to achieve efficient learning and second to apply the method and study how the induced field and polarizability change when a dielectric particle progressively changes its shape from a sphere to a cube.

physics.class-ph↗

arXiv2021

Non-invasive time-sorting in radio-frequency compressed ultrafast electron diffraction

We demonstrate a non-invasive time-sorting method for ultrafast electron diffraction (UED) experiments with radio-frequency (rf) compressed electron beams. We show that electron beam energy and arrival time at the sample after rf compression are strongly correlated such that the arrival time jitter may be corrected through measurement of the beam energy. The method requires minimal change to the infrastructure of most of the UED machines and is applicable to both keV and MeV UED. In our experiment with ~3 MeV beam, the timing jitter after rf compression is corrected with 35 fs root-mean-square (rms) accuracy, limited by the 3x10^-4 energy stability. For keV UED with high energy stability, sub-10 fs accuracy in time-sorting should be readily achievable. This time-sorting technique allows us to retrieve the 2.5 THz oscillation related to coherent A1g phonon in laser excited Bismuth film and extends the temporal resolution of UED to a regime far beyond the 100-200 fs rms jitter limitation.

physics.acc-ph↗

arXiv2021

An Ultrahigh-Q Microresonator on 4H-silicon-carbide-on-insulator Platform for Multiple Harmonics, Cascaded Raman Lasing and Kerr Comb Generations

The realization of ultrahigh quality (Q) resonators regardless of the underpinning material platforms has been a ceaseless pursuit, because the high Q resonators provide an extreme environment of storage of light to enable observations of many unconventional nonlinear optical phenomenon with high efficiencies. Here, we demonstrate an ultra-high Q factor (7.1*10^6) microresonator on the 4H-silicon-carbide-on-insulator (4H-SiCOI) platform in which both \c{hi}^(2) and \c{hi}^(3) nonlinear processes of high efficiencies have been generated. Broadband frequency conversions, including second-, third-, fourth-harmonic generation were observed. Cascaded Raman lasing was demonstrated in the SiC microresonator for the first time to the best of our knowledge. Broadband Kerr frequency combs covering from 1300 to 1700 nm were achieved using a dispersion-engineered SiC microresonator. Our demonstration is a significant milestone in the development of SiC photonic integrated devices.

physics.optics↗

arXiv2021

Exploring Data Augmentation for Multi-Modality 3D Object Detection

It is counter-intuitive that multi-modality methods based on point cloud and images perform only marginally better or sometimes worse than approaches that solely use point cloud. This paper investigates the reason behind this phenomenon. Due to the fact that multi-modality data augmentation must maintain consistency between point cloud and images, recent methods in this field typically use relatively insufficient data augmentation. This shortage makes their performance under expectation. Therefore, we contribute a pipeline, named transformation flow, to bridge the gap between single and multi-modality data augmentation with transformation reversing and replaying. In addition, considering occlusions, a point in different modalities may be occupied by different objects, making augmentations such as cut and paste non-trivial for multi-modality detection. We further present Multi-mOdality Cut and pAste (MoCa), which simultaneously considers occlusion and physical plausibility to maintain the multi-modality consistency. Without using ensemble of detectors, our multi-modality detector achieves new state-of-the-art performance on nuScenes dataset and competitive performance on KITTI 3D benchmark. Our method also wins the best PKL award in the 3rd nuScenes detection challenge. Code and models will be released at https://github.com/open-mmlab/mmdetection3d.

cs.CV↗

arXiv2021

PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection

We present a novel and high-performance 3D object detection framework, named PointVoxel-RCNN (PV-RCNN), for accurate 3D object detection from point clouds. Our proposed method deeply integrates both 3D voxel Convolutional Neural Network (CNN) and PointNet-based set abstraction to learn more discriminative point cloud features. It takes advantages of efficient learning and high-quality proposals of the 3D voxel CNN and the flexible receptive fields of the PointNet-based networks. Specifically, the proposed framework summarizes the 3D scene with a 3D voxel CNN into a small set of keypoints via a novel voxel set abstraction module to save follow-up computations and also to encode representative scene features. Given the high-quality 3D proposals generated by the voxel CNN, the RoI-grid pooling is proposed to abstract proposal-specific features from the keypoints to the RoI-grid points via keypoint set abstraction with multiple receptive fields. Compared with conventional pooling operations, the RoI-grid feature points encode much richer context information for accurately estimating object confidences and locations. Extensive experiments on both the KITTI dataset and the Waymo Open dataset show that our proposed PV-RCNN surpasses state-of-the-art 3D detection methods with remarkable margins by using only point clouds. Code is available at https://github.com/open-mmlab/OpenPCDet.

cs.CV↗

arXiv2021

AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matching

Recently, records on stereo matching benchmarks are constantly broken by end-to-end disparity networks. However, the domain adaptation ability of these deep models is quite poor. Addressing such problem, we present a novel domain-adaptive pipeline called AdaStereo that aims to align multi-level representations for deep stereo matching networks. Compared to previous methods for adaptive stereo matching, our AdaStereo realizes a more standard, complete and effective domain adaptation pipeline. Firstly, we propose a non-adversarial progressive color transfer algorithm for input image-level alignment. Secondly, we design an efficient parameter-free cost normalization layer for internal feature-level alignment. Lastly, a highly related auxiliary task, self-supervised occlusion-aware reconstruction is presented to narrow down the gaps in output space. Our AdaStereo models achieve state-of-the-art cross-domain performance on multiple stereo benchmarks, including KITTI, Middlebury, ETH3D, and DrivingStereo, even outperforming disparity networks finetuned with target-domain ground-truths.

cs.CV↗

arXiv2021

ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection

We present a new domain adaptive self-training pipeline, named ST3D, for unsupervised domain adaptation on 3D object detection from point clouds. First, we pre-train the 3D detector on the source domain with our proposed random object scaling strategy for mitigating the negative effects of source domain bias. Then, the detector is iteratively improved on the target domain by alternatively conducting two steps, which are the pseudo label updating with the developed quality-aware triplet memory bank and the model training with curriculum data augmentation. These specific designs for 3D object detection enable the detector to be trained with consistent and high-quality pseudo labels and to avoid overfitting to the large number of easy examples in pseudo labeled data. Our ST3D achieves state-of-the-art performance on all evaluated datasets and even surpasses fully supervised results on KITTI 3D object detection benchmark. Code will be available at https://github.com/CVMI-Lab/ST3D.

cs.CV↗

arXiv2021

Gradient Free Minimax Optimization: Variance Reduction and Faster Convergence

Many important machine learning applications amount to solving minimax optimization problems, and in many cases there is no access to the gradient information, but only the function values. In this paper, we focus on such a gradient-free setting, and consider the nonconvex-strongly-concave minimax stochastic optimization problem. In the literature, various zeroth-order (i.e., gradient-free) minimax methods have been proposed, but none of them achieve the potentially feasible computational complexity of $\mathcal{O}(ε^{-3})$ suggested by the stochastic nonconvex minimization theorem. In this paper, we adopt the variance reduction technique to design a novel zeroth-order variance reduced gradient descent ascent (ZO-VRGDA) algorithm. We show that the ZO-VRGDA algorithm achieves the best known query complexity of $\mathcal{O}(κ(d_1 + d_2)ε^{-3})$, which outperforms all previous complexity bound by orders of magnitude, where $d_1$ and $d_2$ denote the dimensions of the optimization variables and $κ$ denotes the condition number. In particular, with a new analysis technique that we develop, our result does not rely on a diminishing or accuracy-dependent stepsize usually required in the existing methods. To our best knowledge, this is the first study of zeroth-order minimax optimization with variance reduction. Experimental results on the black-box distributional robust optimization problem demonstrates the advantageous performance of our new algorithm.

cs.LG↗

arXiv2021

PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videos

The end-to-end Human Mesh Recovery (HMR) approach has been successfully used for 3D body reconstruction. However, most HMR-based frameworks reconstruct human body by directly learning mesh parameters from images or videos, while lacking explicit guidance of 3D human pose in visual data. As a result, the generated mesh often exhibits incorrect pose for complex activities. To tackle this problem, we propose to exploit 3D pose to calibrate human mesh. Specifically, we develop two novel Pose Calibration frameworks, i.e., Serial PC-HMR and Parallel PC-HMR. By coupling advanced 3D pose estimators and HMR in a serial or parallel manner, these two frameworks can effectively correct human mesh with guidance of a concise pose calibration module. Furthermore, since the calibration module is designed via non-rigid pose transformation, our PC-HMR frameworks can flexibly tackle bone length variations to alleviate misplacement in the calibrated mesh. Finally, our frameworks are based on generic and complementary integration of data-driven learning and geometrical modeling. Via plug-and-play modules, they can be efficiently adapted for both image/video-based human mesh recovery. Additionally, they have no requirement of extra 3D pose annotations in the testing phase, which releases inference difficulties in practice. We perform extensive experiments on the popular bench-marks, i.e., Human3.6M, 3DPW and SURREAL, where our PC-HMR frameworks achieve the SOTA results.

cs.CV↗

arXiv2021

An electro-optically tunable microring laser monolithically integrated on lithium niobate on insulator

We demonstrate monolithic integration of an electro-optically (EO) tunable microring laser on lithium niobate on insulator (LNOI) platform. The device is fabricated by photolithography assisted chemo-mechanical etching (PLACE), and the pump laser is evanescently coupled into the erbium (Er3+) doped LN microring laser using an undoped LN waveguide mounted above the microring. The quality factor of the LN microring resonator is measured as high as 1.54x10^5 at the wavelength of 1542 nm. Lasing action can be observed at a pump power threshold below 3.5 mW using a 980 nm continuous-wave pump laser. Finally, tuning of the laser wavelength is achieved by varying the electric voltage on the microelectrodes fabricated in the vicinity of microring waveguide, showing an EO coefficient of 0.33 pm/V.

physics.optics↗

arXiv2021

Relate and Predict: Structure-Aware Prediction with Jointly Optimized Neural DAG

Understanding relationships between feature variables is one important way humans use to make decisions. However, state-of-the-art deep learning studies either focus on task-agnostic statistical dependency learning or do not model explicit feature dependencies during prediction. We propose a deep neural network framework, dGAP, to learn neural dependency Graph and optimize structure-Aware target Prediction simultaneously. dGAP trains towards a structure self-supervision loss and a target prediction loss jointly. Our method leads to an interpretable model that can disentangle sparse feature relationships, informing the user how relevant dependencies impact the target task. We empirically evaluate dGAP on multiple simulated and real datasets. dGAP is not only more accurate, but can also recover correct dependency structure.

cs.LG↗

arXiv2021

Network Pruning via Resource Reallocation

Channel pruning is broadly recognized as an effective approach to obtain a small compact model through eliminating unimportant channels from a large cumbersome network. Contemporary methods typically perform iterative pruning procedure from the original over-parameterized model, which is both tedious and expensive especially when the pruning is aggressive. In this paper, we propose a simple yet effective channel pruning technique, termed network Pruning via rEsource rEalLocation (PEEL), to quickly produce a desired slim model with negligible cost. Specifically, PEEL first constructs a predefined backbone and then conducts resource reallocation on it to shift parameters from less informative layers to more important layers in one round, thus amplifying the positive effect of these informative layers. To demonstrate the effectiveness of PEEL , we perform extensive experiments on ImageNet with ResNet-18, ResNet-50, MobileNetV2, MobileNetV3-small and EfficientNet-B0. Experimental results show that structures uncovered by PEEL exhibit competitive performance with state-of-the-art pruning algorithms under various pruning settings. Our code is available at https://github.com/cardwing/Codes-for-PEEL.

cs.CV↗