arXiv subjects

Xiao Zhang

Publications and source records attributed to Xiao Zhang.

At least 397 records · Page 22Linked to original sources

arXiv2022

ASM2TV: An Adaptive Semi-Supervised Multi-Task Multi-View Learning Framework for Human Activity Recognition

Many real-world scenarios, such as human activity recognition (HAR) in IoT, can be formalized as a multi-task multi-view learning problem. Each specific task consists of multiple shared feature views collected from multiple sources, either homogeneous or heterogeneous. Common among recent approaches is to employ a typical hard/soft sharing strategy at the initial phase separately for each view across tasks to uncover common knowledge, underlying the assumption that all views are conditionally independent. On the one hand, multiple views across tasks possibly relate to each other under practical situations. On the other hand, supervised methods might be insufficient when labeled data is scarce. To tackle these challenges, we introduce a novel framework ASM2TV for semi-supervised multi-task multi-view learning. We present a new perspective named gating control policy, a learnable task-view-interacted sharing policy that adaptively selects the most desirable candidate shared block for any view across any task, which uncovers more fine-grained task-view-interacted relatedness and improves inference efficiency. Significantly, our proposed gathering consistency adaption procedure takes full advantage of large amounts of unlabeled fragmented time-series, making it a general framework that accommodates a wide range of applications. Experiments on two diverse real-world HAR benchmark datasets collected from various subjects and sources demonstrate our framework's superiority over other state-of-the-arts. The detailed codes are available at https://github.com/zachstarkk/ASM2TV.

cs.LG↗

arXiv2022

Nodal lines in momentum space: topological invariants and recent realizations in photonic and other systems

Topological insulators constitute one of the most intriguing phenomena in modern condensed matter theory. The unique and exotic properties of topological states of matter allow for unidirectional gapless electron transport and extremely accurate measurements of the Hall conductivity. Recently, new topological effects occurring at Dirac/Weyl points have been better understood and demonstrated using artificial materials such as photonic and phononic crystals, metamaterials and electrical circuits. In comparison, the topological properties of nodal lines, which are one-dimensional degeneracies in momentum space, remain less explored. Here, we explain the theoretical concept of topological nodal lines and review recent and ongoing progress using artificial materials. The review includes recent demonstrations of non-Abelian topological charges of nodal lines in momentum space and examples of nodal lines realized in photonic and other systems. Finally, we will address the challenges involved in both experimental demonstration and theoretical understanding of topological nodal lines.

cond-mat.mtrl-sci↗

arXiv2022

Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoT

Many real-world IoT systems, which include a variety of internet-connected sensory devices, produce substantial amounts of multivariate time series data. Meanwhile, vital IoT infrastructures like smart power grids and water distribution networks are frequently targeted by cyber-attacks, making anomaly detection an important study topic. Modeling such relatedness is, nevertheless, unavoidable for any efficient and effective anomaly detection system, given the intricate topological and nonlinear connections that are originally unknown among sensors. Furthermore, detecting anomalies in multivariate time series is difficult due to their temporal dependency and stochasticity. This paper presented GTA, a new framework for multivariate time series anomaly detection that involves automatically learning a graph structure, graph convolution, and modeling temporal dependency using a Transformer-based architecture. The connection learning policy, which is based on the Gumbel-softmax sampling approach to learn bi-directed links among sensors directly, is at the heart of learning graph structure. To describe the anomaly information flow between network nodes, we introduced a new graph convolution called Influence Propagation convolution. In addition, to tackle the quadratic complexity barrier, we suggested a multi-branch attention mechanism to replace the original multi-head self-attention method. Extensive experiments on four publicly available anomaly detection benchmarks further demonstrate the superiority of our approach over alternative state-of-the-arts. Codes are available at https://github.com/ZEKAICHEN/GTA.

cs.LG↗

arXiv2022

Combining Reinforcement Learning and Inverse Reinforcement Learning for Asset Allocation Recommendations

We suggest a simple practical method to combine the human and artificial intelligence to both learn best investment practices of fund managers, and provide recommendations to improve them. Our approach is based on a combination of Inverse Reinforcement Learning (IRL) and RL. First, the IRL component learns the intent of fund managers as suggested by their trading history, and recovers their implied reward function. At the second step, this reward function is used by a direct RL algorithm to optimize asset allocation decisions. We show that our method is able to improve over the performance of individual fund managers.

cs.LG↗

arXiv2021

Photochemical Synthesis of P-S-H Ternary Hydride at High Pressures

The recent discovery of room temperature superconductivity (283 K) in carbonaceous sulfur hydride (C-S-H) has attracted lots of interests in ternary hydrogen rich materials. In this report, ternary hydride P-S-H has been synthesized through photochemical reaction from elemental sulfur (S), phosphorus (P) and molecular hydrogen (H2) at high pressures and room temperature. The Raman spectroscopy under pressure shows that H2S and PH3 compounds are synthesized after laser heating at 0.9 GPa and a ternary van der Waals compound P-S-H is synthesized with a further compression to 4.6 GPa. The P-S-H compound is probably a mixed alloy of PH3 and (H2S)2H2 with a guest-host structure similar to the C-S-H system. The ternary hydride can persist up to 35.6 GPa at least and shows two phase transitions at approximately 23.6 GPa and 32.8 GPa, respectively. The P-S-H ternary hydride in this report is a competitive candidate for new hydride superconductors with near room-temperature transitions.

cond-mat.mtrl-sci↗

arXiv2021

Extended high-harmonic spectra through cascade resonance in confined quantum systems

The study of high-harmonic generation in confined quantum systems is vital to establishing a complete physical picture of harmonic generation from atoms and molecules to bulk solids. Based on a multilevel approach, we demonstrate how intraband resonances significantly influence the harmonic spectra via charge pumping to the higher subbands and, thus, redefine the cutoff laws. As a proof of principle, we consider the interaction of graphene nanoribbons, with zigzag as well as armchair terminations, and resonant fields polarized along the cross-ribbon direction. Here, this effect is particularly prominent due to many nearly equi-separated energy levels. In such a scenario, a cascade resonance effect can take place in high-harmonic generation when the field strength is above a critical threshold, which is completely different from the harmonic generation mechanism of atoms, molecules and bulk solids. We further discuss the implications not only for other systems in a nanoribbon geometry, but also systems where only a few subbands (energy levels) meet this frequency-matching condition by considering a generalized multilevel Hamiltonian. Our study highlights that cascade resonance bears fundamentally distinct influence on the laws of harmonic generation, specifically the cutoff laws based on laser duration, field strength, and wavelength, thus unraveling new insights in solid-state high-harmonic generation.

cond-mat.mes-hall↗

arXiv2021

Quasi one-dimensional diffuse laser cooling of atoms

We demonstrate experimentally the generation of one-dimensional cold gases of $^{87}$Rb atoms by diffuse laser cooling (DLC). A horizontal slender vacuum glass tube with length of 105~cm and diameter of 2~cm is used in our experiment. The diffuse laser light inside the tube, which is generated by multi-reflection of injected lasers, cools the background vapor atoms. With 250~mW of cooling light and 50~mW of repumping light, an evenly distributed meter-long profile of atom cloud is obtained. We observe a factor 4 improvement on the atomic OD for a typical cooling duration of 170~ms and a sub-Doppler atomic temperature of 25~$μ$k. The maximum number of detected cold atoms remain constant for a free-fall duration of 30~ms. Such samples are ideal for many quantum optical experiments involving electromagnetically induced transparency, electronically highly excited (Rydberg) atoms and quantum precision measurements.

physics.atom-ph↗

arXiv2021

Hidden Order of Boolean Networks

It is a common belief that the order of a Boolean network is mainly determined by its attractors, including fixed points and cycles. Using semi-tensor product (STP) of matrices and the algebraic state-space representation (ASSR) of Boolean networks, this paper reveals that in addition to this explicit order, there is certain implicit or hidden order, which is determined by the fixed points and limit cycles of their dual networks. The structure and certain properties of dual networks are investigated. Instead of a trajectory, which describes the evolution of a state, hidden order provides a global picture to describe the evolution of the overall network. It is our conjecture that the order of networks is mainly determined by the dual attractors via their corresponding hidden orders. The previously obtained results about Boolean networks are further extended to the k-valued case.

eess.SY↗

arXiv2021

Self-distillation with Batch Knowledge Ensembling Improves ImageNet Classification

The recent studies of knowledge distillation have discovered that ensembling the "dark knowledge" from multiple teachers or students contributes to creating better soft targets for training, but at the cost of significantly more computations and/or parameters. In this work, we present BAtch Knowledge Ensembling (BAKE) to produce refined soft targets for anchor images by propagating and ensembling the knowledge of the other samples in the same mini-batch. Specifically, for each sample of interest, the propagation of knowledge is weighted in accordance with the inter-sample affinities, which are estimated on-the-fly with the current network. The propagated knowledge can then be ensembled to form a better soft target for distillation. In this way, our BAKE framework achieves online knowledge ensembling across multiple samples with only a single network. It requires minimal computational and memory overhead compared to existing knowledge ensembling methods. Extensive experiments demonstrate that the lightweight yet effective BAKE consistently boosts the classification performance of various architectures on multiple datasets, e.g., a significant +0.7% gain of Swin-T on ImageNet with only +1.5% computational overhead and zero additional parameters. BAKE does not only improve the vanilla baselines, but also surpasses the single-network state-of-the-arts on all the benchmarks.

cs.CV↗

arXiv2021

Normalized Diversification

Generating diverse yet specific data is the goal of the generative adversarial network (GAN), but it suffers from the problem of mode collapse. We introduce the concept of normalized diversity which force the model to preserve the normalized pairwise distance between the sparse samples from a latent parametric distribution and their corresponding high-dimensional outputs. The normalized diversification aims to unfold the manifold of unknown topology and non-uniform distribution, which leads to safe interpolation between valid latent variables. By alternating the maximization over the pairwise distance and updating the total distance (normalizer), we encourage the model to actively explore in the high-dimensional output space. We demonstrate that by combining the normalized diversity loss and the adversarial loss, we generate diverse data without suffering from mode collapsing. Experimental results show that our method achieves consistent improvement on unsupervised image generation, conditional image generation and hand pose estimation over strong baselines.

cs.CV↗

arXiv2021

Synthesis and structure of carbon doped H3S compounds at high pressure

Understanding of recently reported putative close-to-room-temperature superconductivity in C-S-H compounds at 267 GPa demands reproducible synthesis protocol as well as knowledge of its structure and composition. We synthesized C-S-H compounds with various carbon composition at high pressures from elemental C and methane CH4, sulfur S, and molecular hydrogen H2. Here we focus on compounds synthesized using methane as these allow a straightforward determination of their structure and composition by combining single-crystal X-ray diffraction (XRD) and Raman spectroscopy. We applied a two-stage synthesis of ((CH4)x(H2S)(1-x))2H2 compounds by first reacting sulfur and mixed methane-hydrogen fluids and forming CH4 doped H2S crystals at 0.5-3 GPa, and then by growing single crystals of the desired hydrogen rich compound. Raman spectroscopy applied to this material shows the presence of the CH4 molecules incorporated into the lattice and allows to determine the CH4 content, while single-crystal X-ray diffraction results suggest that the methane molecules substitute H2S ones. The structural behavior of these compounds is very similar to the previously investigated methane free compounds demonstrating a transition from Al2Cu type I4/mcm structure to a modulated structure at 20-30 GPa and back to the same basic structure in an extended modification with greatly modified Raman spectra. This latter phase demonstrates a distortion into Pnma structure at 132-159 GPa and then transforms into a common Im-3m H3S phase at higher pressures, however, no structural anomaly is detected near 220 GPa, where a sharp upturn in Tc has been reported.

cond-mat.mtrl-sci↗

arXiv2021

A Divide-and-Merge Point Cloud Clustering Algorithm for LiDAR Panoptic Segmentation

Clustering objects from the LiDAR point cloud is an important research problem with many applications such as autonomous driving. To meet the real-time requirement, existing research proposed to apply the connected-component-labeling (CCL) technique on LiDAR spherical range image with a heuristic condition to check if two neighbor points are connected. However, LiDAR range image is different from a binary image which has a deterministic condition to tell if two pixels belong to the same component. The heuristic condition used on the LiDAR range image only works empirically, which suggests the LiDAR clustering algorithm should be robust to potential failures of the empirical heuristic condition. To overcome this challenge, this paper proposes a divide-and-merge LiDAR clustering algorithm. This algorithm firstly conducts clustering in each evenly divided local region, then merges the local clustered small components by voting on edge point pairs. Assuming there are $N$ LiDAR points of objects in total with $m$ divided local regions, the time complexity of the proposed algorithm is $O(N)+O(m^2)$. A smaller $m$ means the voting will involve more neighbor points, but the time complexity will become larger. So the $m$ controls the trade-off between the time complexity and the clustering accuracy. A proper $m$ helps the proposed algorithm work in real-time as well as maintain good performance. We evaluate the divide-and-merge clustering algorithm on the SemanticKITTI panoptic segmentation benchmark by cascading it with a state-of-the-art semantic segmentation model. The final performance evaluated through the leaderboard achieves the best among all published methods. The proposed algorithm is implemented with C++ and wrapped as a python function. It can be easily used with the modern deep learning framework in python.

cs.CV↗

arXiv2021

Multi-UAV Cooperative Trajectory for Servicing Dynamic Demands and Charging Battery

Unmanned Aerial Vehicle (UAV) technology is a promising solution for providing high-quality mobile services to ground users, where a UAV with limited service coverage travels among multiple geographical user locations (e.g., hotspots) for servicing their demands locally. How to dynamically determine a UAV swarm's cooperative path planning to best meet many users' spatio-temporally distributed demands is an important question but is unaddressed in the literature. To our best knowledge, this paper is the first to design and analyze cooperative path planning algorithms of a large UAV swarm for optimally servicing many spatial locations, where ground users' demands are released dynamically in the long time horizon. Regarding a single UAV's path planning design, we manage to substantially simplify the traditional dynamic program and propose an optimal algorithm of low computation complexity, which is only polynomial with respect to both the numbers of spatial locations and user demands. After coordinating a large number $K$ of UAVs, this simplified dynamic optimization problem becomes intractable and we alternatively present a fast iterative cooperation algorithm with provable approximation ratio $1-(1-\frac{1}{K})^{K}$ in the worst case, which is proved to obviously outperform the traditional approach of partitioning UAVs to serve different location clusters separately. To relax UAVs' battery capacity limit for sustainable service provisioning, we further allow UAVs to travel to charging stations in the mean time and thus jointly design UAVs' path planning over users' locations and charging stations. Despite of the problem difficulty, for the optimal solution, we successfully transform the problem to an integer linear program by creating novel directed acyclic graph of the UAV-state transition diagram, and propose an iterative algorithm with constant approximation ratio.

cs.NI↗

arXiv2021

Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification

Unsupervised object re-identification targets at learning discriminative representations for object retrieval without any annotations. Clustering-based methods conduct training with the generated pseudo labels and currently dominate this research direction. However, they still suffer from the issue of pseudo label noise. To tackle the challenge, we propose to properly estimate pseudo label similarities between consecutive training generations with clustering consensus and refine pseudo labels with temporally propagated and ensembled pseudo labels. To the best of our knowledge, this is the first attempt to leverage the spirit of temporal ensembling to improve classification with dynamically changing classes over generations. The proposed pseudo label refinery strategy is simple yet effective and can be seamlessly integrated into existing clustering-based unsupervised re-identification methods. With our proposed approach, state-of-the-art method can be further boosted with up to 8.8% mAP improvements on the challenging MSMT17 dataset.

cs.CV↗

arXiv2021

DCAP: Deep Cross Attentional Product Network for User Response Prediction

User response prediction, which aims to predict the probability that a user will provide a predefined positive response in a given context such as clicking on an ad or purchasing an item, is crucial to many industrial applications such as online advertising, recommender systems, and search ranking. However, due to the high dimensionality and super sparsity of the data collected in these tasks, handcrafting cross features is inevitably time expensive. Prior studies in predicting user response leveraged the feature interactions by enhancing feature vectors with products of features to model second-order or high-order cross features, either explicitly or implicitly. Nevertheless, these existing methods can be hindered by not learning sufficient cross features due to model architecture limitations or modeling all high-order feature interactions with equal weights. This work aims to fill this gap by proposing a novel architecture Deep Cross Attentional Product Network (DCAP), which keeps cross network's benefits in modeling high-order feature interactions explicitly at the vector-wise level. Beyond that, it can differentiate the importance of different cross features in each network layer inspired by the multi-head attention mechanism and Product Neural Network (PNN), allowing practitioners to perform a more in-depth analysis of user behaviors. Additionally, our proposed model can be easily implemented and train in parallel. We conduct comprehensive experiments on three real-world datasets. The results have robustly demonstrated that our proposed model DCAP achieves superior prediction performance compared with the state-of-the-art models. Public codes are available at https://github.com/zachstarkk/DCAP.

cs.LG↗

arXiv2021

A Technical Survey and Evaluation of Traditional Point Cloud Clustering Methods for LiDAR Panoptic Segmentation

LiDAR panoptic segmentation is a newly proposed technical task for autonomous driving. In contrast to popular end-to-end deep learning solutions, we propose a hybrid method with an existing semantic segmentation network to extract semantic information and a traditional LiDAR point cloud cluster algorithm to split each instance object. We argue geometry-based traditional clustering algorithms are worth being considered by showing a state-of-the-art performance among all published end-to-end deep learning solutions on the panoptic segmentation leaderboard of the SemanticKITTI dataset. To our best knowledge, we are the first to attempt the point cloud panoptic segmentation with clustering algorithms. Therefore, instead of working on new models, we give a comprehensive technical survey in this paper by implementing four typical cluster methods and report their performances on the benchmark. Those four cluster methods are the most representative ones with real-time running speed. They are implemented with C++ in this paper and then wrapped as a python function for seamless integration with the existing deep learning frameworks. We release our code for peer researchers who might be interested in this problem.

cs.CV↗

arXiv2021

Mott insulating state and $d+id$ superconductivity in an ABC graphene trilayer

Motivated by the recently experimental reported signatures of the tunable Mott insulating state and superconductivity in an ABC graphene trilayer superlattice, we investigate the charge compressibility, the spin correlation, and the superconducting instability within the Hubbard model on a three-layer honeycomb lattice. It is found that an antiferromagnetically ordered Mott insulator emerges beyond a critical $U_c$ at half-filling, and the electronic correlation drives a $d+id$ superconducting pairing to be dominant over other pairing patterns in a wide doped region. The effective pairing interaction with $d+id$ pairing symmetry is strongly enhanced with the increasing of on-site interaction, and suppressed as the interlayer coupling strength increases. Our intensive numerical results demonstrate that the insulating state and superconductivity in an ABC graphene trilayer are driven by strong electric correlation, and it may offer an attractive systems to explore rich correlated behaviors.

cond-mat.str-el↗

arXiv2021

RSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object Detection

The detection of 3D objects from LiDAR data is a critical component in most autonomous driving systems. Safe, high speed driving needs larger detection ranges, which are enabled by new LiDARs. These larger detection ranges require more efficient and accurate detection models. Towards this goal, we propose Range Sparse Net (RSN), a simple, efficient, and accurate 3D object detector in order to tackle real time 3D object detection in this extended detection regime. RSN predicts foreground points from range images and applies sparse convolutions on the selected foreground points to detect objects. The lightweight 2D convolutions on dense range images results in significantly fewer selected foreground points, thus enabling the later sparse convolutions in RSN to efficiently operate. Combining features from the range image further enhance detection accuracy. RSN runs at more than 60 frames per second on a 150m x 150m detection region on Waymo Open Dataset (WOD) while being more accurate than previously published detectors. As of 11/2020, RSN is ranked first in the WOD leaderboard based on the APH/LEVEL 1 metrics for LiDAR-based pedestrian and vehicle detection, while being several times faster than alternatives.

cs.CV↗