arXiv subjects

Hao Shi

Publications and source records attributed to Hao Shi.

At least 145 records · Page 8Linked to original sources

arXiv2022

Heavy fermion representation for twisted bilayer graphene systems

We construct a heavy fermion representation for twisted bilayer graphene (TBG) systems. Two local orbitals (per spin/valley) are analytically found, which are exactly the maximally localized zero modes of the continuum Hamiltonian near the AA-stacking center. They have similar properties to the Wannier functions in [arXiv:2111.05865v2], but also have a clear interpretation as the zeroth pseudo Landau levels (ZLL) of Dirac fermions under the uniform strain field created by twisting [arXiv:1810.03103v3]. The electronic states of TBG can be viewed as the hybridization between these ZLL orbitals and other itinerant states which can be obtained following the standard procedure of orthogonalized plane wave method. The "heavy fermion" model for TBG separates the strongly correlated components from the itinerant components and provides a solid base for the comprehensive understanding of the exotic physics in TBG.

cond-mat.str-el↗

arXiv2022

Monolingual Recognizers Fusion for Code-switching Speech Recognition

The bi-encoder structure has been intensively investigated in code-switching (CS) automatic speech recognition (ASR). However, most existing methods require the structures of two monolingual ASR models (MAMs) should be the same and only use the encoder of MAMs. This leads to the problem that pre-trained MAMs cannot be timely and fully used for CS ASR. In this paper, we propose a monolingual recognizers fusion method for CS ASR. It has two stages: the speech awareness (SA) stage and the language fusion (LF) stage. In the SA stage, acoustic features are mapped to two language-specific predictions by two independent MAMs. To keep the MAMs focused on their own language, we further extend the language-aware training strategy for the MAMs. In the LF stage, the BELM fuses two language-specific predictions to get the final prediction. Moreover, we propose a text simulation strategy to simplify the training process of the BELM and reduce reliance on CS data. Experiments on a Mandarin-English corpus show the efficiency of the proposed method. The mix error rate is significantly reduced on the test set after using open-source pre-trained MAMs.

eess.AS↗

arXiv2022

Review on Panoramic Imaging and Its Applications in Scene Understanding

With the rapid development of high-speed communication and artificial intelligence technologies, human perception of real-world scenes is no longer limited to the use of small Field of View (FoV) and low-dimensional scene detection devices. Panoramic imaging emerges as the next generation of innovative intelligent instruments for environmental perception and measurement. However, while satisfying the need for large-FoV photographic imaging, panoramic imaging instruments are expected to have high resolution, no blind area, miniaturization, and multidimensional intelligent perception, and can be combined with artificial intelligence methods towards the next generation of intelligent instruments, enabling deeper understanding and more holistic perception of 360-degree real-world surrounding environments. Fortunately, recent advances in freeform surfaces, thin-plate optics, and metasurfaces provide innovative approaches to address human perception of the environment, offering promising ideas beyond conventional optical imaging. In this review, we begin with introducing the basic principles of panoramic imaging systems, and then describe the architectures, features, and functions of various panoramic imaging systems. Afterwards, we discuss in detail the broad application prospects and great design potential of freeform surfaces, thin-plate optics, and metasurfaces in panoramic imaging. We then provide a detailed analysis on how these techniques can help enhance the performance of panoramic imaging systems. We further offer a detailed analysis of applications of panoramic imaging in scene understanding for autonomous driving and robotics, spanning panoramic semantic image segmentation, panoramic depth estimation, panoramic visual localization, and so on. Finally, we cast a perspective on future potential and research directions for panoramic imaging instruments.

cs.CV↗

arXiv2022

Two Piggybacking Codes with Flexible Sub-Packetization to Achieve Lower Repair Bandwidth

As a special class of array codes, $(n,k,m)$ piggybacking codes are MDS codes (i.e., any $k$ out of $n$ nodes can retrieve all data symbols) that can achieve low repair bandwidth for single-node failure with low sub-packetization $m$. In this paper, we propose two new piggybacking codes that have lower repair bandwidth than the existing piggybacking codes given the same parameters. Our first piggybacking codes can support flexible sub-packetization $m$ with $2\leq m\leq n-k$, where $n - k > 3$. We show that our first piggybacking codes have lower repair bandwidth for any single-node failure than the existing piggybacking codes when $n - k = 8,9$, $m = 6$ and $30\leq k \leq 100$. Moreover, we propose second piggybacking codes such that the sub-packetization is a multiple of the number of parity nodes (i.e., $(n-k)|m$), by jointly designing the piggyback function for data node repair and transformation function for parity node repair. We show that the proposed second piggybacking codes have lowest repair bandwidth for any single-node failure among all the existing piggybacking codes for the evaluated parameters $k/n = 0.75, 0.8, 0.9$ and $n-k\geq 4$.

cs.IT↗

arXiv2022

Efficient Human Pose Estimation via 3D Event Point Cloud

Human Pose Estimation (HPE) based on RGB images has experienced a rapid development benefiting from deep learning. However, event-based HPE has not been fully studied, which remains great potential for applications in extreme scenes and efficiency-critical conditions. In this paper, we are the first to estimate 2D human pose directly from 3D event point cloud. We propose a novel representation of events, the rasterized event point cloud, aggregating events on the same position of a small time slice. It maintains the 3D features from multiple statistical cues and significantly reduces memory consumption and computation complexity, proved to be efficient in our work. We then leverage the rasterized event point cloud as input to three different backbones, PointNet, DGCNN, and Point Transformer, with two linear layer decoders to predict the location of human keypoints. We find that based on our method, PointNet achieves promising results with much faster speed, whereas Point Transfomer reaches much higher accuracy, even close to previous event-frame-based methods. A comprehensive set of results demonstrates that our proposed method is consistently effective for these 3D backbone models in event-driven human pose estimation. Our method based on PointNet with 2048 points input achieves 82.46mm in MPJPE3D on the DHP19 dataset, while only has a latency of 12.29ms on an NVIDIA Jetson Xavier NX edge computing platform, which is ideally suitable for real-time detection with event cameras. Code is available at https://github.com/MasterHow/EventPointPose.

cs.CV↗

arXiv2022

Precision Many-Body Study of the Berezinskii-Kosterlitz-Thouless Transition and Temperature-Dependent Properties in the Two-Dimensional Fermi Gas

We perform large-scale, numerically exact calculations on the two-dimensional interacting Fermi gas with a contact attraction. Reaching much larger lattice sizes and lower temperatures than previously possible, we determine systematically the finite-temperature phase diagram of the Berezinskii-Kosterlitz-Thouless (BKT) transitions for interaction strengths ranging from BCS to crossover to BEC regimes. The evolutions of the pairing wavefunctions and the fermion and Cooper pair momentum distributions with temperature are accurately characterized. In the crossover regime, we find that the contact has a non-monotonic temperature dependence, first increasing as temperature is lowered, and then showing a slight decline below the BKT transition temperature to approach the ground-state value from above.

cond-mat.quant-gas↗

arXiv2022

LF-VIO: A Visual-Inertial-Odometry Framework for Large Field-of-View Cameras with Negative Plane

Visual-inertial-odometry has attracted extensive attention in the field of autonomous driving and robotics. The size of Field of View (FoV) plays an important role in Visual-Odometry (VO) and Visual-Inertial-Odometry (VIO), as a large FoV enables to perceive a wide range of surrounding scene elements and features. However, when the field of the camera reaches the negative half plane, one cannot simply use [u,v,1]^T to represent the image feature points anymore. To tackle this issue, we propose LF-VIO, a real-time VIO framework for cameras with extremely large FoV. We leverage a three-dimensional vector with unit length to represent feature points, and design a series of algorithms to overcome this challenge. To address the scarcity of panoramic visual odometry datasets with ground-truth location and pose, we present the PALVIO dataset, collected with a Panoramic Annular Lens (PAL) system with an entire FoV of 360°x(40°-120°) and an IMU sensor. With a comprehensive variety of experiments, the proposed LF-VIO is verified on both the established PALVIO benchmark and a public fisheye camera dataset with a FoV of 360°x(0°-93.5°). LF-VIO outperforms state-of-the-art visual-inertial-odometry methods. Our dataset and code are made publicly available at https://github.com/flysoaryun/LF-VIO

cs.CV↗

arXiv2022

Language-specific Characteristic Assistance for Code-switching Speech Recognition

Dual-encoder structure successfully utilizes two language-specific encoders (LSEs) for code-switching speech recognition. Because LSEs are initialized by two pre-trained language-specific models (LSMs), the dual-encoder structure can exploit sufficient monolingual data and capture the individual language attributes. However, most existing methods have no language constraints on LSEs and underutilize language-specific knowledge of LSMs. In this paper, we propose a language-specific characteristic assistance (LSCA) method to mitigate the above problems. Specifically, during training, we introduce two language-specific losses as language constraints and generate corresponding language-specific targets for them. During decoding, we take the decoding abilities of LSMs into account by combining the output probabilities of two LSMs and the mixture model to obtain the final predictions. Experiments show that either the training or decoding method of LSCA can improve the model's performance. Furthermore, the best result can obtain up to 15.4% relative error reduction on the code-switching test set by combining the training and decoding methods of LSCA. Moreover, the system can process code-switching speech recognition tasks well without extra shared parameters or even retraining based on two pre-trained LSMs by using our method.

cs.CL↗

arXiv2022

Solving 2D and 3D lattice models of correlated fermions -- combining matrix product states with mean field theory

Correlated electron states are at the root of many important phenomena including unconventional superconductivity (USC), where electron-pairing arises from repulsive interactions. Computing the properties of correlated electrons, such as the critical temperature $T_c$ for the onset of USC, efficiently and reliably from the microscopic physics with quantitative methods remains a major challenge for almost all models and materials. In this theoretical work we combine matrix product states (MPS) with static mean field (MF) to provide a solution to this challenge for quasi-one-dimensional (Q1D) systems: Two- and three-dimensional (2D/3D) materials comprised of weakly coupled correlated 1D fermions. This MPS+MF framework for the ground state and thermal equilibrium properties of Q1D fermions is developed and validated for attractive Hubbard systems first, and further enhanced via analytical field theory. We then deploy it to compute $T_c$ for superconductivity in 3D arrays of weakly coupled, doped and repulsive Hubbard ladders. The MPS+MF framework thus enables the reliable, quantitative and unbiased study of USC and high-$T_c$ superconductivity - and potentially many more correlated phases - in fermionic Q1D systems from microscopic parameters, in ways inaccessible to previous methods. It opens the possibility of designing deliberately optimized Q1D superconductors, from experiments in ultracold gases to synthesizing new materials.

cond-mat.str-el↗

arXiv2022

DCAN: Diversified News Recommendation with Coverage-Attentive Networks

Self-attention based models are widely used in news recommendation tasks. However, previous Attention architecture does not constrain repeated information in the user's historical behavior, which limits the power of hidden representation and leads to some problems such as information redundancy and filter bubbles. To solve this problem, we propose a personalized news recommendation model called DCAN.It captures multi-grained user-news matching signals through news encoders and user encoders. We keep updating a coverage vector to track the history of news attention and augment the vector in 4 types of ways. Then we fed the augmented Coverage vector into the Multi-headed Self-attention model to help adjust the future attention and added the Coverage regulation to the loss function(CRL), which enabled the recommendation system to consider more about differentiated information. Extensive experiments on Microsoft News Recommendation Dataset (MIND) show that our model significantly improve the diversity of news recommendations with minimal sacrifice in accuracy.

cs.IR↗

arXiv2022

Stripes and spin-density waves in the doped two-dimensional Hubbard model: ground state phase diagram

We determine the spin and charge orders in the ground state of the doped two-dimensional (2D) Hubbard model in its simplest form, namely with only nearest-neighbor hopping and on-site repulsion. At half-filling, the ground state is known to be an anti-ferromagnetic Mott insulator. Doping Mott insulators is believed to be relevant to the superconductivity observed in cuprates. A variety of candidates have been proposed for the ground state of the doped 2D Hubbard model. A recent work employing a combination of several state-of-the-art numerical many-body methods, established the stripe order as the ground state near $1/8$ doping at strong interactions. In this work, we apply one of these methods, the cutting-edge constrained-path auxiliary field quantum Monte Carlo method with self-consistently optimized gauge constraints, to systematically study the model as a function of doping and interaction strength. With careful finite size scaling based on large-scale computations, we map out the ground state phase diagram in terms of its spin and charge order. We find that modulated antiferromagnetic order persists from near half-filling to about $1/5$ doping. At lower interaction strengths or larger doping, these ordered states are best described as spin-density waves, with essentially delocalized holes and modest oscillations in charge correlations. When the charge correlations are stronger (large interaction or small doping), they are best described as stripe states, with the holes more localized near the node in the antiferromagnetic spin order. In both cases, we find that the wavelength in the charge correlations is consistent with so-called filled stripes in the pure Hubbard model.

cond-mat.str-el↗

arXiv2022

An Improved Automatic Modulation Classification Scheme Based on Adaptive Fusion Network

Due to the over-fitting problem caused by imbalance samples, there is still room to improve the performance of data-driven automatic modulation classification (AMC) in noisy scenarios. By fully considering the signal characteristics, an AMC scheme based on adaptive fusion network (AFNet) is proposed in this work. The AFNet can extract and aggregate multi-scale spatial features of in-phase and quadrature (I/Q) signals intelligently, thus improving the feature representation capability. Moreover, a novel confidence weighted loss function is proposed to address the imbalance issue and it is implemented by a two-stage learning scheme.Through the two-stage learning, AFNet can focus on high-confidence samples with more valid information and extract effective representations, so as to improve the overall classification performance. In the simulations, the proposed scheme reaches an average accuracy of 62.66% on a wide range of SNRs, which outperforms other AMC models. The effects of the loss function on classification accuracy are further studied.

eess.SP↗

arXiv2022

CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving

Optical flow estimation is an essential task in self-driving systems, which helps autonomous vehicles perceive temporal continuity information of surrounding scenes. The calculation of all-pair correlation plays an important role in many existing state-of-the-art optical flow estimation methods. However, the reliance on local knowledge often limits the model's accuracy under complex street scenes. In this paper, we propose a new deep network architecture for optical flow estimation in autonomous driving--CSFlow, which consists of two novel modules: Cross Strip Correlation module (CSC) and Correlation Regression Initialization module (CRI). CSC utilizes a striping operation across the target image and the attended image to encode global context into correlation volumes, while maintaining high efficiency. CRI is used to maximally exploit the global context for optical flow initialization. Our method has achieved state-of-the-art accuracy on the public autonomous driving dataset KITTI-2015. Code is publicly available at https://github.com/MasterHow/CSFlow.

cs.CV↗

arXiv2021

Ab initio Calculations in Atoms, Molecules, and Solids, Treating Spin-Orbit Coupling and Electron Interaction on Equal Footing

We incorporate explicit, non-perturbative treatment of spin-orbit coupling into ab initio auxiliary-field quantum Monte Carlo (AFQMC) calculations. The approach allows a general computational framework for molecular and bulk systems in which materials specificity, electron correlation, and spin-orbit coupling effects can be captured accurately and on equal footing, with favorable computational scaling versus system size. We adopt relativistic effective-core potentials which have been obtained by fitting to fully relativistic data and which have demonstrated a high degree of reliability and transferability in molecular systems. This results in a 2-component spin-coupled Hamiltonian, which is then treated by generalizing the ab initio AFQMC approach. We demonstrate the method by computing the electron affinity in Pb, the bond dissociation energy in Br$_2$ and I$_2$, and solid Bi.

cond-mat.str-el↗

arXiv2020

A Pseudo-BCS Wavefunction from Density Matrix Decomposition:Application in Auxiliary-Field Quantum Monte Carlo

We present a method to construct pseudo-BCS wave functions from the one-body density matrix. The resulting many-body wave function, which can be produced for any fermion systems, including those with purely repulsive interactions, has the form of a number-projected BCS form, or antisymmetrized germinal power (AGP). Such wave functions provide a better ansatz for correlated fermion systems than a single Slater determinant, and often better than a linear combination of Slater determinants (for example from a truncated active space calculation). We describe a procedure to build such a wave function conveniently from a given reduced density matrix of the system, rather than from a mean-field solution (which gives a Slater determinant for repulsive interactions). The pseudo-BCS wave function thus obtained reproduces the density matrix or minimizes the difference between the input and resulting density matrices. One application of the pseudo-BCS wave function is in auxiliary-field quantum Monte Carlo (AFQMC) calculations as the trial wave function to control the sign/phase problem. AFQMC is often among the most accurate general methods for correlated fermion systems. We show that the pseudo-BCS form further reduces the constraint bias and leads to improved accuracy compared to the usual Slater determinant trial wave functions, using the two-dimensional Hubbard model as an example. Furthermore, the pseudo-BCS trial wave function allows a new systematically improvable self-consistent approach, with pseudo-BCS trial wave function iteratively generated by AFQMC via the one-body density matrix.

cond-mat.str-el↗

arXiv2020

Some Recent Developments in Auxiliary-Field Quantum Monte Carlo for Real Materials

The auxiliary-field quantum Monte Carlo (AFQMC) method is a general numerical method for correlated many-electron systems, which is being increasingly applied in lattice models, atoms, molecules, and solids. Here we introduce the theory and algorithm of the method specialized for real materials, and present several recent developments. We give a systematic exposition of the key steps of AFQMC, closely tracking the framework of a modern software library we are developing. The building of a Monte Carlo Hamiltonian, projecting to the ground state, sampling two-body operators, phaseless approximation, and measuring ground state properties are discussed in details. An advanced implementation for multi-determinant trial wave functions is described which dramatically speeds up the algorithm and reduces the memory cost. We propose a self-consistent constraint for real materials, and discuss two flavors for its realization, either by coupling the AFQMC calculation to an effective independent-electron calculation, or via the natural orbitals of the computed one-body density matrix.

physics.comp-ph↗

arXiv2020

Absence of superconductivity in the pure two-dimensional Hubbard model

We study the superconducting pairing correlations in the ground state of the doped Hubbard model -- in its original form without hopping beyond nearest neighbor or other perturbing parameters -- in two dimensions at intermediate to strong coupling and near optimal doping. The nature of such correlations has been a central question ever since the discovery of cuprate high-temperature superconductors. Despite unprecedented effort and tremendous progress in understanding the properties of this fundamental model, a definitive answer to whether the ground state is superconducting in the parameter regime most relevant to cuprates has proved exceedingly difficult to establish. In this work, we employ two complementary, state-of-the-art many-body computational methods, constrained path (CP) auxiliary-field quantum Monte Carlo (AFQMC) and density matrix renormalization group (DMRG) methods, deploying the most recent algorithmic advances in each. Systematic and detailed comparisons between the two methods are performed. The DMRG is extremely reliable on small width cylinders, where we use it to validate the AFQMC. The AFQMC is then used to study wide systems as well as fully periodic systems, to establish that we have reached the thermodynamic limit. The ground state is found to be non-superconducting in the moderate to strong coupling regime in the vicinity of optimal hole doping.

cond-mat.str-el↗

arXiv2020

Ground-state properties of the hydrogen chain: insulator-to-metal transition, dimerization, and magnetic phases

Accurate and predictive computations of the quantum-mechanical behavior of many interacting electrons in realistic atomic environments are critical for the theoretical design of materials with desired properties, and require solving the grand-challenge problem of the many-electron Schrodinger equation. An infinite chain of equispaced hydrogen atoms is perhaps the simplest realistic model for a bulk material, embodying several central themes of modern condensed matter physics and chemistry, while retaining a connection to the paradigmatic Hubbard model. Here we report a combined application of cutting-edge computational methods to determine the properties of the hydrogen chain in its quantum-mechanical ground state. Varying the separation between the nuclei leads to a rich phase diagram, including a Mott phase with quasi long-range antiferromagnetic order, electron density dimerization with power-law correlations, an insulator-to-metal transition and an intricate set of intertwined magnetic orders.

cond-mat.str-el↗