arXiv subjects

Li Zhang

Publications and source records attributed to Li Zhang.

At least 667 records · Page 37Linked to original sources

arXiv2022

ImpDet: Exploring Implicit Fields for 3D Object Detection

Conventional 3D object detection approaches concentrate on bounding boxes representation learning with several parameters, i.e., localization, dimension, and orientation. Despite its popularity and universality, such a straightforward paradigm is sensitive to slight numerical deviations, especially in localization. By exploiting the property that point clouds are naturally captured on the surface of objects along with accurate location and intensity information, we introduce a new perspective that views bounding box regression as an implicit function. This leads to our proposed framework, termed Implicit Detection or ImpDet, which leverages implicit field learning for 3D object detection. Our ImpDet assigns specific values to points in different local 3D spaces, thereby high-quality boundaries can be generated by classifying points inside or outside the boundary. To solve the problem of sparsity on the object surface, we further present a simple yet efficient virtual sampling strategy to not only fill the empty region, but also learn rich semantic features to help refine the boundaries. Extensive experimental results on KITTI and Waymo benchmarks demonstrate the effectiveness and robustness of unifying implicit fields into object detection.

cs.CV↗

arXiv2022

ALX: Large Scale Matrix Factorization on TPUs

We present ALX, an open-source library for distributed matrix factorization using Alternating Least Squares, written in JAX. Our design allows for efficient use of the TPU architecture and scales well to matrix factorization problems of O(B) rows/columns by scaling the number of available TPU cores. In order to spur future research on large scale matrix factorization methods and to illustrate the scalability properties of our own implementation, we also built a real world web link prediction dataset called WebGraph. This dataset can be easily modeled as a matrix factorization problem. We created several variants of this dataset based on locality and sparsity properties of sub-graphs. The largest variant of WebGraph has around 365M nodes and training a single epoch finishes in about 20 minutes with 256 TPU cores. We include speed and performance numbers of ALX on all variants of WebGraph. Both the framework code and the dataset is open-sourced.

cs.LG↗

arXiv2022

BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-training

Multiple datasets and open challenges for object detection have been introduced in recent years. To build more general and powerful object detection systems, in this paper, we construct a new large-scale benchmark termed BigDetection. Our goal is to simply leverage the training data from existing datasets (LVIS, OpenImages and Object365) with carefully designed principles, and curate a larger dataset for improved detector pre-training. Specifically, we generate a new taxonomy which unifies the heterogeneous label spaces from different sources. Our BigDetection dataset has 600 object categories and contains over 3.4M training images with 36M bounding boxes. It is much larger in multiple dimensions than previous benchmarks, which offers both opportunities and challenges. Extensive experiments demonstrate its validity as a new benchmark for evaluating different object detection methods, and its effectiveness as a pre-training dataset.

cs.CV↗

arXiv2022

Discovery of a maximally charged Weyl point

The hypothetical Weyl particles in high-energy physics have been discovered in three-dimensional crystals as collective quasiparticle excitations near two-fold degenerate Weyl points. Such momentum-space Weyl particles carry quantized chiral charges, which can be measured by counting the number of Fermi arcs emanating from the corresponding Weyl points. It is known that merging unit-charged Weyl particles can create new ones with more charges. However, only very recently has it been realised that there is an upper limit - the maximal charge number that a two-fold Weyl point can host is four - achievable only in crystals without spin-orbit coupling. Here, we report the experimental realisation of such a maximally charged Weyl point in a three-dimensional photonic crystal. The four charges support quadruple-helicoid Fermi arcs, forming an unprecedented topology of two non-contractible loops in the surface Brillouin zone. The helicoid Fermi arcs also exhibit the long-pursued type-II van Hove singularities that can reside at arbitrary momenta. This discovery reveals a type of maximally charged Weyl particles beyond conventional topological particles in crystals.

cond-mat.mes-hall↗

arXiv2022

Show Me More Details: Discovering Hierarchies of Procedures from Semi-structured Web Data

Procedures are inherently hierarchical. To "make videos", one may need to "purchase a camera", which in turn may require one to "set a budget". While such hierarchical knowledge is critical for reasoning about complex procedures, most existing work has treated procedures as shallow structures without modeling the parent-child relation. In this work, we attempt to construct an open-domain hierarchical knowledge-base (KB) of procedures based on wikiHow, a website containing more than 110k instructional articles, each documenting the steps to carry out a complex procedure. To this end, we develop a simple and efficient method that links steps (e.g., "purchase a camera") in an article to other articles with similar goals (e.g., "how to choose a camera"), recursively constructing the KB. Our method significantly outperforms several strong baselines according to automatic evaluation, human judgment, and application to downstream tasks such as instructional video retrieval. A demo with partial data can be found at https://wikihow-hierarchy.github.io. The code and the data are at https://github.com/shuyanzhou/wikihow_hierarchy.

cs.CL↗

arXiv2022

Multi-Scale Context-Guided Lumbar Spine Disease Identification with Coarse-to-fine Localization and Classification

Accurate and efficient lumbar spine disease identification is crucial for clinical diagnosis. However, existing deep learning models with millions of parameters often fail to learn with only hundreds or dozens of medical images. These models also ignore the contextual relationship between adjacent objects, such as between vertebras and intervertebral discs. This work introduces a multi-scale context-guided network with coarse-to-fine localization and classification, named CCF-Net, for lumbar spine disease identification. Specifically, in learning, we divide the localization objective into two parallel tasks, coarse and fine, which are more straightforward and effectively reduce the number of parameters and computational cost. The experimental results show that the coarse-to-fine design presents the potential to achieve high performance with fewer parameters and data requirements. Moreover, the multi-scale context-guided module can significantly improve the performance by 6.45% and 5.51% with ResNet18 and ResNet50, respectively. Our code is available at https://github.com/czifan/CCFNet.pytorch.

cs.CV↗

arXiv2022

A general framework for adaptive two-index fusion attribute weighted naive Bayes

Naive Bayes(NB) is one of the essential algorithms in data mining. However, it is rarely used in reality because of the attribute independent assumption. Researchers have proposed many improved NB methods to alleviate this assumption. Among these methods, due to high efficiency and easy implementation, the filter attribute weighted NB methods receive great attentions. However, there still exists several challenges, such as the poor representation ability for single index and the fusion problem of two indexes. To overcome above challenges, we propose a general framework for Adaptive Two-index Fusion attribute weighted NB(ATFNB). Two types of data description category are used to represent the correlation between classes and attributes, intercorrelation between attributes and attributes, respectively. ATFNB can select any one index from each category. Then, we introduce a switching factor \{beta} to fuse two indexes, which can adaptively adjust the optimal ratio of the two index on various datasets. And a quick algorithm is proposed to infer the optimal interval of switching factor \{beta}. Finally, the weight of each attribute is calculated using the optimal value \{beta} and is integrated into NB classifier to improve the accuracy. The experimental results on 50 benchmark datasets and a Flavia dataset show that ATFNB outperforms the basic NB and state-of-the-art filter weighted NB models. In addition, the ATFNB framework can improve the existing two-index NB model by introducing the adaptive switching factor \{beta}. Auxiliary experimental results demonstrate the improved model significantly increases the accuracy compared to the original model without the adaptive switching factor \{beta}.

cs.LG↗

arXiv2022

SGM3D: Stereo Guided Monocular 3D Object Detection

Monocular 3D object detection aims to predict the object location, dimension and orientation in 3D space alongside the object category given only a monocular image. It poses a great challenge due to its ill-posed property which is critically lack of depth information in the 2D image plane. While there exist approaches leveraging off-the-shelve depth estimation or relying on LiDAR sensors to mitigate this problem, the dependence on the additional depth model or expensive equipment severely limits their scalability to generic 3D perception. In this paper, we propose a stereo-guided monocular 3D object detection framework, dubbed SGM3D, adapting the robust 3D features learned from stereo inputs to enhance the feature for monocular detection. We innovatively present a multi-granularity domain adaptation (MG-DA) mechanism to exploit the network's ability to generate stereo-mimicking features given only on monocular cues. Coarse BEV feature-level, as well as the fine anchor-level domain adaptation, are both leveraged for guidance in the monocular domain.In addition, we introduce an IoU matching-based alignment (IoU-MA) method for object-level domain adaptation between the stereo and monocular predictions to alleviate the mismatches while adopting the MG-DA. Extensive experiments demonstrate state-of-the-art results on KITTI and Lyft datasets.

cs.CV↗

arXiv2022

Learning from Mistakes -- A Framework for Neural Architecture Search

Learning from one's mistakes is an effective human learning technique where the learners focus more on the topics where mistakes were made, so as to deepen their understanding. In this paper, we investigate if this human learning strategy can be applied in machine learning. We propose a novel machine learning method called Learning From Mistakes (LFM), wherein the learner improves its ability to learn by focusing more on the mistakes during revision. We formulate LFM as a three-stage optimization problem: 1) learner learns; 2) learner re-learns focusing on the mistakes, and; 3) learner validates its learning. We develop an efficient algorithm to solve the LFM problem. We apply the LFM framework to neural architecture search on CIFAR-10, CIFAR-100, and Imagenet. Experimental results strongly demonstrate the effectiveness of our model.

cs.LG↗

arXiv2021

Multi-band Emission up to PeV Energy from the Crab Nebula in a Spatially Dependent Lepto-hadronic Model

Multi-band emission from radio to ultra-high energy gamma-rays in the Crab Nebula has been detected. To explain the observed results, non-thermal photon production \textbf{in} the Crab Nebula is carefully studied in a spatially dependent lepto-hadronic model. In our model, the dynamical evolution of the PWN is simulated in a spherically symmetric system. Both electrons and protons are accelerated at the termination shock. The relevant particle propagation equations as well as the photon evolving equation are simultaneously solved. For the Crab Nebula, our results reveal that the observed multi-band photon spectra can be well reproduced with reasonable model parameters. In particular, the photons with energy $\gtrsim 200$ TeV are mainly contributed by the hadronic component via proton-proton interaction. The contribution of the hadronic component depends on both proton spectral index $α_{\rm p}$ and number density $n_{\rm H}$ of medium within the PWN. Besides, high energy neutrino fluxes are predicted with variable proton spectral indices. The predicted fluxes are not only far below the sensitivities of current neutrino observatories, but also beneath the atmospheric neutrino background with energy less than $\sim 40$ TeV. Moreover, the calculated radial profiles of surface brightness and spectral index are presented.

astro-ph.HE↗

arXiv2021

Validity of equivalent photon spectra and the photoproduction processes in p-p collisions

Through a consistent analysis of the terms neglected in going from the accurate expression to the one of Weizsäcker-Williams approximation (WWA), the validity of equivalent photon spectra is studied, and a modified photon flux of proton is also derived. We take the photoproductions of photons and dileptons as examples, to provide the comparison between the exact results and the ones based on various photon fluxes. We present the results for the distributions in $Q^{2}$ (virtuality of photons), $y$ and $p_{T}$, the total cross sections are also estimated. The numerical results show that the modified equivalent photon spectrum reproduces the exact result within less than one percent. And the corrections of photoproduction processes to the dileptons and photons productions are about $20\%$.

hep-ph↗

arXiv2021

The Devil is in the Task: Exploiting Reciprocal Appearance-Localization Features for Monocular 3D Object Detection

Low-cost monocular 3D object detection plays a fundamental role in autonomous driving, whereas its accuracy is still far from satisfactory. In this paper, we dig into the 3D object detection task and reformulate it as the sub-tasks of object localization and appearance perception, which benefits to a deep excavation of reciprocal information underlying the entire task. We introduce a Dynamic Feature Reflecting Network, named DFR-Net, which contains two novel standalone modules: (i) the Appearance-Localization Feature Reflecting module (ALFR) that first separates taskspecific features and then self-mutually reflects the reciprocal features; (ii) the Dynamic Intra-Trading module (DIT) that adaptively realigns the training processes of various sub-tasks via a self-learning manner. Extensive experiments on the challenging KITTI dataset demonstrate the effectiveness and generalization of DFR-Net. We rank 1st among all the monocular 3D object detectors in the KITTI test set (till March 16th, 2021). The proposed method is also easy to be plug-and-play in many cutting-edge 3D detection frameworks at negligible cost to boost performance. The code will be made publicly available.

cs.CV↗

arXiv2021

A Possible Hadronic Origin of TeV Photon Emission from SNR G106.3+2.7

In our model, the acceleration and propagation of particles from the Bohm-like diffusion region inside the SNR to the Galactic diffusion region outside the SNR are described through nonlinear diffusive shock acceleration (NLDSA). The main content of our NLDSA model is to solve the hydrodynamic equations numerically for gas density, gas velocity, gas pressure as well as the equation for the quasi-isotropic particle momentum distribution. The consequent multi-band non-thermal emission is from two different regions, namely the acceleration region and the escaping region. Our model is capable of explaining the multi-band photon emission via the dominant synchrotron radiation of the electrons accelerated inside the SNR; and the photons with energy of $\gtrsim$ GeV are naturally produced by the protons inside and outside the SNR. Moreover, the photons in the energy range of $\sim 1 - \sim 100$ TeV are due to the interaction of escaped protons with dense molecular clouds. For the photons with energy of $E_γ\gtrsim $ 1 GeV from SNR G106.3+2.7, our results here favor a hadronic origin, where the photons in the energy range of $\sim 1$ GeV to $\sim 1$ TeV are produced inside the SNR through proton-proton interaction, while the photons with $E_γ\gtrsim 1$ TeV originate from the interaction of escaped protons with a dense molecular cloud.

astro-ph.HE↗

arXiv2021

Observation of topologically enabled complete polarization conversion

Exploiting topological ideas has been a major theme in modern photonics, which provides unprecedented opportunities to design photonic devices with robustness against defects and flaws. While most previous works in topological photonics have focused on band theory, recent theoretical advances extend the topological concepts to the analysis of scattering matrices and suggest a topological route to complete polarization conversion (CPC), a unique photonic phenomenon without an electronic counterpart. Here, we report on the experimental observation of the topological effect in reflection matrices of a photonic crystal slab, enabling CPC between two linear polarizations over a wide range of frequencies. Using angle-resolved reflection measurements, we observe CPC occurring at vortex singularities of reflection coefficients in momentum space, verifying the topological nature of CPC. In addition, the topological effect also guarantees the spin-preserved reflection of a circularly polarized wave. Remarkably, we experimentally establish a connection between two seemingly unrelated topological phenomena--CPC and bound states in the continuum (BICs): BICs lie on the critical coupling curves that define the condition for CPC. Our work paves the way to exploring the topological properties in scattering matrices for controlling light polarization and spin and creating robust photonic devices.

physics.class-ph↗

arXiv2021

Beijing ZKJ-NPU Speaker Verification System for VoxCeleb Speaker Recognition Challenge 2021

In this report, we describe the Beijing ZKJ-NPU team submission to the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). We participated in the fully supervised speaker verification track 1 and track 2. In the challenge, we explored various kinds of advanced neural network structures with different pooling layers and objective loss functions. In addition, we introduced the ResNet-DTCF, CoAtNet and PyConv networks to advance the performance of CNN-based speaker embedding model. Moreover, we applied embedding normalization and score normalization at the evaluation stage. By fusing 11 and 14 systems, our final best performances (minDCF/EER) on the evaluation trails are 0.1205/2.8160% and 0.1175/2.8400% respectively for track 1 and 2. With our submission, we came to the second place in the challenge for both tracks.

cs.SD↗

arXiv2021

Acoustic non-Hermitian skin effect from twisted winding topology

The recently discovered non-Hermitian skin effect (NHSE) manifests the breakdown of current classification of topological phases in energy-nonconservative systems, and necessitates the introduction of non-Hermitian band topology. So far, all NHSE observations are based on one type of non-Hermitian band topology, in which the complex energy spectrum winds along a closed loop. As recently characterized along a synthetic dimension on a photonic platform, non-Hermitian band topology can exhibit almost arbitrary windings in momentum space, but their actual phenomena in real physical systems remain unclear. Here, we report the experimental realization of NHSE in a one-dimensional (1D) non-reciprocal acoustic crystal. With direct acoustic measurement, we demonstrate that a twisted winding, whose topology consists of two oppositely oriented loops in contact rather than a single loop, will dramatically change the NHSE, following previous predictions of unique features such as the bipolar localization and the Bloch point for a Bloch-wave-like extended state. This work reveals previously unnoticed features of NHSE, and provides the observation of physical phenomena originating from complex non-Hermitian winding topology.

physics.app-ph↗

arXiv2021

From Cloud to Edge: A First Look at Public Edge Platforms

Public edge platforms have drawn increasing attention from both academia and industry. In this study, we perform a first-of-its-kind measurement study on a leading public edge platform that has been densely deployed in China. Based on this measurement, we quantitatively answer two critical yet unexplored questions. First, from end users' perspective, what is the performance of commodity edge platforms compared to cloud, in terms of the end-to-end network delay, throughput, and the application QoE. Second, from the edge service provider's perspective, how are the edge workloads different from cloud, in terms of their VM subscription, monetary cost, and resource usage. Our study quantitatively reveals the status quo of today's public edge platforms, and provides crucial insights towards developing and operating future edge services.

cs.NI↗

arXiv2021

Revisiting the Performance of iALS on Item Recommendation Benchmarks

Matrix factorization learned by implicit alternating least squares (iALS) is a popular baseline in recommender system research publications. iALS is known to be one of the most computationally efficient and scalable collaborative filtering methods. However, recent studies suggest that its prediction quality is not competitive with the current state of the art, in particular autoencoders and other item-based collaborative filtering methods. In this work, we revisit the iALS algorithm and present a bag of tricks that we found useful when applying iALS. We revisit four well-studied benchmarks where iALS was reported to perform poorly and show that with proper tuning, iALS is highly competitive and outperforms any method on at least half of the comparisons. We hope that these high quality results together with iALS's known scalability spark new interest in applying and further improving this decade old technique.

cs.IR↗