arXiv subjects

Li Zhang

Publications and source records attributed to Li Zhang.

At least 631 records · Page 35Linked to original sources

arXiv2022

Stable interaction-induced Anderson-like localization embedded in standing waves

We uncover the interaction-induced \emph{stable self-localization} of bosons in disorder-free superlattices. In these nonthermalized multi-particle states, one of the particles forms a superposition of multiple standing waves, so that it provides a quasirandom potential to localize the other particles. We derive effective Hamiltonians for self-localized states and find their energy level spacings obeying the Poisson statistics for Anderson-like localization. Surprisingly, we find that the correlated self-localization can be solely induced by interaction in the well-studied nonintegrable Bose-Hubbard models, which has been overlooked for a long time. We propose a dynamical scheme to detect self-localization, where long-time quantum walks of a single particle form a superposition of multiple standing waves for trapping the subsequently loaded particles. Our work provides an experimentally feasible way to realize stable Anderson-like localization in translation-invariant disorder-free systems.

quant-ph↗

arXiv2022

Data-Driven Deep Supervision for Skin Lesion Classification

Automatic classification of pigmented, non-pigmented, and depigmented non-melanocytic skin lesions have garnered lots of attention in recent years. However, imaging variations in skin texture, lesion shape, depigmentation contrast, lighting condition, etc. hinder robust feature extraction, affecting classification accuracy. In this paper, we propose a new deep neural network that exploits input data for robust feature extraction. Specifically, we analyze the convolutional network's behavior (field-of-view) to find the location of deep supervision for improved feature extraction. To achieve this, first, we perform activation mapping to generate an object mask, highlighting the input regions most critical for classification output generation. Then the network layer whose layer-wise effective receptive field matches the approximated object shape in the object mask is selected as our focus for deep supervision. Utilizing different types of convolutional feature extractors and classifiers on three melanoma detection datasets and two vitiligo detection datasets, we verify the effectiveness of our new method.

cs.CV↗

arXiv2022

Scalable Nanophotonic-Electronic Spiking Neural Networks

Spiking neural networks (SNN) provide a new computational paradigm capable of highly parallelized, real-time processing. Photonic devices are ideal for the design of high-bandwidth, parallel architectures matching the SNN computational paradigm. Co-integration of CMOS and photonic elements allow low-loss photonic devices to be combined with analog electronics for greater flexibility of nonlinear computational elements. As such, we designed and simulated an optoelectronic spiking neuron circuit on a monolithic silicon photonics (SiPh) process that replicates useful spiking behaviors beyond the leaky integrate-and-fire (LIF). Additionally, we explored two learning algorithms with the potential for on-chip learning using Mach-Zehnder Interferometric (MZI) meshes as synaptic interconnects. A variation of Random Backpropagation (RPB) was experimentally demonstrated on-chip and matched the performance of a standard linear regression on a simple classification task. Meanwhile, the Contrastive Hebbian Learning (CHL) rule was applied to a simulated neural network composed of MZI meshes for a random input-output mapping task. The CHL-trained MZI network performed better than random guessing but does not match the performance of the ideal neural network (without the constraints imposed by the MZI meshes). Through these efforts, we demonstrate that co-integrated CMOS and SiPh technologies are well-suited to the design of scalable SNN computing architectures.

cs.NE↗

arXiv2022

Hierarchical Reinforcement Learning Based Video Semantic Coding for Segmentation

The rapid development of intelligent tasks, e.g., segmentation, detection, classification, etc, has brought an urgent need for semantic compression, which aims to reduce the compression cost while maintaining the original semantic information. However, it is impractical to directly integrate the semantic metric into the traditional codecs since they cannot be optimized in an end-to-end manner. To solve this problem, some pioneering works have applied reinforcement learning to implement image-wise semantic compression. Nevertheless, video semantic compression has not been explored since its complex reference architectures and compression modes. In this paper, we take a step forward to video semantic compression and propose the Hierarchical Reinforcement Learning based task-driven Video Semantic Coding, named as HRLVSC. Specifically, to simplify the complex mode decision of video semantic coding, we divided the action space into frame-level and CTU-level spaces in a hierarchical manner, and then explore the best mode selection for them progressively with the cooperation of frame-level and CTU-level agents. Moreover, since the modes of video semantic coding will exponentially increase with the number of frames in a Group of Pictures (GOP), we carefully investigate the effects of different mode selections for video semantic coding and design a simple but effective mode simplification strategy for it. We have validated our HRLVSC on the video segmentation task with HEVC reference software HM16.19. Extensive experimental results demonstrated that our HRLVSC can achieve over 39% BD-rate saving for video semantic coding under the Low Delay P configuration.

eess.IV↗

arXiv2022

Fabrication and characterization of InSb nanosheet/hBN/graphite heterostructure devices

Semiconductor InSb nanosheet/hexagonal boron nitride (hBN)/graphite trilayers are fabricated, and single- and double-gate devices made from the trilayers are realized and characterized. The InSb nanosheets employed in the trilayer devices are epitaxially grown, free-standing, zincblende crystals and are in micrometer lateral sizes. The hBN and graphite flakes are obtained by exfoliation. Each trilayer is made by successively stacking an InSb nanosheet on an hBN flake and on a graphite flake using a home-made alignment stacking/transfer setup. The fabricated single- and double-gate devices are characterized by electrical and/or magnetotransport measurements. In all these devices, the graphite and hBN flakes are employed as the bottom gates and the gate dielectrics. The measurements of a fabricated single bottom-gate field-effect device show that the InSb nanosheet in the device has an electron field-effect mobility of ~7300 cm$^2$V$^{-1}$s$^{-1}$ and a low gate hysteresis of ~0.05 V at 1.9 K. The measurements of a double-gate Hall-bar device show that both the top and the bottom gate exhibit strong capacitive couplings to the InSb nanosheet channel and can thus tune the nanosheet channel conduction effectively. The electron Hall mobility in the InSb nanosheet of the Hall-bar device is extracted to be larger than 1.1$\times$10$^4$ cm$^2$V$^{-1}$s$^{-1}$ at a sheet electron density of ~6.1$\times$10$^{11}$ cm$^{-2}$ and 1.9 K and, thus, the device exhibits well-defined Shubnikov-de Haas oscillations.

cond-mat.mes-hall↗

arXiv2022

Quantum oscillations in a hexagonal boron nitride-supported single crystalline InSb nanosheet

A gated Hall-bar device is made from an epitaxially grown, free-standing InSb nanosheet on a hexagonal boron nitride (hBN) dielectric/graphite gate structure and the electron transport properties in the InSb nanosheet are studied by gate-transfer characteristic and magnetotransport measurements at low temperatures. The measurements show that the carriers in the InSb nanosheet are of electrons and the carrier density in the nanosheet can be highly efficiently tuned by the graphite gate. The mobility of the electrons in the InSb nanosheet is extracted from low-field magneotransport measurements and a value of the mobility exceeding ~18000 cm$^2$V$^{-1}$s$^{-1}$ is found. High-field magentotransport measurements show well-defined Shubnikov-de Haas (SdH) oscillations in the longitudinal resistance of the InSb nanosheet. Temperature-dependent measurements of the SdH oscillations are carried out and key transport parameters, including the electron effective mass m$^*$$\sim$0.028 m$_0$ and the quantum lifetime $τ$$\sim$0.046 ps, in the InSb nanosheet are extracted. It is for the first time that such experimental measurements have been reported for a free-standing InSb nanosheet and the results obtained indicate that InSb nanosheet/hBN/graphite gate structures can be used to develop advanced quantum devices for novel physics studies and for quantum technology applications.

cond-mat.mes-hall↗

arXiv2022

Learning Ego 3D Representation as Ray Tracing

A self-driving perception model aims to extract 3D semantic representations from multiple cameras collectively into the bird's-eye-view (BEV) coordinate frame of the ego car in order to ground downstream planner. Existing perception methods often rely on error-prone depth estimation of the whole scene or learning sparse virtual 3D representations without the target geometry structure, both of which remain limited in performance and/or capability. In this paper, we present a novel end-to-end architecture for ego 3D representation learning from an arbitrary number of unconstrained camera views. Inspired by the ray tracing principle, we design a polarized grid of "imaginary eyes" as the learnable ego 3D representation and formulate the learning process with the adaptive attention mechanism in conjunction with the 3D-to-2D projection. Critically, this formulation allows extracting rich 3D representation from 2D images without any depth supervision, and with the built-in geometry structure consistent w.r.t. BEV. Despite its simplicity and versatility, extensive experiments on standard BEV visual tasks (e.g., camera-based 3D object detection and BEV segmentation) show that our model outperforms all state-of-the-art alternatives significantly, with an extra advantage in computational efficiency from multi-task learning.

cs.CV↗

arXiv2022

Correlated topological pumping of interacting bosons assisted by Bloch oscillations

Thouless pumping, not only achieving quantized transport but also immune to moderate disorder, has attracted growing attention in both experiments and theories. Here, we explore how particle-particle interactions affect topological transport in a periodically-modulated and tilted optical lattice. Not limited to wannier states, our scheme ensures a dispersionless quantized transport even for initial Gaussian-like wave packets of interacting bosons which do not uniformly occupy a given band. This is because the tilting potential leads to Bloch oscillations uniformly sampling the Berry curvatures over the entire Brillouin zone. The interplay among on-site potential difference, tunneling rate and interactions contributes to the topological transport of bound and scattering states and the topologically resonant tunnelings. Our study deepens the understanding of correlation effects on topological states, and provides a feasible way for detecting topological properties in interacting systems.

quant-ph↗

arXiv2022

A Preliminary Study on the Potential Usefulness of Open Domain Model for Missing Software Requirements Recommendation

Completeness is one of the most important attributes of software requirement specifications. Unfortunately, incompleteness is meanwhile one of the most difficult problems to detect. Some approaches have been proposed to detect missing requirements based on the requirement-oriented domain model. However, this kind of models are lacking for lots of domains. Fortunately, the domain models constructed for different purposes can usually be found online. This raises a question: whether or not these domain models are helpful in finding the missing functional information in requirement specification? To explore this question, we design and conduct a preliminary study by computing the overlapping rate between the entities in domain models and the concepts of natural language software requirements and then digging into four regularities of the occurrence of these entities(concepts) based on two example domains. The usefulness of these regularities, especially the one based on our proposed metric AHME (with F2 gains of 146% and 223% on the two domains than without any regularity), has been shown in experiments.

cs.SE↗

arXiv2022

Demonstration of broadband topological slow light

Slow-light devices are able to significantly enhance light-matter interaction due to the reduced group velocity of light, but a very low group velocity is usually achieved in a narrow bandwidth, accompanied by extreme sensitivity to imperfections that causes increased disorder-induced attenuation. Recent theories have suggested an ideal solution to this problem - unidirectional chiral photonic states, previously discovered in structures known as photonic topological insulators, not only resist backscattering from imperfections but can also be slowed down in the entire topological bandgap with multiple windings in the Brillouin zone. Here, we report on the experimental demonstration of broadband topological slow light in a photonic topological insulator. When coupled with periodic resonators that form flat bands, the chiral photonic states can wind many times around the Brillouin zone, achieving an ultra-low group velocity in the entire topological bandgap. This demonstration extends the scope of topological photonics into slow light engineering and opens a unique avenue in the dispersion manipulation of chiral photonic states.

physics.app-ph↗

arXiv2022

Bidirectional Self-Training with Multiple Anisotropic Prototypes for Domain Adaptive Semantic Segmentation

A thriving trend for domain adaptive segmentation endeavors to generate the high-quality pseudo labels for target domain and retrain the segmentor on them. Under this self-training paradigm, some competitive methods have sought to the latent-space information, which establishes the feature centroids (a.k.a prototypes) of the semantic classes and determines the pseudo label candidates by their distances from these centroids. In this paper, we argue that the latent space contains more information to be exploited thus taking one step further to capitalize on it. Firstly, instead of merely using the source-domain prototypes to determine the target pseudo labels as most of the traditional methods do, we bidirectionally produce the target-domain prototypes to degrade those source features which might be too hard or disturbed for the adaptation. Secondly, existing attempts simply model each category as a single and isotropic prototype while ignoring the variance of the feature distribution, which could lead to the confusion of similar categories. To cope with this issue, we propose to represent each category with multiple and anisotropic prototypes via Gaussian Mixture Model, in order to fit the de facto distribution of source domain and estimate the likelihood of target samples based on the probability density. We apply our method on GTA5->Cityscapes and Synthia->Cityscapes tasks and achieve 61.2 and 62.8 respectively in terms of mean IoU, substantially outperforming other competitive self-training methods. Noticeably, in some categories which severely suffer from the categorical confusion such as "truck" and "bus", our method achieves 56.4 and 68.8 respectively, which further demonstrates the effectiveness of our design.

cs.CV↗

arXiv2022

CelebV-HQ: A Large-Scale Video Facial Attributes Dataset

Large-scale datasets have played indispensable roles in the recent success of face generation/editing and significantly facilitated the advances of emerging research fields. However, the academic community still lacks a video dataset with diverse facial attribute annotations, which is crucial for the research on face-related videos. In this work, we propose a large-scale, high-quality, and diverse video dataset with rich facial attribute annotations, named the High-Quality Celebrity Video Dataset (CelebV-HQ). CelebV-HQ contains 35,666 video clips with the resolution of 512x512 at least, involving 15,653 identities. All clips are labeled manually with 83 facial attributes, covering appearance, action, and emotion. We conduct a comprehensive analysis in terms of age, ethnicity, brightness stability, motion smoothness, head pose diversity, and data quality to demonstrate the diversity and temporal coherence of CelebV-HQ. Besides, its versatility and potential are validated on two representative tasks, i.e., unconditional video generation and video facial attribute editing. Furthermore, we envision the future potential of CelebV-HQ, as well as the new opportunities and challenges it would bring to related research directions. Data, code, and models are publicly available. Project page: https://celebv-hq.github.io.

cs.CV↗

arXiv2022

RCLane: Relay Chain Prediction for Lane Detection

Lane detection is an important component of many real-world autonomous systems. Despite a wide variety of lane detection approaches have been proposed, reporting steady benchmark improvements over time, lane detection remains a largely unsolved problem. This is because most of the existing lane detection methods either treat the lane detection as a dense prediction or a detection task, few of them consider the unique topologies (Y-shape, Fork-shape, nearly horizontal lane) of the lane markers, which leads to sub-optimal solution. In this paper, we present a new method for lane detection based on relay chain prediction. Specifically, our model predicts a segmentation map to classify the foreground and background region. For each pixel point in the foreground region, we go through the forward branch and backward branch to recover the whole lane. Each branch decodes a transfer map and a distance map to produce the direction moving to the next point, and how many steps to progressively predict a relay station (next point). As such, our model is able to capture the keypoints along the lanes. Despite its simplicity, our strategy allows us to establish new state-of-the-art on four major benchmarks including TuSimple, CULane, CurveLanes and LLAMAS.

cs.CV↗

arXiv2022

FashionViL: Fashion-Focused Vision-and-Language Representation Learning

Large-scale Vision-and-Language (V+L) pre-training for representation learning has proven to be effective in boosting various downstream V+L tasks. However, when it comes to the fashion domain, existing V+L methods are inadequate as they overlook the unique characteristics of both the fashion V+L data and downstream tasks. In this work, we propose a novel fashion-focused V+L representation learning framework, dubbed as FashionViL. It contains two novel fashion-specific pre-training tasks designed particularly to exploit two intrinsic attributes with fashion V+L data. First, in contrast to other domains where a V+L data point contains only a single image-text pair, there could be multiple images in the fashion domain. We thus propose a Multi-View Contrastive Learning task for pulling closer the visual representation of one image to the compositional multimodal representation of another image+text. Second, fashion text (e.g., product description) often contains rich fine-grained concepts (attributes/noun phrases). To exploit this, a Pseudo-Attributes Classification task is introduced to encourage the learned unimodal (visual/textual) representations of the same concept to be adjacent. Further, fashion V+L tasks uniquely include ones that do not conform to the common one-stream or two-stream architectures (e.g., text-guided image retrieval). We thus propose a flexible, versatile V+L model architecture consisting of a modality-agnostic Transformer so that it can be flexibly adapted to any downstream tasks. Extensive experiments show that our FashionViL achieves a new state of the art across five downstream tasks. Code is available at https://github.com/BrandonHanx/mmf.

cs.CV↗

arXiv2022

LAGOS-AND: A Large Gold Standard Dataset for Scholarly Author Name Disambiguation

In this paper, we present a method to automatically build large labeled datasets for the author ambiguity problem in the academic world by leveraging the authoritative academic resources, ORCID and DOI. Using the method, we built LAGOS-AND, two large, gold-standard datasets for author name disambiguation (AND), of which LAGOS-AND-BLOCK is created for clustering-based AND research and LAGOS-AND-PAIRWISE is created for classification-based AND research. Our LAGOS-AND datasets are substantially different from the existing ones. The initial versions of the datasets (v1.0, released in February 2021) include 7.5M citations authored by 798K unique authors (LAGOS-AND-BLOCK) and close to 1M instances (LAGOS-AND-PAIRWISE). And both datasets show close similarities to the whole Microsoft Academic Graph (MAG) across validations of six facets. In building the datasets, we reveal the variation degrees of last names in three literature databases, PubMed, MAG, and Semantic Scholar, by comparing author names hosted to the authors' official last names shown on the ORCID pages. Furthermore, we evaluate several baseline disambiguation methods as well as the MAG's author IDs system on our datasets, and the evaluation helps identify several interesting findings. We hope the datasets and findings will bring new insights for future studies. The code and datasets are publicly available.

cs.DL↗

arXiv2022

What Makes for Automatic Reconstruction of Pulmonary Segments

3D reconstruction of pulmonary segments plays an important role in surgical treatment planning of lung cancer, which facilitates preservation of pulmonary function and helps ensure low recurrence rates. However, automatic reconstruction of pulmonary segments remains unexplored in the era of deep learning. In this paper, we investigate what makes for automatic reconstruction of pulmonary segments. First and foremost, we formulate, clinically and geometrically, the anatomical definitions of pulmonary segments, and propose evaluation metrics adhering to these definitions. Second, we propose ImPulSe (Implicit Pulmonary Segment), a deep implicit surface model designed for pulmonary segment reconstruction. The automatic reconstruction of pulmonary segments by ImPulSe is accurate in metrics and visually appealing. Compared with canonical segmentation methods, ImPulSe outputs continuous predictions of arbitrary resolutions with higher training efficiency and fewer parameters. Lastly, we experiment with different network inputs to analyze what matters in the task of pulmonary segment reconstruction. Our code is available at https://github.com/M3DV/ImPulSe.

eess.IV↗

arXiv2022

Device-centric Federated Analytics At Ease

Nowadays, high-volume and privacy-sensitive data are generated by mobile devices, which are better to be preserved on devices and queried on demand. However, data analysts still lack a uniform way to harness such distributed on-device data. In this paper, we propose a data querying system, Deck, that enables flexible device-centric federated analytics. The key idea of Deck is to bypass the app developers but allow the data analysts to directly submit their analytics code to run on devices, through a centralized query coordinator service. Deck provides a list of standard APIs to data analysts and handles most of the device-specific tasks underneath. Deck further incorporates two key techniques: (i) a hybrid permission checking mechanism and mandatory cross-device aggregation to ensure data privacy; (ii) a zero-knowledge statistical model that judiciously trades off query delay and query resource expenditure on devices. We fully implement Deck and plug it into 20 popular Android apps. An in-the-wild deployment on 1,642 volunteers shows that Deck significantly reduces the query delay by up to 30x compared to baselines. Our microbenchmarks also demonstrate that the standalone overhead of Deck is negligible.

cs.DC↗

arXiv2022

SiamMask: A Framework for Fast Online Object Tracking and Segmentation

In this paper we introduce SiamMask, a framework to perform both visual object tracking and video object segmentation, in real-time, with the same simple method. We improve the offline training procedure of popular fully-convolutional Siamese approaches by augmenting their losses with a binary segmentation task. Once the offline training is completed, SiamMask only requires a single bounding box for initialization and can simultaneously carry out visual object tracking and segmentation at high frame-rates. Moreover, we show that it is possible to extend the framework to handle multiple object tracking and segmentation by simply re-using the multi-task model in a cascaded fashion. Experimental results show that our approach has high processing efficiency, at around 55 frames per second. It yields real-time state-of-the-art results on visual-object tracking benchmarks, while at the same time demonstrating competitive performance at a high speed for video object segmentation benchmarks.

cs.CV↗