arXiv subjects

Jie Li

Publications and source records attributed to Jie Li.

At least 451 records · Page 25Linked to original sources

arXiv2022

Spin-related electronic pathway through single molecule on Au(111)

Spin properties of organic molecules have attracted great interest for their potential applications in spintronic devices and quantum computing. Fe-tetraphenyl porphyrin (FeTPP) is of particular interest for its robust magnetic properties on metallic substrates. FeTPP is prepared in vacuum via on-surface synthesis. Molecular structure and spin-related transport properties are characterized by low-temperature scanning tunneling microscope and spectroscopy at 0.5 K. Density functional theory calculations are performed to understand molecular adsorption and spin distribution on Au(111). The molecular structure of FeTPP is distorted upon adsorption on the substrate. Spin excitations of FeTPP are observed on the Fe atom and high pyrrole groups in differential conductance spectra. The calculated spin density distribution indicates that the electron spin of FeTPP is mainly distributed on the Fe atom. The atomic transmission calculation indicates that electrons transport to substrate is mediated through Fe atom, when the tip is above the high pyrrole group.

cond-mat.mes-hall↗

arXiv2022

Depth Is All You Need for Monocular 3D Detection

A key contributor to recent progress in 3D detection from single images is monocular depth estimation. Existing methods focus on how to leverage depth explicitly, by generating pseudo-pointclouds or providing attention cues for image features. More recent works leverage depth prediction as a pretraining task and fine-tune the depth representation while training it for 3D detection. However, the adaptation is insufficient and is limited in scale by manual labels. In this work, we propose to further align depth representation with the target domain in unsupervised fashions. Our methods leverage commonly available LiDAR or RGB videos during training time to fine-tune the depth representation, which leads to improved 3D detectors. Especially when using RGB videos, we show that our two-stage training by first generating pseudo-depth labels is critical because of the inconsistency in loss distribution between the two tasks. With either type of reference data, our multi-task learning approach improves over the state of the art on both KITTI and NuScenes, while matching the test-time complexity of its single task sub-network.

cs.CV↗

arXiv2022

Simple-BEV: What Really Matters for Multi-Sensor BEV Perception?

Building 3D perception systems for autonomous vehicles that do not rely on high-density LiDAR is a critical research problem because of the expense of LiDAR systems compared to cameras and other sensors. Recent research has developed a variety of camera-only methods, where features are differentiably "lifted" from the multi-camera images onto the 2D ground plane, yielding a "bird's eye view" (BEV) feature representation of the 3D space around the vehicle. This line of work has produced a variety of novel "lifting" methods, but we observe that other details in the training setups have shifted at the same time, making it unclear what really matters in top-performing methods. We also observe that using cameras alone is not a real-world constraint, considering that additional sensors like radar have been integrated into real vehicles for years already. In this paper, we first of all attempt to elucidate the high-impact factors in the design and training protocol of BEV perception models. We find that batch size and input resolution greatly affect performance, while lifting strategies have a more modest effect -- even a simple parameter-free lifter works well. Second, we demonstrate that radar data can provide a substantial boost to performance, helping to close the gap between camera-only and LiDAR-enabled systems. We analyze the radar usage details that lead to good performance, and invite the community to re-consider this commonly-neglected part of the sensor platform.

cs.CV↗

arXiv2022

Black-Box Dissector: Towards Erasing-based Hard-Label Model Stealing Attack

Previous studies have verified that the functionality of black-box models can be stolen with full probability outputs. However, under the more practical hard-label setting, we observe that existing methods suffer from catastrophic performance degradation. We argue this is due to the lack of rich information in the probability prediction and the overfitting caused by hard labels. To this end, we propose a novel hard-label model stealing method termed \emph{black-box dissector}, which consists of two erasing-based modules. One is a CAM-driven erasing strategy that is designed to increase the information capacity hidden in hard labels from the victim model. The other is a random-erasing-based self-knowledge distillation module that utilizes soft labels from the substitute model to mitigate overfitting. Extensive experiments on four widely-used datasets consistently demonstrate that our method outperforms state-of-the-art methods, with an improvement of at most $8.27\%$. We also validate the effectiveness and practical potential of our method on real-world APIs and defense methods. Furthermore, our method promotes other downstream tasks, \emph{i.e.}, transfer adversarial attacks.

cs.CV↗

arXiv2022

Incorporation of Human Knowledge into Data Embeddings to Improve Pattern Significance and Interpretability

Embedding is a common technique for analyzing multi-dimensional data. However, the embedding projection cannot always form significant and interpretable visual structures that foreshadow underlying data patterns. We propose an approach that incorporates human knowledge into data embeddings to improve pattern significance and interpretability. The core idea is (1) externalizing tacit human knowledge as explicit sample labels and (2) adding a classification loss in the embedding network to encode samples' classes. The approach pulls samples of the same class with similar data features closer in the projection, leading to more compact (significant) and class-consistent (interpretable) visual structures. We give an embedding network with a customized classification loss to implement the idea and integrate the network into a visualization system to form a workflow that supports flexible class creation and pattern exploration. Patterns found on open datasets in case studies, subjects' performance in a user study, and quantitative experiment results illustrate the general usability and effectiveness of the approach.

cs.HC↗

arXiv2022

Seen to Unseen: When Fuzzy Inference System Predicts IoT Device Positioning Labels That Had Not Appeared in Training Phase

Situating at the core of Artificial Intelligence (AI), Machine Learning (ML), and more specifically, Deep Learning (DL) have embraced great success in the past two decades. However, unseen class label prediction is far less explored due to missing classes being invisible in training ML or DL models. In this work, we propose a fuzzy inference system to cope with such a challenge by adopting TSK+ fuzzy inference engine in conjunction with the Curvature-based Feature Selection (CFS) method. The practical feasibility of our system has been evaluated by predicting the positioning labels of networking devices within the realm of the Internet of Things (IoT). Competitive prediction performance confirms the efficiency and efficacy of our system, especially when a large number of continuous class labels are unseen during the model training stage.

cs.LG↗

arXiv2022

Parameter-Efficient Conformers via Sharing Sparsely-Gated Experts for End-to-End Speech Recognition

While transformers and their variant conformers show promising performance in speech recognition, the parameterized property leads to much memory cost during training and inference. Some works use cross-layer weight-sharing to reduce the parameters of the model. However, the inevitable loss of capacity harms the model performance. To address this issue, this paper proposes a parameter-efficient conformer via sharing sparsely-gated experts. Specifically, we use sparsely-gated mixture-of-experts (MoE) to extend the capacity of a conformer block without increasing computation. Then, the parameters of the grouped conformer blocks are shared so that the number of parameters is reduced. Next, to ensure the shared blocks with the flexibility of adapting representations at different levels, we design the MoE routers and normalization individually. Moreover, we use knowledge distillation to further improve the performance. Experimental results show that the proposed model achieves competitive performance with 1/3 of the parameters of the encoder, compared with the full-parameter model.

eess.AS↗

arXiv2022

On Collective Robustness of Bagging Against Data Poisoning

Bootstrap aggregating (bagging) is an effective ensemble protocol, which is believed can enhance robustness by its majority voting mechanism. Recent works further prove the sample-wise robustness certificates for certain forms of bagging (e.g. partition aggregation). Beyond these particular forms, in this paper, \emph{we propose the first collective certification for general bagging to compute the tight robustness against the global poisoning attack}. Specifically, we compute the maximum number of simultaneously changed predictions via solving a binary integer linear programming (BILP) problem. Then we analyze the robustness of vanilla bagging and give the upper bound of the tolerable poison budget. Based on this analysis, \emph{we propose hash bagging} to improve the robustness of vanilla bagging almost for free. This is achieved by modifying the random subsampling in vanilla bagging to a hash-based deterministic subsampling, as a way of controlling the influence scope for each poisoning sample universally. Our extensive experiments show the notable advantage in terms of applicability and robustness.

cs.CR↗

arXiv2022

Mechanical Bistability in Kerr-modified Cavity Magnomechanics

Bistable mechanical vibration is observed in a cavity magnomechanical system, which consists of a microwave cavity mode, a magnon mode, and a mechanical vibration mode of a ferrimagnetic yttrium-iron-garnet (YIG) sphere. The bistability manifests itself in both the mechanical frequency and linewidth under a strong microwave drive field, which simultaneously activates three different kinds of nonlinearities, namely, magnetostriction, magnon self-Kerr, and magnon-phonon cross-Kerr nonlinearities. The magnon-phonon cross-Kerr nonlinearity is first predicted and measured in magnomechanics. The system enters a regime where Kerr-type nonlinearities strongly modify the conventional cavity magnomechanics that possesses only a radiation-pressure-like magnomechanical coupling. Three different kinds of nonlinearities are identified and distinguished in the experiment. Our work demonstrates a new mechanism for achieving mechanical bistability by combining magnetostriction and Kerr-type nonlinearities, and indicates that such Kerr-modified cavity magnomechanics provides a unique platform for studying many distinct nonlinearities in a single experiment.

quant-ph↗

arXiv2022

FedIPR: Ownership Verification for Federated Deep Neural Network Models

Federated learning models are collaboratively developed upon valuable training data owned by multiple parties. During the development and deployment of federated models, they are exposed to risks including illegal copying, re-distribution, misuse and/or free-riding. To address these risks, the ownership verification of federated learning models is a prerequisite that protects federated learning model intellectual property rights (IPR) i.e., FedIPR. We propose a novel federated deep neural network (FedDNN) ownership verification scheme that allows private watermarks to be embedded and verified to claim legitimate IPR of FedDNN models. In the proposed scheme, each client independently verifies the existence of the model watermarks and claims respective ownership of the federated model without disclosing neither private training data nor private watermark information. The effectiveness of embedded watermarks is theoretically justified by the rigorous analysis of conditions under which watermarks can be privately embedded and detected by multiple clients. Moreover, extensive experimental results on computer vision and natural language processing tasks demonstrate that varying bit-length watermarks can be embedded and reliably detected without compromising original model performances. Our watermarking scheme is also resilient to various federated training settings and robust against removal attacks.

cs.LG↗

arXiv2022

Distinguishing two-component anomalous Hall effect from topological Hall effect

In transport, the topological Hall effect (THE) presents itself as non-monotonic features (or humps and dips) in the Hall signal and is widely interpreted as a sign of chiral spin textures, like magnetic skyrmions. However, when anomalous Hall effect (AHE) is also present, the co-existence of two AHEs could give rise to similar artifacts, making it difficult to distinguish between genuine THE with AHE and two-component AHE. Here we confirm genuine THE with AHE by means of transport and magneto-optical Kerr effect (MOKE) microscopy, in which magnetic skyrmions are directly observed, and find that genuine THE occurs in the transition region of the AHE. In sharp contrast, the artifact "THE", or two-component AHE occurs well beyond the saturation of the "AHE component" (under the false assumption of THE+AHE). Furthermore, we distinguish artifact "THE" from genuine THE by three methods: 1. Minor loops, 2. Temperature dependence, 3. Gate dependence. Minor loops of genuine THE with AHE are always within the full loop, while minor loops of the artifact "THE" may reveal a single loop that cannot fit into the "AHE component". Besides, the temperature or gate dependence of the artifact "THE" may also be accompanied by a polarity change of the "AHE component", as the non-monotonic features vanish, while the temperature dependence of genuine THE with AHE reveals no such change. Our work may help future researchers to exercise cautions and use these methods to examine carefully in order to ascertain genuine THE.

cond-mat.mtrl-sci↗

arXiv2022

Cr$_3$X$_4$ (X=Se, Te) monolayers as new platform to realize robust spin filter, spin diode and spin valve

Two-dimensional ferromagnetic (FM) half-metals are promising candidates for advanced spintronic devices with small-size and high-capacity. Motivated by recent report on controlling synthesis of FM Cr$_3$Te$_4$ nanosheet, herein, to explore the potential application in spintronics, we designed spintronic devices based on Cr$_3$X$_4$ (X=Se, Te) monolayers and investigated their spin transport properties. We found that Cr$_3$Te$_4$ monolayer based device shows spin filtering and dual spin diode effect when applying bias voltage, while Cr$_3$S$_4$ monolayer is an excellent platform to realize a spin valve. The different transport properties are primarily ascribed to the semiconducting spin channel, which is close to and away from the Fermi level in Cr$_3$Te$_4$ and Cr$_3$Se$_4$ monolayers, respectively. Interestingly, the current in monolayer Cr$_3$Se$_4$ based device also displays a negative differential resistance effect (NDRE) and a high magnetoresistance ratio (up to 2*10$^3$). Moreover, we found thermally induced spin filtering effect and NDRE in Cr$_3$Se$_4$ junction when applying temperature gradient instead of bias voltage. These theoretical findings highlight the potential of Cr$_3$X$_4$ (X=Se, Te) monolayers in spintronic applications and put forward realistic materials to realize nanosale spintronic device.

cond-mat.mtrl-sci↗

arXiv2022

Seeking Subjectivity in Visual Emotion Distribution Learning

Visual Emotion Analysis (VEA), which aims to predict people's emotions towards different visual stimuli, has become an attractive research topic recently. Rather than a single label classification task, it is more rational to regard VEA as a Label Distribution Learning (LDL) problem by voting from different individuals. Existing methods often predict visual emotion distribution in a unified network, neglecting the inherent subjectivity in its crowd voting process. In psychology, the \textit{Object-Appraisal-Emotion} model has demonstrated that each individual's emotion is affected by his/her subjective appraisal, which is further formed by the affective memory. Inspired by this, we propose a novel \textit{Subjectivity Appraise-and-Match Network (SAMNet)} to investigate the subjectivity in visual emotion distribution. To depict the diversity in crowd voting process, we first propose the \textit{Subjectivity Appraising} with multiple branches, where each branch simulates the emotion evocation process of a specific individual. Specifically, we construct the affective memory with an attention-based mechanism to preserve each individual's unique emotional experience. A subjectivity loss is further proposed to guarantee the divergence between different individuals. Moreover, we propose the \textit{Subjectivity Matching} with a matching loss, aiming at assigning unordered emotion labels to ordered individual predictions in a one-to-one correspondence with the Hungarian algorithm. Extensive experiments and comparisons are conducted on public visual emotion distribution datasets, and the results demonstrate that the proposed SAMNet consistently outperforms the state-of-the-art methods. Ablation study verifies the effectiveness of our method and visualization proves its interpretability.

cs.CV↗

arXiv2022

Learning to Evolve Structural Ensembles of Unfolded and Disordered Proteins Using Experimental Solution Data

We have developed a Generative Recurrent Neural Networks (GRNN) that learns the probability of the next residue torsions $X_{i+1}=\ [ϕ_{i+1},ψ_{i+1},ω_{i+1}, χ_{i+1}]$ from the previous residue in the sequence $X_i$ to generate new IDP conformations. In addition, we couple the GRNN with a Bayesian model, X-EISD, in a reinforcement learning step that biases the probability distributions of torsions to take advantage of experimental data types such as J-couplingss, NOEs and PREs. We show that updating the generative model parameters according to the reward feedback on the basis of the agreement between structures and data improves upon existing approaches that simply reweight static structural pools for disordered proteins. Instead the GRNN "DynamICE" model learns to physically change the conformations of the underlying pool to those that better agree with experiment.

physics.bio-ph↗

arXiv2022

TransFA: Transformer-based Representation for Face Attribute Evaluation

Face attribute evaluation plays an important role in video surveillance and face analysis. Although methods based on convolution neural networks have made great progress, they inevitably only deal with one local neighborhood with convolutions at a time. Besides, existing methods mostly regard face attribute evaluation as the individual multi-label classification task, ignoring the inherent relationship between semantic attributes and face identity information. In this paper, we propose a novel \textbf{trans}former-based representation for \textbf{f}ace \textbf{a}ttribute evaluation method (\textbf{TransFA}), which could effectively enhance the attribute discriminative representation learning in the context of attention mechanism. The multiple branches transformer is employed to explore the inter-correlation between different attributes in similar semantic regions for attribute feature learning. Specially, the hierarchical identity-constraint attribute loss is designed to train the end-to-end architecture, which could further integrate face identity discriminative information to boost performance. Experimental results on multiple face attribute benchmarks demonstrate that the proposed TransFA achieves superior performances compared with state-of-the-art methods.

cs.CV↗

arXiv2022

SpOT: Spatiotemporal Modeling for 3D Object Tracking

3D multi-object tracking aims to uniquely and consistently identify all mobile entities through time. Despite the rich spatiotemporal information available in this setting, current 3D tracking methods primarily rely on abstracted information and limited history, e.g. single-frame object bounding boxes. In this work, we develop a holistic representation of traffic scenes that leverages both spatial and temporal information of the actors in the scene. Specifically, we reformulate tracking as a spatiotemporal problem by representing tracked objects as sequences of time-stamped points and bounding boxes over a long temporal history. At each timestamp, we improve the location and motion estimates of our tracked objects through learned refinement over the full sequence of object history. By considering time and space jointly, our representation naturally encodes fundamental physical priors such as object permanence and consistency across time. Our spatiotemporal tracking framework achieves state-of-the-art performance on the Waymo and nuScenes benchmarks.

cs.CV↗

arXiv2022

Fully Attentional Network for Semantic Segmentation

Recent non-local self-attention methods have proven to be effective in capturing long-range dependencies for semantic segmentation. These methods usually form a similarity map of RC*C (by compressing spatial dimensions) or RHW*HW (by compressing channels) to describe the feature relations along either channel or spatial dimensions, where C is the number of channels, H and W are the spatial dimensions of the input feature map. However, such practices tend to condense feature dependencies along the other dimensions,hence causing attention missing, which might lead to inferior results for small/thin categories or inconsistent segmentation inside large objects. To address this problem, we propose anew approach, namely Fully Attentional Network (FLANet),to encode both spatial and channel attentions in a single similarity map while maintaining high computational efficiency. Specifically, for each channel map, our FLANet can harvest feature responses from all other channel maps, and the associated spatial positions as well, through a novel fully attentional module. Our new method has achieved state-of-the-art performance on three challenging semantic segmentation datasets,i.e., 83.6%, 46.99%, and 88.5% on the Cityscapes test set,the ADE20K validation set, and the PASCAL VOC test set,respectively.

cs.CV↗

arXiv2022

The quasi-Keplerian motion in the regular Bardeen spacetime

The second post-Newtonian solution for the quasi-Keplerian motion of a test particle in the gravitational field of regular Bardeen black hole is derived. The solution is formulated in terms of the test particle's orbital energy and angular momentum, as well as the mass and magnetic charge of the Bardeen black hole. The leading effects of the magnetic charge on the test particle's orbit and motion including perihelion precession are displayed explicitly. In particular, it is shown that to the second post-Newtonian order the magnetic charge does not affect the test particle's orbital period.

gr-qc↗