arXiv Science⌕ Search

arXiv subjects

Zheng Li

Publications and source records attributed to Zheng Li.

At least 397 records · Page 22Linked to original sources

Reconstruction of Quantitative Susceptibility Maps from Phase of Susceptibility Weighted Imaging with Cross-Connected $Ψ$-Net

Quantitative Susceptibility Mapping (QSM) is a new phase-based technique for quantifying magnetic susceptibility. The existing QSM reconstruction methods generally require complicated pre-processing on high-quality phase data. In this work, we propose to explore a new value of the high-pass filtered phase data generated in susceptibility weighted imaging (SWI), and develop an end-to-end Cross-connected $Ψ$-Net (C$Ψ$-Net) to reconstruct QSM directly from these phase data in SWI without additional pre-processing. C$Ψ$-Net adds an intermediate branch in the classical U-Net to form a $Ψ$-like structure. The specially designed dilated interaction block is embedded in each level of this branch to enlarge the receptive fields for capturing more susceptibility information from a wider spatial range of phase images. Moreover, the crossed connections are utilized between branches to implement a multi-resolution feature fusion scheme, which helps C$Ψ$-Net capture rich contextual information for accurate reconstruction. The experimental results on a human dataset show that C$Ψ$-Net achieves superior performance in our task over other QSM reconstruction algorithms.

eess.IV↗

Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English

In this paper, we describe our system for the AAAI 2021 shared task of COVID-19 Fake News Detection in English, where we achieved the 3rd position with the weighted F1 score of 0.9859 on the test set. Specifically, we proposed an ensemble method of different pre-trained language models such as BERT, Roberta, Ernie, etc. with various training strategies including warm-up,learning rate schedule and k-fold cross-validation. We also conduct an extensive analysis of the samples that are not correctly classified. The code is available at:https://github.com/archersama/3rd-solution-COVID19-Fake-News-Detection-in-English.

cs.CL↗

Tomographic imaging of complete quantum state of matter by ultrafast diffraction

With the ability to directly obtain the Wigner function and density matrix of photon states, quantum tomography (QT) has had a significant impact on quantum optics, quantum computing and quantum information. By an appropriate sequence of measurements on the evolution of each degreeof freedom (DOF), the full quantum state of the observed photonic system can be determined. The first proposal to extend the application of QT to reconstruction of complete quantum states of matter wavepackets had generated enormous interest in ultrafast diffraction imaging and pump-probe spectroscopy of molecules. This interest was elevated with the advent of ultrafast electron and X-ray diffraction techniques using electron accelerators and X-ray free electron lasers to add temporal resolution to the observed nuclear and electron distributions. However, the great interest in this area has been tempered by the illustration of an impossibility theorem, known as the dimension problem. Not being able to associate unitary evolution to every DOF of molecular motion, quantum tomography could not be used beyond 1D and categorically excludes most vibrational and all rotational motion of molecules. Here we present a theoretical advance to overcome the notorious dimension problem. Solving this challenging problem is important to push imaging molecular dynamics to the quantum limit. The new theory has solved this problem, which makes quantum tomography a truly useful methodology in ultrafast physics and enables the making of quantum version of a molecular movie. With the new theory, quantum tomography can be finally advanced to a sufficient level to become a general method for reconstructing quantum states of matter, without being limited in one dimension. Our new concept is demonstrated using a simulated dataset of ultrafast diffraction experiment of laser-aligned nitrogen molecules.

quant-ph↗

Site-specific Interrogation of an Ionic Chiral Fragment During Photolysis Using an X-ray Free-Electron Laser

Short-wavelength free-electron lasers with their ultrashort pulses at high intensities have originated new approaches for tracking molecular dynamics from the vista of specific sites. X-ray pump X-ray probe schemes even allow to address individual atomic constituents with a 'trigger'-event that preludes the subsequent molecular dynamics while being able to selectively probe the evolving structure with a time-delayed second X-ray pulse. Here, we use a linearly polarized X-ray photon to trigger the photolysis of a prototypical chiral molecule, namely trifluoromethyloxirane (C$_3$H$_3$F$_3$O), at the fluorine K-edge at around 700 eV. The evolving fluorine-containing fragments are then probed by a second, circularly polarized X-ray pulse of higher photon energy in order to investigate the chemically shifted inner-shell electrons of the ionic motherfragment for their stereochemical sensitivity. We experimentally demonstrate and theoretically support how two-color X-ray pump X-ray probe experiments with polarization control enable XFELs as tools for chiral recognition.

physics.chem-ph↗

Online Knowledge Distillation via Multi-branch Diversity Enhancement

Knowledge distillation is an effective method to transfer the knowledge from the cumbersome teacher model to the lightweight student model. Online knowledge distillation uses the ensembled prediction results of multiple student models as soft targets to train each student model. However, the homogenization problem will lead to difficulty in further improving model performance. In this work, we propose a new distillation method to enhance the diversity among multiple student models. We introduce Feature Fusion Module (FFM), which improves the performance of the attention mechanism in the network by integrating rich semantic information contained in the last block of multiple student models. Furthermore, we use the Classifier Diversification(CD) loss function to strengthen the differences between the student models and deliver a better ensemble result. Extensive experiments proved that our method significantly enhances the diversity among student models and brings better distillation performance. We evaluate our method on three image classification datasets: CIFAR-10/100 and CINIC-10. The results show that our method achieves state-of-the-art performance on these datasets.

cs.CV↗

Multimodal Topic Learning for Video Recommendation

Facilitated by deep neural networks, video recommendation systems have made significant advances. Existing video recommendation systems directly exploit features from different modalities (e.g., user personal data, user behavior data, video titles, video tags, and visual contents) to input deep neural networks, while expecting the networks to online mine user-preferred topics implicitly from these features. However, the features lacking semantic topic information limits accurate recommendation generation. In addition, feature crosses using visual content features generate high dimensionality features that heavily downgrade the online computational efficiency of networks. In this paper, we explicitly separate topic generation from recommendation generation, propose a multimodal topic learning algorithm to exploit three modalities (i.e., tags, titles, and cover images) for generating video topics offline. The topics generated by the proposed algorithm serve as semantic topic features to facilitate preference scope determination and recommendation generation. Furthermore, we use the semantic topic features instead of visual content features to effectively reduce online computational cost. Our proposed algorithm has been deployed in the Kuaibao information streaming platform. Online and offline evaluation results show that our proposed algorithm performs favorably.

cs.IR↗

AP20-OLR Challenge: Three Tasks and Their Baselines

This paper introduces the fifth oriental language recognition (OLR) challenge AP20-OLR, which intends to improve the performance of language recognition systems, along with APSIPA Annual Summit and Conference (APSIPA ASC). The data profile, three tasks, the corresponding baselines, and the evaluation principles are introduced in this paper. The AP20-OLR challenge includes more languages, dialects and real-life data provided by Speechocean and the NSFC M2ASR project, and all the data is free for participants. The challenge this year still focuses on practical and challenging problems, with three tasks: (1) cross-channel LID, (2) dialect identification and (3) noisy LID. Based on Kaldi and Pytorch, recipes for i-vector and x-vector systems are also conducted as baselines for the three tasks. These recipes will be online-published, and available for participants to configure LID systems. The baseline results on the three tasks demonstrate that those tasks in this challenge are worth paying more efforts to achieve better performance.

eess.AS↗

SYNC: A Copula based Framework for Generating Synthetic Data from Aggregated Sources

A synthetic dataset is a data object that is generated programmatically, and it may be valuable to creating a single dataset from multiple sources when direct collection is difficult or costly. Although it is a fundamental step for many data science tasks, an efficient and standard framework is absent. In this paper, we study a specific synthetic data generation task called downscaling, a procedure to infer high-resolution, harder-to-collect information (e.g., individual level records) from many low-resolution, easy-to-collect sources, and propose a multi-stage framework called SYNC (Synthetic Data Generation via Gaussian Copula). For given low-resolution datasets, the central idea of SYNC is to fit Gaussian copula models to each of the low-resolution datasets in order to correctly capture dependencies and marginal distributions, and then sample from the fitted models to obtain the desired high-resolution subsets. Predictive models are then used to merge sampled subsets into one, and finally, sampled datasets are scaled according to low-resolution marginal constraints. We make four key contributions in this work: 1) propose a novel framework for generating individual level data from aggregated data sources by combining state-of-the-art machine learning and statistical techniques, 2) perform simulation studies to validate SYNC's performance as a synthetic data generation algorithm, 3) demonstrate its value as a feature engineering tool, as well as an alternative to data collection in situations where gathering is difficult through two real-world datasets, 4) release an easy-to-use framework implementation for reproducibility and scalability at the production level that easily incorporates new data.

stat.AP↗

COPOD: Copula-Based Outlier Detection

Outlier detection refers to the identification of rare items that are deviant from the general data distribution. Existing approaches suffer from high computational complexity, low predictive capability, and limited interpretability. As a remedy, we present a novel outlier detection algorithm called COPOD, which is inspired by copulas for modeling multivariate data distribution. COPOD first constructs an empirical copula, and then uses it to predict tail probabilities of each given data point to determine its level of "extremeness". Intuitively, we think of this as calculating an anomalous p-value. This makes COPOD both parameter-free, highly interpretable, and computationally efficient. In this work, we make three key contributions, 1) propose a novel, parameter-free outlier detection algorithm with both great performance and interpretability, 2) perform extensive experiments on 30 benchmark datasets to show that COPOD outperforms in most cases and is also one of the fastest algorithms, and 3) release an easy-to-use Python implementation for reproducibility.

stat.ML↗

Research on multi-dimensional end-to-end phrase recognition algorithm based on background knowledge

At present, the deep end-to-end method based on supervised learning is used in entity recognition and dependency analysis. There are two problems in this method: firstly, background knowledge cannot be introduced; secondly, multi granularity and nested features of natural language cannot be recognized. In order to solve these problems, the annotation rules based on phrase window are proposed, and the corresponding multi-dimensional end-to-end phrase recognition algorithm is designed. This annotation rule divides sentences into seven types of nested phrases, and indicates the dependency between phrases. The algorithm can not only introduce background knowledge, recognize all kinds of nested phrases in sentences, but also recognize the dependency between phrases. The experimental results show that the annotation rule is easy to use and has no ambiguity; the matching algorithm is more consistent with the multi granularity and diversity characteristics of syntax than the traditional end-to-end algorithm. The experiment on CPWD dataset, by introducing background knowledge, the new algorithm improves the accuracy of the end-to-end method by more than one point. The corresponding method was applied to the CCL 2018 competition and won the first place in the task of Chinese humor type recognition.

cs.CL↗

Research on Annotation Rules and Recognition Algorithm Based on Phrase Window

At present, most Natural Language Processing technology is based on the results of Word Segmentation for Dependency Parsing, which mainly uses an end-to-end method based on supervised learning. There are two main problems with this method: firstly, the la-beling rules are complex and the data is too difficult to label, the workload of which is large; secondly, the algorithm cannot recognize the multi-granularity and diversity of language components. In order to solve these two problems, we propose labeling rules based on phrase windows, and designed corresponding phrase recognition algorithms. The labeling rule uses phrases as the minimum unit, di-vides sentences into 7 types of nestable phrase types, and marks the grammatical dependencies between phrases. The corresponding algorithm, drawing on the idea of identifying the target area in the image field, can find the start and end positions of various phrases in the sentence, and realize the synchronous recognition of nested phrases and grammatical dependencies. The results of the experiment shows that the labeling rule is convenient and easy to use, and there is no ambiguity; the algorithm is more grammatically multi-granular and diverse than the end-to-end algorithm. Experiments on the CPWD dataset improve the accuracy of the end-to-end method by about 1 point. The corresponding method was applied to the CCL2018 competition, and the first place in the Chinese Metaphor Sentiment Analysis Task.

cs.CL↗

Exploiting Visual Semantic Reasoning for Video-Text Retrieval

Video retrieval is a challenging research topic bridging the vision and language areas and has attracted broad attention in recent years. Previous works have been devoted to representing videos by directly encoding from frame-level features. In fact, videos consist of various and abundant semantic relations to which existing methods pay less attention. To address this issue, we propose a Visual Semantic Enhanced Reasoning Network (ViSERN) to exploit reasoning between frame regions. Specifically, we consider frame regions as vertices and construct a fully-connected semantic correlation graph. Then, we perform reasoning by novel random walk rule-based graph convolutional networks to generate region features involved with semantic relations. With the benefit of reasoning, semantic interactions between regions are considered, while the impact of redundancy is suppressed. Finally, the region features are aggregated to form frame-level features for further encoding to measure video-text similarity. Extensive experiments on two public benchmark datasets validate the effectiveness of our method by achieving state-of-the-art performance due to the powerful semantic reasoning.

cs.CV↗

Ramsey interferometry through coherent $X^2Σ_g^+ - A^2Π_u - B^2Σ_u^+$ coupling and population transfer in N$^+_2$ air laser

The laser-like coherent emission at 391nm from N$_2$ gas irradiated by strong 800nm pump laser and weak 400nm seed laser is theoretically investigated. Recent experimental observations are well simulated, including temporal profile, optical gain and periodic modulation of the 391nm signal from N$_2^+$. Our calculation sheds light on the long standing controversy on whether population inversion is indispensable for the optical gain. We demonstrate the Ramsey interference fringes of the emission intensity at 391nm formed by additionally injecting another 800nm pump or 400nm seed, which are well explained by the coherent modulation of transition dipole moment and population between the $A^2Π_u(ν=2)$-$X^2Σ_g^+$ states as well as the $B^2Σ_u^+ (ν=0)$-$X^2Σ_g^+$ states. This study provides versatile possibilities for the coherent control of $\text{N}_2^+$ air laser.

physics.atom-ph↗

Efficient asymmetric transmission of elastic waves in thin plates with lossless metasurfaces

Requiring neither active components nor complex designs, we propose and experimentally demonstrate a generic framework for undistorted asymmetric elastic-wave transmission in a thin plate just using a layer of lossless metasurface. The asymmetric transmission stems from the uneven diffraction of +1 and -1 orders on opposite sides of the metasurface, respectively. Compared with previous loss-induced strategies, the present metasurface maintains a nearly total transmission for the transportation side, but a total reflection from the opposite side, exhibiting a higher contrast ratio of transmission. Moreover, we illustrate that this strong asymmetric behavior is robust to the frequency, the incident angle and the loss effect. The present work paves new avenues to compact rectification, high resolution ultrasonography, vibration and noise control in elastodynamics and acoustics.

physics.app-ph↗

Photoinduced Vibrations Drive Ultrafast Structural Distortion in Lead Halide Perovskite

Organic-inorganic perovskites have shown great promise towards their application in optoelectronics. The success of this class of material is dictated by the complex interplay between various underlying microscopic phenomena. The structural dynamics of organic cations and the inorganic sublattice after photoexcitation is hypothesized to have a direct effect on the material properties, thereby affecting the overall device performance. Here, we use two-dimensional (2D) electronic spectroscopy to reveal impulsively excited vibrational modes of methylammonium (MA) lead iodide perovskite, which drive the structural distortion after photoexcitation. The vibrational analysis of the measured data allows us to directly monitor the time evolution of the librational motion of the MA cation along with the vibrational coherences of inorganic sublattice. Wavelet analysis of the observed vibrational coherences uncovers the interplay between these two types of phonons. It reveals the coherent generation of the librational motion of the MA cation within ~300 fs, which is complemented by the coherent evolution of the skeletal motion of the inorganic sublattice. We have employed time-dependent density functional theory (TDDFT) to study the atomic motion of the MA cation and the inorganic sublattice during the process of photoexcitation. The TDDFT calculations support our experimental observations of the coherent generation of librational motions in the MA cation and highlight the importance of the anharmonic interaction between the MA cation and the inorganic sublattice. Our calculations predict the transfer of the photoinduced vibrational coherence from the MA cation to the inorganic sublattice, which drives the skeleton motion to form a polaronic state leading to long lifetimes of the charge carriers. This work may lead to novel design principles for next generation of solar cell materials.

physics.chem-ph↗

Rate Splitting for Multi-Antenna Downlink: Precoder Design and Practical Implementation

Rate splitting (RS) is a potentially powerful and flexible technique for multi-antenna downlink transmission. In this paper, we address several technical challenges towards its practical implementation for beyond 5G systems. To this end, we focus on a single-cell system with a multi-antenna base station (BS) and K single-antenna receivers. We consider RS in its most general form, and joint decoding to fully exploit the potential of RS. First, we investigate the achievable rates under joint decoding and formulate the precoder design problems to maximize a general utility function, or to minimize the transmit power under pre-defined rate targets. Building upon the concave-convex procedure (CCCP), we propose precoder design algorithms for an arbitrary number of users. Our proposed algorithms approximate the intractable non-convex problems with a number of successively refined convex problems, and provably converge to stationary points of the original problems. Then, to reduce the decoding complexity, we consider the optimization of the precoder and the decoding order under successive decoding. Further, we propose a stream selection algorithm to reduce the number of precoded signals. With a reduced number of streams and successive decoding at the receivers, our proposed algorithm can even be implemented when the number of users is relatively large, whereas the complexity was previously considered as prohibitively high in the same setting. Finally, we propose a simple adaptation of our algorithms to account for the imperfection of the channel state information at the transmitter. Numerical results demonstrate that the general RS scheme provides a substantial performance gain as compared to state-of-the-art linear precoding schemes, especially with a moderately large number of users.

cs.IT↗

A Dynamic Subspace Based BFGS Method for Large Scale Optimization Problem

Large-scale unconstrained optimization is a fundamental and important class of, yet not well-solved problems in numerical optimization. The main challenge in designing an algorithm is to require a few storage locations or very inexpensive computations while preserving global convergence. In this work, we propose a novel approach solving large-scale unconstrained optimization problem by combining the dynamic subspace technique and the BFGS update algorithm. It is clearly demonstrated that our approach has the same rate of convergence in the dynamic subspace as the BFGS and less memory than L-BFGS. Further, we give the convergence analysis by constructing the mapping of low-dimensional Euclidean space to the adaptive subspace. We compare our hybrid algorithm with the BFGS and L-BFGS approaches. Experimental results show that our hybrid algorithm offers several significant advantages such as parallel computing, convergence efficiency, and robustness.

math.OC↗

Non-uniform Berry-Esseen Bound by Unbounded Exchangeable Pair Approach

In this paper, a new technique is introduced to obtain non-uniform Berry-Esseen bounds of normal and nonnormal approximation for unbounded exchangeable pairs. This technique does not rely on the concentration inequalities developed by Chen and Shao \cite{cls1, cls2} and can be applied to the quadratic forms, general Curie-Weiss model and an independence test. In particular, our non-uniform result about the independence test is under 6th moment condition, while the uniform bound in Chen and Shao \cite{cs2} requires 24th moment condition.

math.ST↗