arXiv subjects

Wei Zhou

Publications and source records attributed to Wei Zhou.

At least 397 records · Page 22Linked to original sources

arXiv2021

A systematic comparison of grapheme-based vs. phoneme-based label units for encoder-decoder-attention models

Following the rationale of end-to-end modeling, CTC, RNN-T or encoder-decoder-attention models for automatic speech recognition (ASR) use graphemes or grapheme-based subword units based on e.g. byte-pair encoding (BPE). The mapping from pronunciation to spelling is learned completely from data. In contrast to this, classical approaches to ASR employ secondary knowledge sources in the form of phoneme lists to define phonetic output labels and pronunciation lexica. In this work, we do a systematic comparison between grapheme- and phoneme-based output labels for an encoder-decoder-attention ASR model. We investigate the use of single phonemes as well as BPE-based phoneme groups as output labels of our model. To preserve a simplified and efficient decoder design, we also extend the phoneme set by auxiliary units to be able to distinguish homophones. Experiments performed on the Switchboard 300h and LibriSpeech benchmarks show that phoneme-based modeling is competitive to grapheme-based encoder-decoder-attention modeling.

eess.AS↗

arXiv2021

Electronic transport properties and hydrostatic pressure effect of FeSe$_{0.67}$Te$_{0.33}$ single crystals free of phase separation

FeSe$_{1-x}$Te$_{x}$ superconductors manifest some intriguing electronic properties depending on the value of $x$. In FeSe single crystal, the nematic phase and Dirac band structure have been observed, while topological surface superconductivity with the Majorana bound state was found in the crystal of $x \sim 0.55$. Therefore, the electronic properties of single crystals with $0 < x \leq 0.5$ are crucial for probing the evolution of those intriguing properties as well as their relations. However, this study is still left blank due to the lack of single crystals because of phase separation. Here, we report the synthesis, magnetization, electronic transport properties, and hydrostatic pressure effect of FeSe$_{0.67}$Te$_{0.33}$ single crystals free of phase separation. A structural (nematic) transition is visible at $T_{s} = 39$ K, below which the resistivity exhibits a Fermi-liquid behavior. Analysis of upper critical fields suggests that spin-paramagnetic effect should be taken into account for both $H \parallel c$ axis and $H \parallel ab$ plane. A crossover from the low-$H$ quadratic to the high-$H$ quasi-linear behavior is observed in the magnetoresistance, signifying the possible existence of Dirac-cone state. Besides, the strong temperature dependence of Hall coefficient, violation of (modified) Kohler's rule, and two-band model analysis indicate the multiband effects in FeSe$_{0.67}$Te$_{0.33}$ single crystals. Hydrostatic pressure measurements reveal that $T_{s}$ is quickly suppressed with pressure while $T_{c}$ is monotonically increased up to 2.31 GPa, indicating the competition between nematicity and superconductivity. No signature of magnetic order that has been detected in FeSe$_{1-x}$S$_{x}$ is observed. Our findings fill up the blank of the knowledge on the basic properties of FeSe$_{1-x}$Te$_{x}$ system with low-Te concentrations.

cond-mat.supr-con↗

arXiv2021

Bayesian Graph Convolutional Network for Traffic Prediction

Recently, adaptive graph convolutional network based traffic prediction methods, learning a latent graph structure from traffic data via various attention-based mechanisms, have achieved impressive performance. However, they are still limited to find a better description of spatial relationships between traffic conditions due to: (1) ignoring the prior of the observed topology of the road network; (2) neglecting the presence of negative spatial relationships; and (3) lacking investigation on uncertainty of the graph structure. In this paper, we propose a Bayesian Graph Convolutional Network (BGCN) framework to alleviate these issues. Under this framework, the graph structure is viewed as a random realization from a parametric generative model, and its posterior is inferred using the observed topology of the road network and traffic data. Specifically, the parametric generative model is comprised of two parts: (1) a constant adjacency matrix which discovers potential spatial relationships from the observed physical connections between roads using a Bayesian approach; (2) a learnable adjacency matrix that learns a global shared spatial correlations from traffic data in an end-to-end fashion and can model negative spatial correlations. The posterior of the graph structure is then approximated by performing Monte Carlo dropout on the parametric graph structure. We verify the effectiveness of our method on five real-world datasets, and the experimental results demonstrate that BGCN attains superior performance compared with state-of-the-art methods.

cs.LG↗

arXiv2021

Anisotropic transport and de Haas$-$van Alphen oscillations in quasi-one-dimensional TaPtTe$_5$

Because of the unique physical properties and potential applications, the exploration of quantum materials with diverse symmetry-protected topological states has attracted considerable interest in the condensed-matter community in recent years. Most of the topologically nontirvial materials identified thus far have two-dimensional or three-dimensional structural characteristics, while the quasi-one-dimensional (quasi-1D) analogs are rare. Here we report on anisotropic magnetoresistance, Hall effect, and quantum de Haas$-$van Alphen (dHvA) oscillations in TaPtTe$_5$ single crystals, which possess a layered crystal structure with quasi-1D PtTe$_2$ chains. TaPtTe$_5$ manifests an anisotropic magnetoresistance and a nonlinear Hall effect at low temperatures. The analysis of the dHvA oscillations reveals two major oscillation frequencies (63.5 T and 95.2 T). The corresponding light effective masses and the nonzero Berry phases suggest the nontrivial band topology in TaPtTe$_5$, which is further corroborated by the first-principles calculations. Our results suggest that TaPtTe$_5$, in analogy with its sister compounds TaPdTe$_5$ and TaNiTe$_5$, is another quasi-1D material hosting topological Dirac fermions.

cond-mat.str-el↗

arXiv2021

Resolving the Intrinsic Bandgap and Edge Effect of BiI3 Film Epitaxially Grown on Graphene

Two-dimensional materials with layered structures, appropriate bandgap, and high carrier mobilities have gathered tremendous interests due to their potential applications in optoelectronic and photovoltaic devices. Here, we report the growth of BiI3 thin film with controllable atomic thickness on graphene-terminated 6H-SiC(0001) substrate by molecular beam epitaxy (MBE) method. The growth kinetic processes and crystalline properties of the BiI3 film are studied by scanning tunneling microscopy (STM). The scanning tunneling spectroscopy (STS) reveals a bandgap of 2.8 eV for monolayer BiI3 with a weak dependence on film thickness for few-layer BiI3, which greatly exceeds the previous reported values identified by macroscopic optical measurements. This discrepancy originates from the edge effect of BiI3 that renders the bandgap downshift to 1.5 - 1.6 eV, as identified by the STS curves and the further confirmed by density functional theory (DFT) calculations. Our work provides a method to fabricate high-quality monolayer BiI3 film and resolves its intrinsic bandgap as well as the edge effect on reduction of bandgap, benefitting not only to fundamental researches but also to nanoelectronic and optoelectronic applications.

cond-mat.mtrl-sci↗

arXiv2021

Epitaxial Growth of Quasi-One-Dimensional Bismuth-Halide Chains with Topological Non-Trivial Edge States

Quantum spin Hall insulators have one-dimensional (1D) spin-momentum locked topological edge states (ES) inside the bulk band gap, which can serve as dissipationless channels for the practical applications in low consumption electronics and high performance spintronics. However, the clean and atomically sharp ES serving as ideal 1D conducting channels are still lack. Here, we report the formation of the quasi-1D Bi4I4 nanoribbons on the surface of Bi(111) with the support of the graphene-terminated 6H-SiC(0001) and the direct observations of the topological ES at the step edge by scanning tunneling microscopy and spectroscopic-imaging results. The ES reside surround the edge of Bi4I4 nanoribbons and exhibits remarkable robustness against non time reversal symmetry perturbations. The theoretical simulations verify the topological non-trivial character of 1D ES, which is retained after considering the presence of the underlying Bi(111). Our study supports the existence of topological ES in Bi4I4 nanoribbons, paving the way to engineer the novel topological features by using the nanoribbons as the 1D building block.

cond-mat.mtrl-sci↗

arXiv2021

No-Reference Quality Assessment for 360-degree Images by Analysis of Multi-frequency Information and Local-global Naturalness

360-degree/omnidirectional images (OIs) have achieved remarkable attentions due to the increasing applications of virtual reality (VR). Compared to conventional 2D images, OIs can provide more immersive experience to consumers, benefitting from the higher resolution and plentiful field of views (FoVs). Moreover, observing OIs is usually in the head mounted display (HMD) without references. Therefore, an efficient blind quality assessment method, which is specifically designed for 360-degree images, is urgently desired. In this paper, motivated by the characteristics of the human visual system (HVS) and the viewing process of VR visual contents, we propose a novel and effective no-reference omnidirectional image quality assessment (NR OIQA) algorithm by Multi-Frequency Information and Local-Global Naturalness (MFILGN). Specifically, inspired by the frequency-dependent property of visual cortex, we first decompose the projected equirectangular projection (ERP) maps into wavelet subbands. Then, the entropy intensities of low and high frequency subbands are exploited to measure the multi-frequency information of OIs. Besides, except for considering the global naturalness of ERP maps, owing to the browsed FoVs, we extract the natural scene statistics features from each viewport image as the measure of local naturalness. With the proposed multi-frequency information measurement and local-global naturalness measurement, we utilize support vector regression as the final image quality regressor to train the quality evaluation model from visual quality-related features to human ratings. To our knowledge, the proposed model is the first no-reference quality assessment method for 360-degreee images that combines multi-frequency information and image naturalness. Experimental results on two publicly available OIQA databases demonstrate that our proposed MFILGN outperforms state-of-the-art approaches.

cs.CV↗

arXiv2021

Beyond Statistical Relations: Integrating Knowledge Relations into Style Correlations for Multi-Label Music Style Classification

Automatically labeling multiple styles for every song is a comprehensive application in all kinds of music websites. Recently, some researches explore review-driven multi-label music style classification and exploit style correlations for this task. However, their methods focus on mining the statistical relations between different music styles and only consider shallow style relations. Moreover, these statistical relations suffer from the underfitting problem because some music styles have little training data. To tackle these problems, we propose a novel knowledge relations integrated framework (KRF) to capture the complete style correlations, which jointly exploits the inherent relations between music styles according to external knowledge and their statistical relations. Based on the two types of relations, we use a graph convolutional network to learn the deep correlations between styles automatically. Experimental results show that our framework significantly outperforms state-of-the-art methods. Further studies demonstrate that our framework can effectively alleviate the underfitting problem and learn meaningful style correlations. The source code can be available at https://github.com/Makwen1995/MusicGenre.

cs.CL↗

arXiv2020

Early Detection of Fake News by Utilizing the Credibility of News, Publishers, and Users Based on Weakly Supervised Learning

The dissemination of fake news significantly affects personal reputation and public trust. Recently, fake news detection has attracted tremendous attention, and previous studies mainly focused on finding clues from news content or diffusion path. However, the required features of previous models are often unavailable or insufficient in early detection scenarios, resulting in poor performance. Thus, early fake news detection remains a tough challenge. Intuitively, the news from trusted and authoritative sources or shared by many users with a good reputation is more reliable than other news. Using the credibility of publishers and users as prior weakly supervised information, we can quickly locate fake news in massive news and detect them in the early stages of dissemination. In this paper, we propose a novel Structure-aware Multi-head Attention Network (SMAN), which combines the news content, publishing, and reposting relations of publishers and users, to jointly optimize the fake news detection and credibility prediction tasks. In this way, we can explicitly exploit the credibility of publishers and users for early fake news detection. We conducted experiments on three real-world datasets, and the results show that SMAN can detect fake news in 4 hours with an accuracy of over 91%, which is much faster than the state-of-the-art models.

cs.CL↗

arXiv2020

Deep Multi-Scale Features Learning for Distorted Image Quality Assessment

Image quality assessment (IQA) aims to estimate human perception based image visual quality. Although existing deep neural networks (DNNs) have shown significant effectiveness for tackling the IQA problem, it still needs to improve the DNN-based quality assessment models by exploiting efficient multi-scale features. In this paper, motivated by the human visual system (HVS) combining multi-scale features for perception, we propose to use pyramid features learning to build a DNN with hierarchical multi-scale features for distorted image quality prediction. Our model is based on both residual maps and distorted images in luminance domain, where the proposed network contains spatial pyramid pooling and feature pyramid from the network structure. Our proposed network is optimized in a deep end-to-end supervision manner. To validate the effectiveness of the proposed method, extensive experiments are conducted on four widely-used image quality assessment databases, demonstrating the superiority of our algorithm.

eess.IV↗

arXiv2020

Black-Box Coupled-Mode Theory: An Ab Initio Framework to Model Electromagnetic Interactions of Open, Lossy, and Dispersive Resonators

Temporal coupled-mode theory (TCMT) provides a simple yet powerful platform to model and analyze electromagnetic resonator systems. Nevertheless, restrictive assumptions and lack of rigorous connection to Maxwell's equations limit the TCMT formulation's generality and robustness. Herein, we present the Black-box Coupled-Mode Theory (BBCMT), a general ab initio CMT framework developed from Maxwell's equations and quasinormal mode (QNM) theory to model the electromagnetic interactions of dispersive, lossy, and open resonators. BBCMT development is enabled by employing Poynting's and conjugated reciprocity theorems to rigorously normalize QNMs and calculate their expansion coefficients. Our novel QNM analysis approach allows the definition of a resonator Hamiltonian matrix to characterize the modes' electromagnetic interactions, energy storage, and absorption. Uniquely, the BBCMT framework can capture a resonator's non-resonant scattering and absorption by treating the resonator scattered fields as a perturbation to those of a background structure, which can be flexibly chosen considering the desired accuracy-simplicity trade-off. BBCMT modeling complexity can be further adjusted by treating user-defined subcomponents of a resonator system as black-boxes described only by their input-output transfer characteristics. Beyond the BBCMT formulation, we present two lemmas to reverse-engineer the modeling parameters from calculated or measured far-field spectra. Moreover, we introduce the signal flow graphs from control theory to illustrate, interpret, and solve the BBCMT equations. To evince BBCMT's validity and generality, we compare the BBCMT and TCMT predictions for two plasmonic nanoresonator systems to finite-difference time-domain simulations and find BBCMT results to be a much better match. BBCMT reduces to TCMT or cavity perturbation theory under certain constraints and approximations.

physics.optics↗

arXiv2020

Online Meta-Critic Learning for Off-Policy Actor-Critic Methods

Off-Policy Actor-Critic (Off-PAC) methods have proven successful in a variety of continuous control tasks. Normally, the critic's action-value function is updated using temporal-difference, and the critic in turn provides a loss for the actor that trains it to take actions with higher expected return. In this paper, we introduce a novel and flexible meta-critic that observes the learning process and meta-learns an additional loss for the actor that accelerates and improves actor-critic learning. Compared to the vanilla critic, the meta-critic network is explicitly trained to accelerate the learning process; and compared to existing meta-learning algorithms, meta-critic is rapidly learned online for a single task, rather than slowly over a family of tasks. Crucially, our meta-critic framework is designed for off-policy based learners, which currently provide state-of-the-art reinforcement learning sample efficiency. We demonstrate that online meta-critic learning leads to improvements in avariety of continuous control environments when combined with contemporary Off-PAC methods DDPG, TD3 and the state-of-the-art SAC.

cs.LG↗

arXiv2020

Binocular Rivalry Oriented Predictive Auto-Encoding Network for Blind Stereoscopic Image Quality Measurement

Stereoscopic image quality measurement (SIQM) has become increasingly important for guiding stereo image processing and commutation systems due to the widespread usage of 3D contents. Compared with conventional methods which are relied on hand-crafted features, deep learning oriented measurements have achieved remarkable performance in recent years. However, most existing deep SIQM evaluators are not specifically built for stereoscopic contents and consider little prior domain knowledge of the 3D human visual system (HVS) in network design. In this paper, we develop a Predictive Auto-encoDing Network (PAD-Net) for blind/No-Reference stereoscopic image quality measurement. In the first stage, inspired by the predictive coding theory that the cognition system tries to match bottom-up visual signal with top-down predictions, we adopt the encoder-decoder architecture to reconstruct the distorted inputs. Besides, motivated by the binocular rivalry phenomenon, we leverage the likelihood and prior maps generated from the predictive coding process in the Siamese framework for assisting SIQM. In the second stage, quality regression network is applied to the fusion image for acquiring the perceptual quality prediction. The performance of PAD-Net has been extensively evaluated on three benchmark databases and the superiority has been well validated on both symmetrically and asymmetrically distorted stereoscopic images under various distortion types.

cs.MM↗

arXiv2020

Channel Attention Residual U-Net for Retinal Vessel Segmentation

Retinal vessel segmentation is a vital step for the diagnosis of many early eye-related diseases. In this work, we propose a new deep learning model, namely Channel Attention Residual U-Net (CAR-UNet), to accurately segment retinal vascular and non-vascular pixels. In this model, we introduced a novel Modified Efficient Channel Attention (MECA) to enhance the discriminative ability of the network by considering the interdependence between feature maps. On the one hand, we apply MECA to the "skip connections" in the traditional U-shaped networks, instead of simply copying the feature maps of the contracting path to the corresponding expansive path. On the other hand, we propose a Channel Attention Double Residual Block (CADRB), which integrates MECA into a residual structure as a core structure to construct the proposed CAR-UNet. The results show that our proposed CAR-UNet has reached the state-of-the-art performance on three publicly available retinal vessel datasets: DRIVE, CHASE DB1 and STARE.

eess.IV↗

arXiv2020

Bayesian Spatio-Temporal Graph Convolutional Network for Traffic Forecasting

In traffic forecasting, graph convolutional networks (GCNs), which model traffic flows as spatio-temporal graphs, have achieved remarkable performance. However, existing GCN-based methods heuristically define the graph structure as the physical topology of the road network, ignoring potential dependence of the graph structure over traffic data. And the defined graph structure is deterministic, which lacks investigation of uncertainty. In this paper, we propose a Bayesian Spatio-Temporal Graph Convolutional Network (BSTGCN) for traffic prediction. The graph structure in our network is learned from the physical topology of the road network and traffic data in an end-to-end manner, which discovers a more accurate description of the relationship among traffic flows. Moreover, a parametric generative model is proposed to represent the graph structure, which enhances the generalization capability of GCNs. We verify the effectiveness of our method on two real-world datasets, and the experimental results demonstrate that BSTGCN attains superior performance compared with state-of-the-art methods.

cs.LG↗

arXiv2020

Empirical Fourier Decomposition: An Accurate Adaptive Signal Decomposition Method

Signal decomposition is an effective tool to assist the identification of modal information in time-domain signals. Two signal decomposition methods, including the empirical wavelet transform (EWT) and Fourier decomposition method (FDM), have been developed based on Fourier theory. However, the EWT can suffer from a mode mixing problem for signals with closely-spaced modes and decomposition results by FDM can suffer from an inconsistency problem. An accurate adaptive signal decomposition method, called the empirical Fourier decomposition (EFD), is proposed to solve the problems in this work. The proposed EFD combines the uses of an improved Fourier spectrum segmentation technique and an ideal filter bank. The segmentation technique can solve the inconsistency problem by predefining the number of modes in a signal to be decomposed and filter functions in the ideal filter bank have no transition phases, which can solve the mode mixing problem. Numerical investigations are conducted to study the accuracy of the EFD. It is shown that the EFD can yield accurate and consistent decomposition results for signals with multiple non-stationary modes and those with closely-spaced modes, compared with decomposition results by the EWT, FDM, variational mode decomposition and empirical mode decomposition. It is also shown that the EFD can yield accurate time-frequency representation results and it has the highest computational efficiency among the compared methods.

eess.SP↗

arXiv2020

Affinity Space Adaptation for Semantic Segmentation Across Domains

Semantic segmentation with dense pixel-wise annotation has achieved excellent performance thanks to deep learning. However, the generalization of semantic segmentation in the wild remains challenging. In this paper, we address the problem of unsupervised domain adaptation (UDA) in semantic segmentation. Motivated by the fact that source and target domain have invariant semantic structures, we propose to exploit such invariance across domains by leveraging co-occurring patterns between pairwise pixels in the output of structured semantic segmentation. This is different from most existing approaches that attempt to adapt domains based on individual pixel-wise information in image, feature, or output level. Specifically, we perform domain adaptation on the affinity relationship between adjacent pixels termed affinity space of source and target domain. To this end, we develop two affinity space adaptation strategies: affinity space cleaning and adversarial affinity space alignment. Extensive experiments demonstrate that the proposed method achieves superior performance against some state-of-the-art methods on several challenging benchmarks for semantic segmentation across domains. The code is available at https://github.com/idealwei/ASANet.

cs.CV↗

arXiv2020

Residual Spatial Attention Network for Retinal Vessel Segmentation

Reliable segmentation of retinal vessels can be employed as a way of monitoring and diagnosing certain diseases, such as diabetes and hypertension, as they affect the retinal vascular structure. In this work, we propose the Residual Spatial Attention Network (RSAN) for retinal vessel segmentation. RSAN employs a modified residual block structure that integrates DropBlock, which can not only be utilized to construct deep networks to extract more complex vascular features, but can also effectively alleviate the overfitting. Moreover, in order to further improve the representation capability of the network, based on this modified residual block, we introduce the spatial attention (SA) and propose the Residual Spatial Attention Block (RSAB) to build RSAN. We adopt the public DRIVE and CHASE DB1 color fundus image datasets to evaluate the proposed RSAN. Experiments show that the modified residual structure and the spatial attention are effective in this work, and our proposed RSAN achieves the state-of-the-art performance.

eess.IV↗