arXiv subjects

Xiaodong Li

Publications and source records attributed to Xiaodong Li.

At least 163 records · Page 9Linked to original sources

arXiv2020

Generalization of Machine Learning for Problem Reduction: A Case Study on Travelling Salesman Problems

Combinatorial optimization plays an important role in real-world problem solving. In the big data era, the dimensionality of a combinatorial optimization problem is usually very large, which poses a significant challenge to existing solution methods. In this paper, we examine the generalization capability of a machine learning model for problem reduction on the classic travelling salesman problems (TSP). We demonstrate that our method can greedily remove decision variables from an optimization problem that are predicted not to be part of an optimal solution. More specifically, we investigate our model's capability to generalize on test instances that have not been seen during the training phase. We consider three scenarios where training and test instances are different in terms of: 1) problem characteristics; 2) problem sizes; and 3) problem types. Our experiments show that this machine learning based technique can generalize reasonably well over a wide range of TSP test instances with different characteristics or sizes. While the accuracy of predicting unused variables naturally deteriorates as a test instance is further away from the training set, we observe that even when tested on a different TSP problem variant, the machine learning model still makes useful predictions about which variables can be eliminated without significantly impacting solution quality.

cs.LG↗

arXiv2020

Mott Transition and Superconductivity in Quantum Spin Liquid Candidate NaYbSe$_2$

The Mott transition is one of the fundamental issues in condensed matter physics, especially in the system with antiferromagnetic long-range order. However the Mott transition in quantum spin liquid (QSL) systems without long-range order is rare. Here we report the observation of the pressure-induced insulator to metal transition followed by the emergence of superconductivity in the QSL candidate NaYbSe2 with triangular lattice of 4f Yb$_3^+$ ions. Detail analysis of transport properties at metallic state shows an evolution from non-Fermi liquid to Fermi liquid behavior when approaching the vicinity of superconductivity. An irreversible structure phase transition occurs around 11 GPa is revealed by the X-ray diffraction. These results shed light on the Mott transition and superconductivity in the QSL systems.

cond-mat.supr-con↗

arXiv2020

Polyacrylonitrile/Graphene Nanocomposite: Towards the Next Generation of Carbon Fibers

Carbon Fibers (CFs) are the key solution for the future lightweight vehicle with enhanced fuel efficiency and reduced emissions owing to their ultrahigh strength to weight ratio. However, the high cost of the current dominant PAN-based CFs hinders their application. The use of low-cost alternative precursors may overcome this issue. Unfortunately, low-cost CFs derived from cheaper single component precursors suffer from poor mechanical properties. Developing composite CFs by adding nanoadditives is very promising for low-cost CFs. Therefore, a fundamental understanding of carbonization condition impacts and polymer/additives conversion mechanisms during whole CF production are essential to develop low-cost CFs. In this work, we have demonstrated how the carbonization temperature affects the PAN/graphene CFs properties by performing a series of ReaxFF based molecular dynamics simulations. We found that graphene edges along with the nitrogen and oxygen functional groups have a catalytic role and act as seeds for the graphitic structure growth. Our MD simulations unveil that the addition of the graphene to PAN precursor modifies all-carbon membered rings in CFs and enhances the alignments of 6-member carbon rings in carbonization which leads to superior mechanical properties compare to PAN-based CFs. These ReaxFF simulation results are validates by experimental structural and mechanical characterizations. Interestingly, mechanical characterizations indicate that PAN/graphene CFs carbonized at 1250 C demonstrate 90.9% increase in strength and 101.9% enhancement in Young's modulus compare to the PAN-based CFs carbonized at 1500 C. The superior mechanical properties of PAN/graphene CFs at lower carbonization temperatures offers a path to both energy savings and cost reduction by decreasing the carbonization temperature and could provide key insights for the development of low-cost CFs.

cond-mat.mtrl-sci↗

arXiv2020

Dynamic Attention Based Generative Adversarial Network with Phase Post-Processing for Speech Enhancement

The generative adversarial networks (GANs) have facilitated the development of speech enhancement recently. Nevertheless, the performance advantage is still limited when compared with state-of-the-art models. In this paper, we propose a powerful Dynamic Attention Recursive GAN called DARGAN for noise reduction in the time-frequency domain. Different from previous works, we have several innovations. First, recursive learning, an iterative training protocol, is used in the generator, which consists of multiple steps. By reusing the network in each step, the noise components are progressively reduced in a step-wise manner. Second, the dynamic attention mechanism is deployed, which helps to re-adjust the feature distribution in the noise reduction module. Third, we exploit the deep Griffin-Lim algorithm as the module for phase postprocessing, which facilitates further improvement in speech quality. Experimental results on Voice Bank corpus show that the proposed GAN achieves state-of-the-art performance than previous GAN- and non-GAN-based models

cs.SD↗

arXiv2020

Nonconvex Rectangular Matrix Completion via Gradient Descent without $\ell_{2,\infty}$ Regularization

The analysis of nonconvex matrix completion has recently attracted much attention in the community of machine learning thanks to its computational convenience. Existing analysis on this problem, however, usually relies on $\ell_{2,\infty}$ projection or regularization that involves unknown model parameters, although they are observed to be unnecessary in numerical simulations, see, e.g., Zheng and Lafferty [2016]. In this paper, we extend the analysis of the vanilla gradient descent for positive semidefinite matrix completion proposed in Ma et al. [2017] to the rectangular case, and more significantly, improve the required sampling rate from $O(\operatorname{poly}(κ)μ^3 r^3 \log^3 n/n )$ to $O(μ^2 r^2 κ^{14} \log n/n )$. Our technical ideas and contributions are potentially useful in improving the leave-one-out analysis in other related problems.

stat.ML↗

arXiv2020

The IOA System for Deep Noise Suppression Challenge using a Framework Combining Dynamic Attention and Recursive Learning

This technical report describes our system that is submitted to the Deep Noise Suppression Challenge and presents the results for the non-real-time track. To refine the estimation results stage by stage, we utilize recursive learning, a type of training protocol which aggravates the information through multiple stages with a memory mechanism. The attention generator network is designed to dynamically control the feature distribution of the noise reduction network. To improve the phase recovery accuracy, we take the complex spectral mapping procedure by decoding both real and imaginary spectra. For the final blind test set, the average MOS improvements of the submitted system in noreverb, reverb, and realrec categories are 0.49, 0.24, and 0.36, respectively.

cs.SD↗

arXiv2020

A Recursive Network with Dynamic Attention for Monaural Speech Enhancement

A person tends to generate dynamic attention towards speech under complicated environments. Based on this phenomenon, we propose a framework combining dynamic attention and recursive learning together for monaural speech enhancement. Apart from a major noise reduction network, we design a separated sub-network, which adaptively generates the attention distribution to control the information flow throughout the major network. To effectively decrease the number of trainable parameters, recursive learning is introduced, which means that the network is reused for multiple stages, where the intermediate output in each stage is correlated with a memory mechanism. As a result, a more flexible and better estimation can be obtained. We conduct experiments on TIMIT corpus. Experimental results show that the proposed architecture obtains consistently better performance than recent state-of-the-art models in terms of both PESQ and STOI scores.

cs.SD↗

arXiv2020

Non-superconducting electronic ground state in pressurized BaFe$_2$S$_3$ and BaFe$_2$S$_{2.5}$Se$_{0.5}$

We report a comprehensive study of the spin ladder compound BaFe$_2$S$_{2.5}$Se$_{0.5}$ using neutron diffraction, inelastic neutron scattering, high pressure synchrotron diffraction, and high pressure transport techniques. We find that BaFe$_2$S$_{2.5}$Se$_{0.5}$ possesses the same $Cmcm$ structure and stripe antiferromagnetic order as does BaFe$_2$S$_3$, but with a reduced N{é}el temperature of $T_N=98$ K compared to 120 K for the undoped system, and a slightly increased ordered moment of 1.40$μ_B$ per iron. The low-energy spin excitations in BaFe$_2$S$_{2.5}$Se$_{0.5}$ are likewise similar to those observed in BaFe$_2$S$_{3}$. However, unlike the reports of superconductivity in BaFe$_2$S$_3$ below $T_c \sim 14$~K under pressures of 10~GPa or more, we observe no superconductivity in BaFe$_2$S$_{2.5}$Se$_{0.5}$ at any pressure up to 19.7~GPa. In contrast, the resistivity exhibits an upturn at low temperature under pressure. Furthermore, we show that additional high-quality samples of BaFe$_2$S$_3$ synthesized for this study likewise fail to become superconducting under pressure, instead displaying a similar upturn in resistivity at low temperature. These results demonstrate that microscopic, sample-specific details play an important role in determining the ultimate electronic ground state in this spin ladder system. We suggest that the upturn in resistivity at low temperature in both BaFe$_2$S$_3$ and BaFe$_2$S$_{2.5}$Se$_{0.5}$ may result from Anderson localization induced by S vacancies and random Se substitutions, enhanced by the quasi-one-dimensional ladder structure.

cond-mat.supr-con↗

arXiv2020

Convolutional Recurrent Neural Network Based Progressive Learning for Monaural Speech Enhancement

Recently, progressive learning has shown its capacity to improve speech quality and speech intelligibility when it is combined with deep neural network (DNN) and long short-term memory (LSTM) based monaural speech enhancement algorithms, especially in low signal-to-noise ratio (SNR) conditions. Nevertheless, due to a large number of parameters and high computational complexity, it is hard to implement in current resource-limited micro-controllers and thus, it is essential to significantly reduce both the number of parameters and the computational load for practical applications. For this purpose, we propose a novel progressive learning framework with causal convolutional recurrent neural networks called PL-CRNN, which takes advantage of both convolutional neural networks and recurrent neural networks to drastically reduce the number of parameters and simultaneously improve speech quality and speech intelligibility. Numerous experiments verify the effectiveness of the proposed PL-CRNN model and indicate that it yields consistent better performance than the PL-DNN and PL-LSTM algorithms and also it gets results close even better than the CRNN in terms of objective measurements. Compared with PL-DNN, PL-LSTM, and CRNN, the proposed PL-CRNN algorithm can reduce the number of parameters up to 93%, 97%, and 92%, respectively.

cs.SD↗

arXiv2019

A Supervised Speech enhancement Approach with Residual Noise Control for Voice Communication

For voice communication, it is important to extract the speech from its noisy version without introducing unnaturally artificial noise. By studying the subband mean-squared error (MSE) of the speech for unsupervised speech enhancement approaches and revealing its relationship with the existing loss function for supervised approaches, this paper derives a generalized loss function, when taking the residual noise control into account, for supervised approaches. Our generalized loss function contains the well-known MSE loss function and many other often-used loss functions as special cases. Compared with traditional loss functions, our generalized loss function is more flexible to make a good trade-off between speech distortion and noise reduction. This is because a group of well-studied noise shaping schemes can be introduced to control residual noise for practical applications. Objective and subjective test results verify the importance of residual noise control for the supervised speech enhancement approach.

cs.SD↗

arXiv2019

Aesthetic Attributes Assessment of Images

Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text. In this paper, we propose Aesthetic Attributes Assessment of Images, which means the aesthetic attributes captioning. This is a new formula of image aesthetic assessment, which predicts aesthetic attributes captions together with the aesthetic score of each attribute. We introduce a new dataset named \emph{DPC-Captions} which contains comments of up to 5 aesthetic attributes of one image through knowledge transfer from a full-annotated small-scale dataset. Then, we propose Aesthetic Multi-Attribute Network (AMAN), which is trained on a mixture of fully-annotated small-scale PCCD dataset and weakly-annotated large-scale DPC-Captions dataset. Our AMAN makes full use of transfer learning and attention model in a single framework. The experimental results on our DPC-Captions and PCCD dataset reveal that our method can predict captions of 5 aesthetic attributes together with numerical score assessment of each attribute. We use the evaluation criteria used in image captions to prove that our specially designed AMAN model outperforms traditional CNN-LSTM model and modern SCA-CNN model of image captions.

cs.CV↗

arXiv2019

Facial Makeup Transfer Combining Illumination Transfer

To meet the women appearance needs, we present a novel virtual experience approach of facial makeup transfer, developed into windows platform application software. The makeup effects could present on the user's input image in real time, with an only single reference image. The input image and reference image are divided into three layers by facial feature points landmarked: facial structure layer, facial color layer, and facial detail layer. Except for the above layers are processed by different algorithms to generate output image, we also add illumination transfer, so that the illumination effect of the reference image is automatically transferred to the input image. Our approach has the following three advantages: (1) Black or dark and white facial makeup could be effectively transferred by introducing illumination transfer; (2) Efficiently transfer facial makeup within seconds compared to those methods based on deep learning frameworks; (3) Reference images with the air-bangs could transfer makeup perfectly.

cs.CV↗

arXiv2019

Model-free Nonconvex Matrix Completion: Local Minima Analysis and Applications in Memory-efficient Kernel PCA

This work studies low-rank approximation of a positive semidefinite matrix from partial entries via nonconvex optimization. We characterized how well local-minimum based low-rank factorization approximates a fixed positive semidefinite matrix without any assumptions on the rank-matching, the condition number or eigenspace incoherence parameter. Furthermore, under certain assumptions on rank-matching and well-boundedness of condition numbers and eigenspace incoherence parameters, a corollary of our main theorem improves the state-of-the-art sampling rate results for nonconvex matrix completion with no spurious local minima in Ge et al. [2016, 2017]. In addition, we investigated when the proposed nonconvex optimization results in accurate low-rank approximations even in presence of large condition numbers, large incoherence parameters, or rank mismatching. We also propose to apply the nonconvex optimization to memory-efficient Kernel PCA. Compared to the well-known Nyström methods, numerical experiments indicate that the proposed nonconvex optimization approach yields more stable results in both low-rank approximation and clustering.

math.OC↗

arXiv2018

Observation of superconductivity in pressurized Weyl semimetal candidate TaIrTe4

Here we report the observation of superconductivity in pressurized type-II Weyl semimetal (WSM) candidate TaIrTe4 by means of complementary high-pressure transport and synchrotron X-ray diffraction measurements. We find that TaIrTe4 shows superconductivity with transition temperature (TC) of 0.57 K at the pressure of ~23.8 GPa. Then, the TC value increases with pressure and reaches ~2.1 K at 65.7 GPa. In situ high-pressure Hall coefficient (RH) measurements at low temperatures demonstrate that the positive RH increases with pressure until the critical pressure of the superconducting transition is reached, but starts to decrease upon further increasing pressure. Above the critical pressure, the positive magnetoresistance effect disappears simultaneously. Our high pressure X-ray diffraction measurements reveal that, at around the critical pressure the lattice of the TaIrTe4 sample is distorted by the application of pressure and its volume is reduced by ~19.2%, the value of which is predicted to result in the change of the electronic structure significantly. We propose that the pressure-induced distortion in TaIrTe4 is responsible for the change of topology of Fermi surface and such a change favors the emergence of superconductivity. Our results clearly demonstrate the correlation among the lattice distortion, topological physics and superconductivity in the WSM.

cond-mat.supr-con↗

arXiv2018

Performance Comparison on Parallel CPU and GPU Algorithms for Unified Gas-Kinetic Scheme

Parallel algorithms on CPU and GPU are implemented for the Unified Gas-Kinetic Scheme and their performances are investigated and compared by a two dimensional channel flow case. The parallel CPU algorithm has a one dimensional block partition that parallelizes only the spatial space. Due to the intrinsic feature of the UGKS, a compromised two-level parallelization is adopted for GPU algorithm. A series of meshes with different sizes are tested to reveal the performance evolution of the algorithms with respect to problem size. Then special attentions are paid to UGKS applications where the molecular velocity space range is large. The comparison confirms that GPU has relative elevated accelerations with the latest device having a speedup of 118.38x. Parallel CPU algorithm, on the contrary, might provide better performances when the grid point number in velocity space is large.

physics.comp-ph↗

arXiv2018

Convex Relaxation Methods for Community Detection

This paper surveys recent theoretical advances in convex optimization approaches for community detection. We introduce some important theoretical techniques and results for establishing the consistency of convex community detection under various statistical models. In particular, we discuss the basic techniques based on the primal and dual analysis. We also present results that demonstrate several distinctive advantages of convex community detection, including robustness against outlier nodes, consistency under weak assortativity, and adaptivity to heterogeneous degrees. This survey is not intended to be a complete overview of the vast literature on this fast-growing topic. Instead, we aim to provide a big picture of the remarkable recent development in this area and to make the survey accessible to a broad audience. We hope that this expository article can serve as an introductory guide for readers who are interested in using, designing, and analyzing convex relaxation methods in network analysis.

math.ST↗

arXiv2018

Universal superconductivity phase diagram for pressurized tetradymite topological insulators

We show that two different superconducting phases exist at high pressures in the optimized tetradymite topological insulators Bi2Te2Se (BTS) and Bi1.1Sb0.9Te2S (BSTS). The superconducting phases emerge at structural phase transitions, the first at 8.4 GPa for BTS and 12.4 GPa for BSTS, and the second at 13.6 GPa for BTS and 20.4 GPa, for BSTS. Electronic structure calculations show that these phases do not have topological character. Comparison of our results with prior work on Bi2Se3, Bi2Te3 and (Bi,Sb)2(Se,Te)3 allows us to uncover a universal phase diagram for pressure-induced superconductivity in tetradymites, providing a basis for understanding the relationships between topological behavior, crystal structure, and superconductivity for these materials.

cond-mat.supr-con↗

arXiv2018

When Do Birds of a Feather Flock Together? k-Means, Proximity, and Conic Programming

Given a set of data, one central goal is to group them into clusters based on some notion of similarity between the individual objects. One of the most popular and widely-used approaches is k-means despite the computational hardness to find its global minimum. We study and compare the properties of different convex relaxations by relating them to corresponding proximity conditions, an idea originally introduced by Kumar and Kannan. Using conic duality theory, we present an improved proximity condition under which the Peng-Wei relaxation of k-means recovers the underlying clusters exactly. Our proximity condition improves upon Kumar and Kannan, and is comparable to that of Awashti and Sheffet where proximity conditions are established for projective k-means. In addition, we provide a necessary proximity condition for the exactness of the Peng-Wei relaxation. For the special case of equal cluster sizes, we establish a different and completely localized proximity condition under which the Amini-Levina relaxation yields exact clustering, thereby having addressed an open problem by Awasthi and Sheffet in the balanced case. Our framework is not only deterministic and model-free but also comes with a clear geometric meaning which allows for further analysis and generalization. Moreover, it can be conveniently applied to analyzing various data generative models such as the stochastic ball models and Gaussian mixture models. With this method, we improve the current minimum separation bound for the stochastic ball models and achieve the state-of-the-art results of learning Gaussian mixture models.

math.OC↗