arXiv subjects

Kai Yang

Publications and source records attributed to Kai Yang.

At least 253 records · Page 14Linked to original sources

arXiv2019

Blow-up dynamics in the mass super-critical NLS equations

We study stable blow-up dynamics in the $L^2$-supercritical nonlinear Schrödinger equation in various dimensions. We first investigate the profile equation and extend the result of X.-P. Wang [38] and Budd et al. [4] on the existence and local uniqueness of solutions of the cubic profile equation to other $L^2$-supercritical nonlinearities and dimensions $d \geq 2$. We then numerically observe the multi-bump structure of such solutions, and in particular, exhibit the $Q_{1,0}$ solution, a candidate for the stable blow-up profile. Next, using the dynamic rescaling method, we investigate stable blow-up solutions in the $L^2$-supercritical NLS and confirm the square root rate of the blow-up as well as the convergence of blow-up profiles to the $Q_{1,0}$ profile.

math.AP↗

arXiv2019

Blow-up dynamics and spectral property in the $L^2$-critical nonlinear Schrödinger equation in high dimensions

We study stable blow-up dynamics in the $L^2$-critical nonlinear Schrödinger equation in high dimensions. First, we show that in dimensions $d=4$ to $d=12$ generic blow-up behavior confirms the "log-log" regime in our numerical simulations, including the log-log rate and the convergence of the blow-up profiles to the rescaled ground state; this matches the description of the stable blow-up regime in the dimension $d =2$ (for the 2d cubic NLS equation). Next, we address the question of rigorous justification of the "log-log" dynamics in higher dimensions ($d \geq5)$, at least for the initial data with the mass slightly larger than the mass of the ground state, for which the spectral conjecture has yet to be proved, see [34] and [10]. We give a numerically-assisted proof of the spectral property for the dimensions from $d=5$ to $d=12$, and a modification of it in dimensions $2 \leq d \leq 12$. This, combined with previous results of Merle-Raphaël, proves the "log-log" stable blow-up regime in dimensions $d \leq 10$ and radially stable for $d \leq 12$.

math.AP↗

arXiv2019

Federated Learning via Over-the-Air Computation

The stringent requirements for low-latency and privacy of the emerging high-stake applications with intelligent devices such as drones and smart vehicles make the cloud computing inapplicable in these scenarios. Instead, edge machine learning becomes increasingly attractive for performing training and inference directly at network edges without sending data to a centralized data center. This stimulates a nascent field termed as federated learning for training a machine learning model on computation, storage, energy and bandwidth limited mobile devices in a distributed manner. To preserve data privacy and address the issues of unbalanced and non-IID data points across different devices, the federated averaging algorithm has been proposed for global model aggregation by computing the weighted average of locally updated model at each selected device. However, the limited communication bandwidth becomes the main bottleneck for aggregating the locally computed updates. We thus propose a novel over-the-air computation based approach for fast global model aggregation via exploring the superposition property of a wireless multiple-access channel. This is achieved by joint device selection and beamforming design, which is modeled as a sparse and low-rank optimization problem to support efficient algorithms design. To achieve this goal, we provide a difference-of-convex-functions (DC) representation for the sparse and low-rank function to enhance sparsity and accurately detect the fixed-rank constraint in the procedure of device selection. A DC algorithm is further developed to solve the resulting DC program with global convergence guarantees. The algorithmic advantages and admirable performance of the proposed methodologies are demonstrated through extensive numerical results.

cs.LG↗

arXiv2019

Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Task

We present Spider, a large-scale, complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 college students. It consists of 10,181 questions and 5,693 unique complex SQL queries on 200 databases with multiple tables, covering 138 different domains. We define a new complex and cross-domain semantic parsing and text-to-SQL task where different complex SQL queries and databases appear in train and test sets. In this way, the task requires the model to generalize well to both new SQL queries and new database schemas. Spider is distinct from most of the previous semantic parsing tasks because they all use a single database and the exact same programs in the train set and the test set. We experiment with various state-of-the-art models and the best model achieves only 12.4% exact matching accuracy on a database split setting. This shows that Spider presents a strong challenge for future research. Our dataset and task are publicly available at https://yale-lily.github.io/spider

cs.CL↗

arXiv2019

Floquet dynamical quantum phase transitions

Dynamical quantum phase transitions (DQPTs) are manifested by time-domain nonanalytic behaviors of many-body systems.Introducing a quench is so far understood as a typical scenario to induce DQPTs.In this work, we discover a novel type of DQPTs, termed "Floquet DQPTs", as intrinsic features of systems with periodic time modulation.Floquet DQPTs occur within each period of continuous driving, without the need for any quenches.In particular, in a harmonically driven spin chain model, we find analytically the existence of Floquet DQPTs in and only in a parameter regime hosting a certain nontrivial Floquet topological phase. The Floquet DQPTs are further characterized by a dynamical topological invariant defined as the winding number of the Pancharatnam geometric phase versus quasimomentum.These findings are experimentally demonstrated with a single spin in diamond.This work thus opens a door for future studies of DQPTs in connection with topological matter.

quant-ph↗

arXiv2019

Prediction of Silicate Glasses' Stiffness by High-Throughput Molecular Dynamics Simulations and Machine Learning

The development by machine learning of models predicting materials' properties usually requires the use of a large number of consistent data for training. However, quality experimental datasets are not always available or self-consistent. Here, as an alternative route, we combine machine learning with high-throughput molecular dynamics simulations to predict the Young's modulus of silicate glasses. We demonstrate that this combined approach offers excellent predictions over the entire compositional domain. By comparing the performance of select machine learning algorithms, we discuss the nature of the balance between accuracy, simplicity, and interpretability in machine learning.

cond-mat.mtrl-sci↗

arXiv2018

Multi-task Prediction of Patient Workload

Developing reliable workload predictive models can affect many aspects of clinical decision making procedure. The primary challenge in healthcare systems is handling the demand uncertainty over the time. This issue becomes more critical for the healthcare facilities that provide service for chronic disease treatment because of the need for continuous treatments over the time. Although some researchers focused on exploring the methods for workload prediction recently, few types of research mainly focused on forecasting a quantitative measure for the workload of healthcare providers. Also, among the mentioned studies most of them just focused on workload prediction within one facility. The drawback of the previous studies is the problem is not investigated for multiple facilities where the quality of provided service, the equipment, and resources used for provided service as well as the diagnosis and treatment procedures may differ even for patients with similar conditions. To tackle the mentioned issue, this paper suggests a framework for patient workload prediction by using patients data from VA facilities across the US. To capture the information of patients with similar attributes and make the prediction more accurate, a heuristic cluster based algorithm for single task learning as well as a multi task learning approach are developed in this research.

cs.CY↗

arXiv2018

Effective Feature Learning with Unsupervised Learning for Improving the Predictive Models in Massive Open Online Courses

The effectiveness of learning in massive open online courses (MOOCs) can be significantly enhanced by introducing personalized intervention schemes which rely on building predictive models of student learning behaviors such as some engagement or performance indicators. A major challenge that has to be addressed when building such models is to design handcrafted features that are effective for the prediction task at hand. In this paper, we make the first attempt to solve the feature learning problem by taking the unsupervised learning approach to learn a compact representation of the raw features with a large degree of redundancy. Specifically, in order to capture the underlying learning patterns in the content domain and the temporal nature of the clickstream data, we train a modified auto-encoder (AE) combined with the long short-term memory (LSTM) network to obtain a fixed-length embedding for each input sequence. When compared with the original features, the new features that correspond to the embedding obtained by the modified LSTM-AE are not only more parsimonious but also more discriminative for our prediction task. Using simple supervised learning models, the learned features can improve the prediction accuracy by up to 17% compared with the supervised neural networks and reduce overfitting to the dominant low-performing group of students, specifically in the task of predicting students' performance. Our approach is generic in the sense that it is not restricted to a specific supervised learning model nor a specific prediction task for MOOC learning analytics.

cs.LG↗

arXiv2018

Blind Demixing for Low-Latency Communication

In the next generation wireless networks, lowlatency communication is critical to support emerging diversified applications, e.g., Tactile Internet and Virtual Reality. In this paper, a novel blind demixing approach is developed to reduce the channel signaling overhead, thereby supporting low-latency communication. Specifically, we develop a low-rank approach to recover the original information only based on a single observed vector without any channel estimation. Unfortunately, this problem turns out to be a highly intractable non-convex optimization problem due to the multiple non-convex rankone constraints. To address the unique challenges, the quotient manifold geometry of product of complex asymmetric rankone matrices is exploited by equivalently reformulating original complex asymmetric matrices to the Hermitian positive semidefinite matrices. We further generalize the geometric concepts of the complex product manifolds via element-wise extension of the geometric concepts of the individual manifolds. A scalable Riemannian trust-region algorithm is then developed to solve the blind demixing problem efficiently with fast convergence rates and low iteration cost. Numerical results will demonstrate the algorithmic advantages and admirable performance of the proposed algorithm compared with the state-of-art methods.

cs.IT↗

arXiv2018

SyntaxSQLNet: Syntax Tree Networks for Complex and Cross-DomainText-to-SQL Task

Most existing studies in text-to-SQL tasks do not require generating complex SQL queries with multiple clauses or sub-queries, and generalizing to new, unseen databases. In this paper we propose SyntaxSQLNet, a syntax tree network to address the complex and cross-domain text-to-SQL generation task. SyntaxSQLNet employs a SQL specific syntax tree-based decoder with SQL generation path history and table-aware column attention encoders. We evaluate SyntaxSQLNet on the Spider text-to-SQL task, which contains databases with multiple tables and complex SQL queries with multiple SQL clauses and nested queries. We use a database split setting where databases in the test set are unseen during training. Experimental results show that SyntaxSQLNet can handle a significantly greater number of complex SQL examples than prior work, outperforming the previous state-of-the-art model by 7.3% in exact matching accuracy. We also show that SyntaxSQLNet can further improve the performance by an additional 7.5% using a cross-domain augmentation method, resulting in a 14.8% improvement in total. To our knowledge, we are the first to study this complex and cross-domain text-to-SQL task.

cs.CL↗

arXiv2018

Generalized Low-Rank Optimization for Topological Cooperation in Ultra-Dense Networks

Network densification is a natural way to support dense mobile applications under stringent requirements, such as ultra-low latency, ultra-high data rate, and massive connecting devices. Severe interference in ultra-dense networks poses a key bottleneck. Sharing channel state information (CSI) and messages across transmitters can potentially alleviate interferences and improve system performance. Most existing works on interference coordination require significant CSI signaling overhead and are impractical in ultra-dense networks. This paper investigate topological cooperation to manage interferences in message sharing based only on network connectivity information. In particular, we propose a generalized low-rank optimization approach to maximize achievable degrees-of-freedom (DoFs). To tackle the challenges of poor structure and non-convex rank function, we develop Riemannian optimization algorithms to solve a sequence of complex fixed rank subproblems through a rank growth strategy. By exploiting the non-compact Stiefel manifold formed by the set of complex full column rank matrices, we develop Riemannian optimization algorithms to solve the complex fixed-rank optimization problem by applying the semidefinite lifting technique and Burer-Monteiro factorization approach. Numerical results demonstrate the computational efficiency and higher DoFs achieved by the proposed algorithms.

cs.IT↗

arXiv2018

Data Shuffling in Wireless Distributed Computing via Low-Rank Optimization

Intelligent mobile platforms such as smart vehicles and drones have recently become the focus of attention for onboard deployment of machine learning mechanisms to enable low latency decisions with low risk of privacy breach. However, most such machine learning algorithms are both computation-and-memory intensive, which makes it highly difficult to implement the requisite computations on a single device of limited computation, memory, and energy resources. Wireless distributed computing presents new opportunities by pooling the computation and storage resources among devices. For low-latency applications, the key bottleneck lies in the exchange of intermediate results among mobile devices for data shuffling. To improve communication efficiency, we propose a co-channel communication model and design transceivers by exploiting the locally computed intermediate values as side information. A low-rank optimization model is proposed to maximize the achieved degrees-of-freedom (DoF) by establishing the interference alignment condition for data shuffling. Unfortunately, existing approaches to approximate the rank function fail to yield satisfactory performance due to the poor structure in the formulated low-rank optimization problem. In this paper, we develop an efficient DC algorithm to solve the presented low-rank optimization problem by proposing a novel DC representation for the rank function. Numerical experiments demonstrate that the proposed DC approach can significantly improve the communication efficiency whereas the achievable DoF almost remains unchanged when the number of mobile devices grows.

cs.IT↗

arXiv2018

Active Learning for Wireless IoT Intrusion Detection

Internet of Things (IoT) is becoming truly ubiquitous in our everyday life, but it also faces unique security challenges. Intrusion detection is critical for the security and safety of a wireless IoT network. This paper discusses the human-in-the-loop active learning approach for wireless intrusion detection. We first present the fundamental challenges against the design of a successful Intrusion Detection System (IDS) for wireless IoT network. We then briefly review the rudimentary concepts of active learning and propose its employment in the diverse applications of wireless intrusion detection. Experimental example is also presented to show the significant performance improvement of the active learning method over traditional supervised learning approach. While machine learning techniques have been widely employed for intrusion detection, the application of human-in-the-loop machine learning that leverages both machine and human intelligence to intrusion detection of IoT is still in its infancy. We hope this article can assist the readers in understanding the key concepts of active learning and spur further research in this area.

cs.CR↗

arXiv2018

Magnetic Resonance Imaging of Single Atoms

Magnetic resonance imaging (MRI) revolutionized diagnostic medicine and biomedical research by allowing a noninvasive access to spin ensembles. To enhance MRI resolution to the nanometer scale, new approaches including scanning probe methods have been used in recent years, which culminated in detection of individual spins. This allowed three-dimensional (3D) visualization of organic samples and of sophisticated spin-structures. Here, we demonstrate for the first time MRI of individual atoms on a surface. The setup, implemented in a cryogenic scanning tunneling microscope (STM), uses single-atom electron spin resonance (ESR) to achieve sub-Ångström resolution exceeding the spatial resolution of previous experiments by one to two orders of magnitude. We find that MRI scans of different atomic species and probe tips lead to unique signatures in the resonance images. These signatures reveal the magnetic interactions between the tip and the atom, in particular magnetic dipolar and exchange interaction.

cond-mat.mes-hall↗

arXiv2018

Chimera states in nonlocally coupled bicomponent phase oscillators: From synchronous to asynchronous chimeras

Chimera states, a symmetry-breaking spatiotemporal pattern in nonlocally coupled identical dynamical units, prevail in a variety of systems. Here, we consider a population of nonlocally coupled bicomponent phase oscillators in which oscillators with natural frequency $ω_0$ (positive oscillators) and $-ω_0$ (negative oscillators) are randomly distributed along a ring. We show the existence of chimera states no matter how large $ω_0$ is and the states manifest themselves in the form that oscillators with positive/negative frequency support their own chimera states. There are two types of chimera states, synchronous chimera states at small $ω_0$ in which coherent positive and negative oscillators share a same mean phase velocity and asynchronous chimera states at large $ω_0$ in which coherent positive and negative oscillators have different mean phase velocities. Increasing $ω_0$ induces a desynchronization transition between synchronous chimera states and asynchronous chimera states.

nlin.AO↗

arXiv2018

Enhanced quantum coherence in exchange coupled spins via singlet-triplet transitions

Manipulation of spin states at the single-atom scale underlies spin-based quantum information processing and spintronic devices. Such applications require protection of the spin states against quantum decoherence due to interactions with the environment. While a single spin is easily disrupted, a coupled-spin system can resist decoherence by employing a subspace of states that is immune to magnetic field fluctuations. Here, we engineered the magnetic interactions between the electron spins of two spin-1/2 atoms to create a clock transition and thus enhance their spin coherence. To construct and electrically access the desired spin structures, we use atom manipulation combined with electron spin resonance (ESR) in a scanning tunneling microscope (STM). We show that a two-level system composed of a singlet state and a triplet state is insensitive to local and global magnetic field noise, resulting in much longer spin coherence times compared with individual atoms. Moreover, the spin decoherence resulting from the interaction with tunneling electrons is markedly reduced by a homodyne readout of ESR. These results demonstrate that atomically-precise spin structures can be designed and assembled to yield enhanced quantum coherence.

cond-mat.mes-hall↗

arXiv2018

Incorporating Features Learned by an Enhanced Deep Knowledge Tracing Model for STEM/Non-STEM Job Prediction

The 2017 ASSISTments Data Mining competition aims to use data from a longitudinal study for predicting a brand-new outcome of students which had never been studied before by the educational data mining research community. Specifically, it facilitates research in developing predictive models that predict whether the first job of a student out of college belongs to a STEM (the acronym for science, technology, engineering, and mathematics) field. This is based on the student's learning history on the ASSISTments blended learning platform in the form of extensive clickstream data gathered during the middle school years. To tackle this challenge, we first estimate the expected knowledge state of students with respect to different mathematical skills using a deep knowledge tracing (DKT) model and an enhanced DKT (DKT+) model. We then combine the features corresponding to the DKT/DKT+ expected knowledge state with other features extracted directly from the student profile in the dataset to train several machine learning models for the STEM/non-STEM job prediction. Our experiments show that models trained with the combined features generally perform better than the models trained with the student profile alone. Detailed analysis of the student's knowledge state reveals that, when compared with non-STEM students, STEM students generally show a higher mastery level and a higher learning gain in mathematics.

cs.CY↗

arXiv2018

A Deep Active Survival Analysis Approach for Precision Treatment Recommendations: Application of Prostate Cancer

Survival analysis has been developed and applied in the number of areas including manufacturing, finance, economics and healthcare. In healthcare domain, usually clinical data are high-dimensional, sparse and complex and sometimes there exists few amount of time-to-event (labeled) instances. Therefore building an accurate survival model from electronic health records is challenging. With this motivation, we address this issue and provide a new survival analysis framework using deep learning and active learning with a novel sampling strategy. First, our approach provides better representation with lower dimensions from clinical features using labeled (time-to-event) and unlabeled (censored) instances and then actively trains the survival model by labeling the censored data using an oracle. As a clinical assistive tool, we introduce a simple effective treatment recommendation approach based on our survival model. In the experimental study, we apply our approach on SEER-Medicare data related to prostate cancer among African-Americans and white patients. The results indicate that our approach outperforms significantly than baseline models.

cs.LG↗