arXiv subjects

Kaixuan Zhang

Publications and source records attributed to Kaixuan Zhang.

49 records · Page 3Linked to original sources

arXiv2020

Terahertz Emisssion from Quantum Interference of Electron Trajectories

The semiclassical electron trajectory, the so-called quantum orbits, is employed to explain the terahertz wave generation (TWG) in dual-color strong field, and the feasibility of the theory is validated by the measurement. We find that TWG stems from quantum path interference of partial electron wavepacket released at the neighbouring cycles of the dual-color electric field, manifesting the temporal Young's double-slit interference of single electron. The trajectories released from neighbouring cycles, creating TWG, also account for intercycle interference fringes in the photoelectron momentum distribution, whereas no signature of TWG is found when taking trajectories only from a single cycle.

physics.atom-ph↗

arXiv2019

Connecting First and Second Order Recurrent Networks with Deterministic Finite Automata

We propose an approach that connects recurrent networks with different orders of hidden interaction with regular grammars of different levels of complexity. We argue that the correspondence between recurrent networks and formal computational models gives understanding to the analysis of the complicated behaviors of recurrent networks. We introduce an entropy value that categorizes all regular grammars into three classes with different levels of complexity, and show that several existing recurrent networks match grammars from either all or partial classes. As such, the differences between regular grammars reveal the different properties of these models. We also provide a unification of all investigated recurrent networks. Our evaluation shows that the unified recurrent network has improved performance in learning grammars, and demonstrates comparable performance on a real-world dataset with more complicated models.

cs.LG↗

arXiv2019

Shapley Homology: Topological Analysis of Sample Influence for Neural Networks

Data samples collected for training machine learning models are typically assumed to be independent and identically distributed (iid). Recent research has demonstrated that this assumption can be problematic as it simplifies the manifold of structured data. This has motivated different research areas such as data poisoning, model improvement, and explanation of machine learning models. In this work, we study the influence of a sample on determining the intrinsic topological features of its underlying manifold. We propose the Shapley Homology framework, which provides a quantitative metric for the influence of a sample of the homology of a simplicial complex. By interpreting the influence as a probability measure, we further define an entropy which reflects the complexity of the data manifold. Our empirical studies show that when using the 0-dimensional homology, on neighboring graphs, samples with higher influence scores have more impact on the accuracy of neural networks for determining the graph connectivity and on several regular grammars whose higher entropy values imply more difficulty in being learned.

cs.LG↗

arXiv2019

Magnetically-Sensitive Valley Polarization Reversal and Revival of Defect-Localized Excitons in WSe2-WS2

Manipulating and reserving the valley pseudospin of excitons is one core aim in the two-dimensional transition metal dichalcogenides (TMDs). However, due to the strong electron-hole exchange and spin-orbit coupling interactions, the exciton recombination lifetime is subject to picosecond timescale intrinsically, and the valley polarization is hardly modulated by a moderate magnetic field. It is fortunate that interlayer and defect-localized excitons promise to overcome these difficulties by suppressing the above interactions. Here we clearly reveal that the valley polarization can be reversed and revived in the defect-localized excitons with a microsecond lifetime in AB-stacked WSe2-WS2 heterobilayer. Specifically, for the interlayer defect-localized exciton, the valley polarization is reversed and can be efficiently enhanced by a weak out-of-plane magnetic field (<0.4 T). In sharp contrast, the valley polarization of the intralayer defect-localized exciton can revive after a fast decay process and follows the direction of the moderate out-of-plane magnetic field (<3 T). We explain the reversed valley polarization with highly magnetic sensitivity by the delocalization of defect-localized holes under a weak magnetic field and the revival of valley polarization by the valley Zeeman effect under a moderate magnetic field. Our results demonstrate that the valley pseudospin of defect-localized excitons can be efficiently modulated by the external magnetic field and enrich both the understanding and the technical approaches on manipulating the valley dynamics in TMDs and their heterostructure.

cond-mat.mtrl-sci↗

arXiv2019

Dual-Color Laser Induced Terahertz Generation in Strong Field Approximation

The mechanism of the terahertz (THz) wave generation (TWG) in dual-color fields is elucidated within the theoretical framework of single-atom based strong field approximation (SFA). Evaluating the transition dipole moment, the continuum-continuum (CC) transition, rather than the continuum-bound recombination for the high-order harmonic generation, is confirmed to be the core mechanism of the TWG. The analytic form of the SFA-based CC description is consistent with the classical photoelectric current model, establishing the quantum-classical correspondence for the TWG. The theory is supported by parametric dependence of experimental THz yields calibrated by the joint measurement of the third-order harmonics. Present studies leave open the possibility of probing the ultrafast dynamics of continuum electron.

quant-ph↗

arXiv2018

An Empirical Evaluation of Rule Extraction from Recurrent Neural Networks

Rule extraction from black-box models is critical in domains that require model validation before implementation, as can be the case in credit scoring and medical diagnosis. Though already a challenging problem in statistical learning in general, the difficulty is even greater when highly non-linear, recursive models, such as recurrent neural networks (RNNs), are fit to data. Here, we study the extraction of rules from second-order recurrent neural networks trained to recognize the Tomita grammars. We show that production rules can be stably extracted from trained RNNs and that in certain cases the rules outperform the trained RNNs.

cs.LG↗

arXiv2018

A Comparative Study of Rule Extraction for Recurrent Neural Networks

Understanding recurrent networks through rule extraction has a long history. This has taken on new interests due to the need for interpreting or verifying neural networks. One basic form for representing stateful rules is deterministic finite automata (DFA). Previous research shows that extracting DFAs from trained second-order recurrent networks is not only possible but also relatively stable. Recently, several new types of recurrent networks with more complicated architectures have been introduced. These handle challenging learning tasks usually involving sequential data. However, it remains an open problem whether DFAs can be adequately extracted from these models. Specifically, it is not clear how DFA extraction will be affected when applied to different recurrent networks trained on data sets with different levels of complexity. Here, we investigate DFA extraction on several widely adopted recurrent networks that are trained to learn a set of seven regular Tomita grammars. We first formally analyze the complexity of Tomita grammars and categorize these grammars according to that complexity. Then we empirically evaluate different recurrent networks for their performance of DFA extraction on all Tomita grammars. Our experiments show that for most recurrent networks, their extraction performance decreases as the complexity of the underlying grammar increases. On grammars of lower complexity, most recurrent networks obtain desirable extraction performance. As for grammars with the highest level of complexity, while several complicated models fail with only certain recurrent networks having satisfactory extraction performance.

cs.LG↗

arXiv2018

Verification of Recurrent Neural Networks Through Rule Extraction

The verification problem for neural networks is verifying whether a neural network will suffer from adversarial samples, or approximating the maximal allowed scale of adversarial perturbation that can be endured. While most prior work contributes to verifying feed-forward networks, little has been explored for verifying recurrent networks. This is due to the existence of a more rigorous constraint on the perturbation space for sequential data, and the lack of a proper metric for measuring the perturbation. In this work, we address these challenges by proposing a metric which measures the distance between strings, and use deterministic finite automata (DFA) to represent a rigorous oracle which examines if the generated adversarial samples violate certain constraints on a perturbation. More specifically, we empirically show that certain recurrent networks allow relatively stable DFA extraction. As such, DFAs extracted from these recurrent networks can serve as a surrogate oracle for when the ground truth DFA is unknown. We apply our verification mechanism to several widely used recurrent networks on a set of the Tomita grammars. The results demonstrate that only a few models remain robust against adversarial samples. In addition, we show that for grammars with different levels of complexity, there is also a difference in the difficulty of robust learning of these grammars.

cs.LG↗

arXiv2018

Self-cleaning of hydrophobic rough surfaces by coalescence-induced wetting transition

The superhydrophobic leaves of a lotus plant and other natural surfaces with self-cleaning function have been studied intensively for the development of artificial biomimetic surfaces. Surface roughness generated by hierarchical structures is a crucial property required for superhydrophobicity and self-cleaning. Here, we demonstrate a novel self-cleaning mechanism of textured surfaces attributed to a spontaneous coalescence-induced wetting transition. We focus on the wetting transition as it represents a new mechanism, which can explain why droplets on rough surfaces are able to change from the highly adhesive Wenzel state to the low-adhesion Cassie-Baxter state and achieve self-cleaning. In particular, we perform many-body dissipative particle dynamics simulations of liquid droplets sitting on mechanically textured substrates. We quantitatively investigate the wetting behavior of an isolated droplet as well as coalescence of droplets for both Cassie-Baxter and Wenzel states. Our simulation results reveal that droplets in the Cassie-Baxter state have much lower contact angle hysteresis and smaller hydrodynamic resistance than droplets in the Wenzel state. When small neighboring droplets coalesce into bigger ones on textured hydrophobic substrates, we observe a spontaneous wetting transition from a Wenzel state to a Cassie-Baxter state, which is powered by the surface energy released upon coalescence of the droplets. For superhydrophobic surfaces, the released surface energy may be sufficient to cause a jumping motion of droplets off the surface, in which case adding one more droplet to coalescence may increase the jumping velocity by one order of magnitude. When multiple droplets are involved, we find that the spatial distribution of liquid components in the coalesced droplet can be controlled by properly designing the overall arrangement of droplets and the distance between them.

physics.comp-ph↗

arXiv2018

Terahertz generation in dual-color laser: continuum electron in strong-field single-atom ionization

The terahertz (THz) generation in a dual-color field was investigated experimentally by precisely controlling the relative time delay $τ$ and polarization $θ$ of dual-color lasers, where the accompanying third-harmonic generation (THG) is employed to determine $τ$ up to the sub-wavelength accuracy. An anticorrelation of the yields between THz and THG with $τ$ was displayed. Compared with the theoretical simulations, the experimental results reveal that the continuum-continuum transitions of the released electron after single-atom ionization are the dominating mechanism for THz generation, which is opposite to the high-harmonic generation (HHG) based on the recollision mechanism, or the radiation induced by perturbative bound-bound transitions.

physics.optics↗

arXiv2017

Learning Adversary-Resistant Deep Neural Networks

Deep neural networks (DNNs) have proven to be quite effective in a vast array of machine learning tasks, with recent examples in cyber security and autonomous vehicles. Despite the superior performance of DNNs in these applications, it has been recently shown that these models are susceptible to a particular type of attack that exploits a fundamental flaw in their design. This attack consists of generating particular synthetic examples referred to as adversarial samples. These samples are constructed by slightly manipulating real data-points in order to "fool" the original DNN model, forcing it to mis-classify previously correctly classified samples with high confidence. Addressing this flaw in the model is essential if DNNs are to be used in critical applications such as those in cyber security. Previous work has provided various learning algorithms to enhance the robustness of DNN models, and they all fall into the tactic of "security through obscurity". This means security can be guaranteed only if one can obscure the learning algorithms from adversaries. Once the learning technique is disclosed, DNNs protected by these defense mechanisms are still susceptible to adversarial samples. In this work, we investigate this issue shared across previous research work and propose a generic approach to escalate a DNN's resistance to adversarial samples. More specifically, our approach integrates a data transformation module with a DNN, making it robust even if we reveal the underlying learning algorithm. To demonstrate the generality of our proposed approach and its potential for handling cyber security applications, we evaluate our method and several other existing solutions on datasets publicly available. Our results indicate that our approach typically provides superior classification performance and resistance in comparison with state-of-art solutions.

cs.LG↗

arXiv2017

Towards Interrogating Discriminative Machine Learning Models

It is oftentimes impossible to understand how machine learning models reach a decision. While recent research has proposed various technical approaches to provide some clues as to how a learning model makes individual decisions, they cannot provide users with ability to inspect a learning model as a complete entity. In this work, we propose a new technical approach that augments a Bayesian regression mixture model with multiple elastic nets. Using the enhanced mixture model, we extract explanations for a target model through global approximation. To demonstrate the utility of our approach, we evaluate it on different learning models covering the tasks of text mining and image recognition. Our results indicate that the proposed approach not only outperforms the state-of-the-art technique in explaining individual decisions but also provides users with an ability to discover the vulnerabilities of a learning model.

cs.LG↗

arXiv2017

Adversary Resistant Deep Neural Networks with an Application to Malware Detection

Beyond its highly publicized victories in Go, there have been numerous successful applications of deep learning in information retrieval, computer vision and speech recognition. In cybersecurity, an increasing number of companies have become excited about the potential of deep learning, and have started to use it for various security incidents, the most popular being malware detection. These companies assert that deep learning (DL) could help turn the tide in the battle against malware infections. However, deep neural networks (DNNs) are vulnerable to adversarial samples, a flaw that plagues most if not all statistical learning models. Recent research has demonstrated that those with malicious intent can easily circumvent deep learning-powered malware detection by exploiting this flaw. In order to address this problem, previous work has developed various defense mechanisms that either augmenting training data or enhance model's complexity. However, after a thorough analysis of the fundamental flaw in DNNs, we discover that the effectiveness of current defenses is limited and, more importantly, cannot provide theoretical guarantees as to their robustness against adversarial sampled-based attacks. As such, we propose a new adversary resistant technique that obstructs attackers from constructing impactful adversarial samples by randomly nullifying features within samples. In this work, we evaluate our proposed technique against a real world dataset with 14,679 malware variants and 17,399 benign programs. We theoretically validate the robustness of our technique, and empirically show that our technique significantly boosts DNN robustness to adversarial samples while maintaining high accuracy in classification. To demonstrate the general applicability of our proposed method, we also conduct experiments using the MNIST and CIFAR-10 datasets, generally used in image recognition research.

cs.LG↗