arXiv subjects

Kai Sun

Publications and source records attributed to Kai Sun.

At least 253 records · Page 14Linked to original sources

arXiv2021

Photonic implementation of Majorana-based Berry phases

Geometric phases, generated by cyclic evolutions of quantum systems, offer an inspiring playground for advancing fundamental physics and technologies, alike. Intriguingly, the exotic statistics of anyons realised in physical systems can be interpreted as a topological version of geometric phases. However, non-Abelian statistics has not yet been demonstrated in the laboratory. Here we employ an all optical quantum system that simulates the statistical evolution of Majorana fermions. As a result we experimentally realise non-Abelian Berry phases with the topological characteristic that they are invariant under continues deformations of their control parameters. We implement a universal set of Majorana inspired gates by performing topological and non-topological evolutions and investigate their resilience against perturbative errors. Our photonic experiment, while it is not scalable, it suggests the intriguing possibility of experimentally simulating Majorana statistics with scalable technologies.

quant-ph↗

arXiv2021

Power System Differential-Algebraic Equations

This document presents an introduction of two commonly used power system differential algebraic equations for studying electromechanical oscillation and transient stability. Two types of generator models are used to formulate the power system model, respectively: the second-order classical model and the fourth-order generator model. An example is provided on the IEEE 9-bus system.

eess.SY↗

arXiv2021

Amplitude Mode in Quantum Magnets via Dimensional Crossover

We investigate the amplitude (Higgs) mode associated with longitudinal fluctuations of the order parameter at the continuous spontaneous symmetry breaking phase transition. In quantum magnets, due to the fast decay of the amplitude mode into low-energy Goldstone excitations, direct observation of this mode represents a challenging task. By focusing on a quasi-one-dimensional geometry, we circumvent the difficulty and investigate the amplitude mode in a system of weakly coupled spin chains with the help of quantum Monte Carlo simulations, stochastic analytic continuation, and a chain-mean field approach combined with a mapping to the field-theoretic sine-Gordon model. The amplitude mode is observed to emerge in the longitudinal spin susceptibility in the presence of a weak symmetry-breaking staggered field. A conventional measure of the amplitude mode in higher dimensions, the singlet bond mode, is found to appear at a lower than the amplitude mode frequency. We identify these two excitations with the second (first) breather of the sine-Gordon theory, correspondingly. In contrast to higher-dimensional systems, the amplitude and bond order fluctuations are found to carry significant spectral weight in the quasi-1D limit.

cond-mat.str-el↗

arXiv2021

OmiEmbed: a unified multi-task deep learning framework for multi-omics data

High-dimensional omics data contains intrinsic biomedical information that is crucial for personalised medicine. Nevertheless, it is challenging to capture them from the genome-wide data due to the large number of molecular features and small number of available samples, which is also called 'the curse of dimensionality' in machine learning. To tackle this problem and pave the way for machine learning aided precision medicine, we proposed a unified multi-task deep learning framework named OmiEmbed to capture biomedical information from high-dimensional omics data with the deep embedding and downstream task modules. The deep embedding module learnt an omics embedding that mapped multiple omics data types into a latent space with lower dimensionality. Based on the new representation of multi-omics data, different downstream task modules were trained simultaneously and efficiently with the multi-task strategy to predict the comprehensive phenotype profile of each sample. OmiEmbed support multiple tasks for omics data including dimensionality reduction, tumour type classification, multi-omics integration, demographic and clinical feature reconstruction, and survival prediction. The framework outperformed other methods on all three types of downstream tasks and achieved better performance with the multi-task strategy comparing to training them individually. OmiEmbed is a powerful and unified framework that can be widely adapted to various application of high-dimensional omics data and has a great potential to facilitate more accurate and personalised clinical decision making.

q-bio.GN↗

arXiv2021

Frustrated Self-Assembly of Non-Euclidean Crystals of Nanoparticles

Self-organized complex structures in nature, e.g. viral capsids, hierarchical biopolymers, and bacterial flagella, offer efficiency, adaptability, robustness, and multi-functionality. Can we program the self-assembly of three-dimensional (3D) complex structures with simple building blocks, and reach similar or higher level of sophistication in engineered materials? Here we present an analytic theory of tetrahedral nanoparticles (NPs) self-assembling in 3D space, where unavoidable geometrical frustration combined with competing attractive and repulsive inter-particle interactions lead to controllable, high-yield, and enantiopure self-assembly of helicoidal ribbons. This theory, based on crystal structures in non-Euclidean space, predicts morphologies that exhibit qualitative agreement with experimental observations. We expect that this theory will offer a general framework for the self-assembly of simple polyhedral building blocks into complex morphologies with new material capabilities such as tunable optical activity, essential for multiple emerging technologies.

cond-mat.soft↗

arXiv2021

Adding Chit-Chat to Enhance Task-Oriented Dialogues

Existing dialogue corpora and models are typically designed under two disjoint motives: while task-oriented systems focus on achieving functional goals (e.g., booking hotels), open-domain chatbots aim at making socially engaging conversations. In this work, we propose to integrate both types of systems by Adding Chit-Chat to ENhance Task-ORiented dialogues (ACCENTOR), with the goal of making virtual assistant conversations more engaging and interactive. Specifically, we propose a Human <-> AI collaborative data collection approach for generating diverse chit-chat responses to augment task-oriented dialogues with minimal annotation effort. We then present our new chit-chat-based annotations to 23.8K dialogues from two popular task-oriented datasets (Schema-Guided Dialogue and MultiWOZ 2.1) and demonstrate their advantage over the originals via human evaluation. Lastly, we propose three new models for adding chit-chat to task-oriented dialogues, explicitly trained to predict user goals and to generate contextually relevant chit-chat responses. Automatic and human evaluations show that, compared with the state-of-the-art task-oriented baseline, our models can code-switch between task and chit-chat to be more engaging, interesting, knowledgeable, and humanlike, while maintaining competitive task performance.

cs.CL↗

arXiv2021

When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method

Infrared and visible image fusion, as a hot topic in image processing and image enhancement, aims to produce fused images retaining the detail texture information in visible images and the thermal radiation information in infrared images. A critical step for this issue is to decompose features in different scales and to merge them separately. In this paper, we propose a novel dual-stream auto-encoder (AE) based fusion network. The core idea is that the encoder decomposes an image into base and detail feature maps with low- and high-frequency information, respectively, and that the decoder is responsible for the original image reconstruction. To this end, a well-designed loss function is established to make the base/detail feature maps similar/dissimilar. In the test phase, base and detail feature maps are respectively merged via an additional fusion layer, which contains a saliency weighted-based spatial attention module and a channel attention module to adaptively preserve more information from source images and to highlight the objects. Then the fused image is recovered by the decoder. Qualitative and quantitative results demonstrate that our method can generate fusion images containing highlighted targets and abundant detail texture information with strong reproducibility and meanwhile is superior to the state-of-the-art (SOTA) approaches.

eess.IV↗

arXiv2021

A Replication Study of Dense Passage Retriever

Text retrieval using learned dense representations has recently emerged as a promising alternative to "traditional" text retrieval using sparse bag-of-words representations. One recent work that has garnered much attention is the dense passage retriever (DPR) technique proposed by Karpukhin et al. (2020) for end-to-end open-domain question answering. We present a replication study of this work, starting with model checkpoints provided by the authors, but otherwise from an independent implementation in our group's Pyserini IR toolkit and PyGaggle neural text ranking library. Although our experimental results largely verify the claims of the original paper, we arrived at two important additional findings that contribute to a better understanding of DPR: First, it appears that the original authors under-report the effectiveness of the BM25 baseline and hence also dense--sparse hybrid retrieval results. Second, by incorporating evidence from the retriever and an improved answer span scoring technique, we are able to improve end-to-end question answering effectiveness using exactly the same models as in the original work.

cs.CL↗

arXiv2021

Twist engineering of the two-dimensional magnetism in double bilayer chromium triiodide homostructures

Twist engineering, or the alignment of two-dimensional (2D) crystalline layers with desired orientations, has led to tremendous success in modulating the charge degree of freedom in hetero- and homo-structures, in particular, in achieving novel correlated and topological electronic phases in moiré electronic crystals. However, although pioneering theoretical efforts have predicted nontrivial magnetism and magnons out of twisting 2D magnets, experimental realization of twist engineering spin degree of freedom remains elusive. Here, we leverage the archetypal 2D Ising magnet chromium triiodide (CrI3) to fabricate twisted double bilayer homostructures with tunable twist angles and demonstrate the successful twist engineering of 2D magnetism in them. Using linear and circular polarization-resolved Raman spectroscopy, we identify magneto-Raman signatures of a new magnetic ground state that is sharply distinct from those in natural bilayer (2L) and four-layer (4L) CrI3. With careful magnetic field and twist angle dependence, we reveal that, for a very small twist angle (~ 0.5 degree), this emergent magnetism can be well-approximated by a weighted linear superposition of those of 2L and 4L CI3 whereas, for a relatively large twist angle (~ 5 degree), it mostly resembles that of isolated 2L CrI3. Remarkably, at an intermediate twist angle (~ 1.1 degree), its magnetism cannot be simply inferred from the 2L and 4L cases, because it lacks sharp spin-flip transitions that are present in 2L and 4L CrI3 and features a dramatic Raman circular dichroism that is absent in natural 2L and 4L ones. Our results demonstrate the possibility of designing and controlling the spin degree of freedom in 2D magnets using twist engineering.

cond-mat.mtrl-sci↗

arXiv2021

Contingency Analysis Based on Partitioned and Parallel Holomorphic Embedding

In the steady-state contingency analysis, the traditional Newton-Raphson method suffers from non-convergence issues when solving post-outage power flow problems, which hinders the integrity and accuracy of security assessment. In this paper, we propose a novel robust contingency analysis approach based on holomorphic embedding (HE). The HE-based simulator guarantees convergence if the true power flow solution exists, which is desirable because it avoids the influence of numerical issues and provides a credible security assessment conclusion. In addition, based on the multi-area characteristics of real-world power systems, a partitioned HE (PHE) method is proposed with an interface-based partitioning of HE formulation. The PHE method does not undermine the numerical robustness of HE and significantly reduces the computation burden in large-scale contingency analysis. The PHE method is further enhanced by parallel or distributed computation to become parallel PHE (P${}^\mathrm{2}$HE). Tests on a 458-bus system, a synthetic 419-bus system and a large-scale 21447-bus system demonstrate the advantages of the proposed methods in robustness and efficiency.

cs.DC↗

arXiv2021

Self-Teaching Machines to Read and Comprehend with Large-Scale Multi-Subject Question-Answering Data

In spite of much recent research in the area, it is still unclear whether subject-area question-answering data is useful for machine reading comprehension (MRC) tasks. In this paper, we investigate this question. We collect a large-scale multi-subject multiple-choice question-answering dataset, ExamQA, and use incomplete and noisy snippets returned by a web search engine as the relevant context for each question-answering instance to convert it into a weakly-labeled MRC instance. We then propose a self-teaching paradigm to better use the generated weakly-labeled MRC instances to improve a target MRC task. Experimental results show that we can obtain +5.1% in accuracy on a multiple-choice MRC dataset, C^3, and +3.8% in exact match on an extractive MRC dataset, CMRC 2018 over state-of-the-art MRC baselines, demonstrating the effectiveness of our framework and the usefulness of large-scale subject-area question-answering data for different types of machine reading comprehension tasks.

cs.CL↗

arXiv2021

Photonic implementation of quantum information masking

Masking of quantum information spreads it over nonlocal correlations and hides it from the subsystems. It is known that no operation can simultaneously mask all pure states [Phys. Rev. Lett. 120, 230501 (2018)], so in what sense is quantum information masking useful? Here, we extend the definition of quantum information masking to general mixed states, and show that the resource of maskable quantum states are far more abundant than the no-go theorem seemingly suggests. Geometrically, the simultaneously maskable states lays on hyperdisks in the state hypersphere, and strictly contain the broadcastable states. We devise a photonic quantum information masking machine using time-correlated photons to experimentally investigate the properties of qubit masking, and demonstrate the transfer of quantum information into bipartite correlations and its faithful retrieval. The versatile masking machine has decent extensibility, and may be applicable to quantum secret sharing and fault-tolerant quantum communication. Our results provide some insights on the comprehension and potential application of quantum information masking.

quant-ph↗

arXiv2021

Experimental quantum phase discrimination enhanced by controllable indistinguishability-based coherence

Quantum coherence, a basic feature of quantum mechanics residing in superpositions of quantum states, is a resource for quantum information processing. Coherence emerges in a fundamentally different way for nonidentical and identical particles, in that for the latter a unique contribution exists linked to indistinguishability which cannot occur for nonidentical particles. We experimentally demonstrate by an optical setup this additional contribution to quantum coherence, showing that its amount directly depends on the degree of indistinguishability and exploiting it to run a quantum phase discrimination protocol. Furthermore, the designed setup allows for simulating Fermionic particles with photons, thus assessing the role of particle statistics (Bosons or Fermions) in coherence generation and utilization. Our experiment proves that independent indistinguishable particles can supply a controllable resource of coherence for quantum metrology.

quant-ph↗

arXiv2021

Stochastic Power System Simulation Using the Adomian Decomposition Method

Considering increasing distributed energy resources and responsive loads in smart grid, this paper proposes a stochastic simulation approach for stability analysis of a power system having stochastic loads. The proposed approach solves a stochastic, nonlinear differential equation model of the system in an analytical way by the Adomian decomposition method and generates semi-analytical solutions that express both deterministic and stochastic state variables explicitly as symbolic variables so as to embed stochastic processes directly into the solutions for efficient stability analysis with uncertainties. The proposed approach is tested on the New England 10-machine 39-bus system with different penetration levels of stochastic loads. The approach is also benchmarked with a traditional stochastic simulation approach based on the Euler-Maruyama method. The results show that the new approach has better time performance and a comparable accuracy.

eess.SY↗

arXiv2021

Privacy Preservation in Federated Learning: An insightful survey from the GDPR Perspective

Along with the blooming of AI and Machine Learning-based applications and services, data privacy and security have become a critical challenge. Conventionally, data is collected and aggregated in a data centre on which machine learning models are trained. This centralised approach has induced severe privacy risks to personal data leakage, misuse, and abuse. Furthermore, in the era of the Internet of Things and big data in which data is essentially distributed, transferring a vast amount of data to a data centre for processing seems to be a cumbersome solution. This is not only because of the difficulties in transferring and sharing data across data sources but also the challenges on complying with rigorous data protection regulations and complicated administrative procedures such as the EU General Data Protection Regulation (GDPR). In this respect, Federated learning (FL) emerges as a prospective solution that facilitates distributed collaborative learning without disclosing original training data whilst naturally complying with the GDPR. Recent research has demonstrated that retaining data and computation on-device in FL is not sufficient enough for privacy-guarantee. This is because ML model parameters exchanged between parties in an FL system still conceal sensitive information, which can be exploited in some privacy attacks. Therefore, FL systems shall be empowered by efficient privacy-preserving techniques to comply with the GDPR. This article is dedicated to surveying on the state-of-the-art privacy-preserving techniques which can be employed in FL in a systematic fashion, as well as how these techniques mitigate data security and privacy risks. Furthermore, we provide insights into the challenges along with prospective approaches following the GDPR regulatory guidelines that an FL system shall implement to comply with the GDPR.

cs.CR↗

arXiv2021

Deep Convolutional Sparse Coding Network for Pansharpening with Guidance of Side Information

Pansharpening is a fundamental issue in remote sensing field. This paper proposes a side information partially guided convolutional sparse coding (SCSC) model for pansharpening. The key idea is to split the low resolution multispectral image into a panchromatic image related feature map and a panchromatic image irrelated feature map, where the former one is regularized by the side information from panchromatic images. With the principle of algorithm unrolling techniques, the proposed model is generalized as a deep neural network, called as SCSC pansharpening neural network (SCSC-PNN). Compared with 13 classic and state-of-the-art methods on three satellites, the numerical experiments show that SCSC-PNN is superior to others. The codes are available at https://github.com/xsxjtu/SCSC-PNN.

cs.CV↗

arXiv2021

Deep Gradient Projection Networks for Pan-sharpening

Pan-sharpening is an important technique for remote sensing imaging systems to obtain high resolution multispectral images. Recently, deep learning has become the most popular tool for pan-sharpening. This paper develops a model-based deep pan-sharpening approach. Specifically, two optimization problems regularized by the deep prior are formulated, and they are separately responsible for the generative models for panchromatic images and low resolution multispectral images. Then, the two problems are solved by a gradient projection algorithm, and the iterative steps are generalized into two network blocks. By alternatively stacking the two blocks, a novel network, called gradient projection based pan-sharpening neural network, is constructed. The experimental results on different kinds of satellite datasets demonstrate that the new network outperforms state-of-the-art methods both visually and quantitatively. The codes are available at https://github.com/xsxjtu/GPPNN.

cs.CV↗

arXiv2021

A Blockchain-based Trust System for Decentralised Applications: When trustless needs trust

Blockchain technology has been envisaged to commence an era of decentralised applications and services (DApps) without the need for a trusted intermediary. Such DApps open a marketplace in which services are delivered to end-users by contributors which are then incentivised by cryptocurrencies in an automated, peer-to-peer, and trustless fashion. However, blockchain, consolidated by smart contracts, only ensures on-chain data security, autonomy and integrity of the business logic execution defined in smart contracts. It cannot guarantee the quality of service of DApps, which entirely depends on the services' performance. Thus, there is a critical need for a trust system to reduce the risk of dealing with fraudulent counterparts in a blockchain network. These reasons motivate us to develop a fully decentralised trust framework deployed on top of a blockchain platform, operating along with DApps in the marketplace to demoralise deceptive entities while encouraging trustworthy ones. The trust system works as an underlying decentralised service providing a feedback mechanism for end-users and maintaining trust relationships among them in the ecosystem accordingly. We believe this research fortifies the DApps ecosystem by introducing an universal trust middleware for DApps as well as shedding light on the implementation of a decentralised trust system.

cs.CR↗