arXiv subjects

Xinyi Wang

Publications and source records attributed to Xinyi Wang.

At least 199 records · Page 11Linked to original sources

arXiv2023

Approach to Hyperuniformity in a Metallic Glass-Forming Material Exhibiting a Fragile to Strong Glass Transition

We investigate a metallic glass-forming (GF) material (Al90Sm10) exhibiting a fragile-strong (FS) glass-formation by molecular dynamics simulation to better understand this highly distinctive pattern of glass-formation in which many of the usual phenomenological relations describing relaxation times and diffusion of OGF liquids no longer apply, and where instead genuine thermodynamic features are observed in response functions and little thermodynamic signature is exhibited at the glass transition temperature, Tg. Given the many unexpected similarities between the thermodynamics and dynamics of this metallic GF material with water, we first focus on the anomalous static scattering in this liquid, following recent studies on water, silicon and other FS GF liquids. In particular, we quantify the 'hyperuniformity index' H of our liquid which provides a quantitative measure of molecular 'jamming'. To gain insight into the T-dependence and magnitude of H, we also estimated another more familiar measure of particle localization, the Debye-Waller parameter $ $ describing the mean-square particle displacement on a timescale on the order of the fast relaxation time, and we also calculate H and $ $ for heated crystalline Cu. This comparative analysis between H and $ $ for crystalline and metallic glass materials allows us to understand the critical value of H on the order of $10^{-3}$ as being analogous to the Lindemann criterion for both the melting of crystals and the 'softening' of glasses. We further interpret the emergence of FS GF and liquid-liquid phase separation in this class of liquids to arise from a cooperative assembly process in the GF liquid.

cond-mat.soft↗

arXiv2023

XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages

Data scarcity is a crucial issue for the development of highly multilingual NLP systems. Yet for many under-represented languages (ULs) -- languages for which NLP re-search is particularly far behind in meeting user needs -- it is feasible to annotate small amounts of data. Motivated by this, we propose XTREME-UP, a benchmark defined by: its focus on the scarce-data scenario rather than zero-shot; its focus on user-centric tasks -- tasks with broad adoption by speakers of high-resource languages; and its focus on under-represented languages where this scarce-data scenario tends to be most realistic. XTREME-UP evaluates the capabilities of language models across 88 under-represented languages over 9 key user-centric technologies including ASR, OCR, MT, and information access tasks that are of general utility. We create new datasets for OCR, autocomplete, semantic parsing, and transliteration, and build on and refine existing datasets for other tasks. XTREME-UP provides methodology for evaluating many modeling scenarios including text-only, multi-modal (vision, audio, and text),supervised parameter tuning, and in-context learning. We evaluate commonly used models on the benchmark. We release all code and scripts to train and evaluate models

cs.CL↗

arXiv2023

mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations

Multilingual sequence-to-sequence models perform poorly with increased language coverage and fail to consistently generate text in the correct target language in few-shot settings. To address these challenges, we propose mmT5, a modular multilingual sequence-to-sequence model. mmT5 utilizes language-specific modules during pre-training, which disentangle language-specific information from language-agnostic information. We identify representation drift during fine-tuning as a key limitation of modular generative models and develop strategies that enable effective zero-shot transfer. Our model outperforms mT5 at the same parameter sizes by a large margin on representative natural language understanding and generation tasks in 40+ languages. Compared to mT5, mmT5 raises the rate of generating text in the correct language under zero-shot settings from 7% to 99%, thereby greatly alleviating the source language hallucination problem.

cs.CL↗

arXiv2023

Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction

Continual few-shot relation extraction (RE) aims to continuously train a model for new relations with few labeled training data, of which the major challenges are the catastrophic forgetting of old relations and the overfitting caused by data sparsity. In this paper, we propose a new model, namely SCKD, to accomplish the continual few-shot RE task. Specifically, we design serial knowledge distillation to preserve the prior knowledge from previous models and conduct contrastive learning with pseudo samples to keep the representations of samples in different relations sufficiently distinguishable. Our experiments on two benchmark datasets validate the effectiveness of SCKD for continual few-shot RE and its superiority in knowledge transfer and memory utilization over state-of-the-art models.

cs.CL↗

arXiv2023

Sampling-based path planning under temporal logic constraints with real-time adaptation

Replanning in temporal logic tasks is extremely difficult during the online execution of robots. This study introduces an effective path planner that computes solutions for temporal logic goals and instantly adapts to non-static and partially unknown environments. Given prior knowledge and a task specification, the planner first identifies an initial feasible solution by growing a sampling-based search tree. While carrying out the computed plan, the robot maintains a solution library to continuously enhance the unfinished part of the plan and store backup plans. The planner updates existing plans when meeting unexpected obstacles or recognizing flaws in prior knowledge. Upon a high-level path is obtained, a trajectory generator tracks the path by dividing it into segments of motion primitives. Our planner is integrated into an autonomous mobile robot system, further deployed on a multicopter with limited onboard processing power. In simulation and real-world experiments, our planner is demonstrated to swiftly and effectively adjust to environmental uncertainties.

cs.RO↗

arXiv2023

Causal Balancing for Domain Generalization

While machine learning models rapidly advance the state-of-the-art on various real-world tasks, out-of-domain (OOD) generalization remains a challenging problem given the vulnerability of these models to spurious correlations. We propose a balanced mini-batch sampling strategy to transform a biased data distribution into a spurious-free balanced distribution, based on the invariance of the underlying causal mechanisms for the data generation process. We argue that the Bayes optimal classifiers trained on such balanced distribution are minimax optimal across a diverse enough environment space. We also provide an identifiability guarantee of the latent variable model of the proposed data generation process, when utilizing enough train environments. Experiments are conducted on DomainBed, demonstrating empirically that our method obtains the best performance across 20 baselines reported on the benchmark.

cs.LG↗

arXiv2023

Air-Ground Integrated Sensing and Communications: Opportunities and Challenges

The air-ground integrated sensing and communications (AG-ISAC) network, which consists of unmanned aerial vehicles (UAVs) and ground terrestrial networks, offers unique capabilities and demands special design techniques. In this article, we provide a review on AG-ISAC, by introducing UAVs as ``relay'' nodes for both communications and sensing to resolve the power and computation constraints on UAVs. We first introduce an AG-ISAC framework, including the system architecture and protocol. Four potential use cases are then discussed, with the analysis on the characteristics and merits of AG-ISAC networks. The research on several critical techniques for AG-ISAC is then discussed. Finally, we present our vision of the challenges and future research directions for AG-ISAC, to facilitate the advancement of the technology.

eess.SP↗

arXiv2023

PECO: Examining Single Sentence Label Leakage in Natural Language Inference Datasets through Progressive Evaluation of Cluster Outliers

Building natural language inference (NLI) benchmarks that are both challenging for modern techniques, and free from shortcut biases is difficult. Chief among these biases is "single sentence label leakage," where annotator-introduced spurious correlations yield datasets where the logical relation between (premise, hypothesis) pairs can be accurately predicted from only a single sentence, something that should in principle be impossible. We demonstrate that despite efforts to reduce this leakage, it persists in modern datasets that have been introduced since its 2018 discovery. To enable future amelioration efforts, introduce a novel model-driven technique, the progressive evaluation of cluster outliers (PECO) which enables both the objective measurement of leakage, and the automated detection of subpopulations in the data which maximally exhibit it.

cs.CL↗

arXiv2022

MHD simulation of Solar Eruption from Active Region 11429 Driven by Photospheric Velocity Field

Data-driven simulation is becoming an important approach for realistically characterizing the configuration and evolution of solar active regions, revealing the onset mechanism of solar eruption events and hopefully achieving the goal of accurate space weather forecast, which is beyond the scope of any existing theoretical modelling. Here we performed a full 3D MHD simulation using the data-driven approach and followed the whole evolution process from quasi-static phase to eruption successfully for solar active region NOAA 11429. The MHD system was driven at the bottom boundary by photospheric velocity field, which is derived by the DAVE4VM method from the observed vector magnetograms. The simulation shows that a magnetic flux rope was generated by persistent photospheric flow before the flare onset and then triggered to erupt by torus instability. Our simulation demonstrates a high degree of consistency with observations in the pre-eruption magnetic structure, the time scale of quasi-static stage, the pattern of flare ribbons as well as the time evolution of magnetic energy injection and total unsigned magnetic flux. We further found that an eruption can also be initiated in the simulation as driven by only the horizontal components of photospheric flow, but a comparison of the different simulations indicates that the vertical flow at the bottom boundary is necessary in reproducing more realistically these observed features, emphasizing the importance of flux emergence during the development of this AR.

astro-ph.SR↗

arXiv2022

Quantum-coherence-free precision metrology by means of difference-signal amplification

The novel weak-value-amplification (WVA) scheme of precision metrology is deeply rooted in the quantum nature of destructive interference between the pre- and post-selection states. And, an alternative version, termed as joint WVA (JWVA), which employs the difference-signal from the post-selection accepted and rejected results, has been found possible to achieve even better sensitivity (two orders of magnitude higher) under some technical limitations (e.g. misalignment errors). In this work, after erasing the quantum coherence, we analyze the difference-signal amplification (DSA) technique, which serves as a classical counterpart of the JWVA, and show that similar amplification effect can be achieved. We obtain a simple expression for the amplified signal, carry out characterization of precision, and point out the optimal working regime. We also discuss how to implement the post-selection of a classical mixed state. The proposed classical DSA technique holds similar technical advantages of the JWVA and may find interesting applications in practice.

quant-ph↗

arXiv2022

A Survey of Face Recognition

Recent years witnessed the breakthrough of face recognition with deep convolutional neural networks. Dozens of papers in the field of FR are published every year. Some of them were applied in the industrial community and played an important role in human life such as device unlock, mobile payment, and so on. This paper provides an introduction to face recognition, including its history, pipeline, algorithms based on conventional manually designed features or deep learning, mainstream training, evaluation datasets, and related applications. We have analyzed and compared state-of-the-art works as many as possible, and also carefully designed a set of experiments to find the effect of backbone size and data distribution. This survey is a material of the tutorial named The Practical Face Recognition Technology in the Industrial World in the FG2023.

cs.CV↗

arXiv2022

Taxonomy of Benchmarks in Graph Representation Learning

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a collection of graph representation learning benchmarks, it is currently not well understood what aspects of a given model are probed by them. For example, to what extent do they test the ability of a model to leverage graph structure vs. node features? Here, we develop a principled approach to taxonomize benchmarking datasets according to a $\textit{sensitivity profile}$ that is based on how much GNN performance changes due to a collection of graph perturbations. Our data-driven analysis provides a deeper understanding of which benchmarking data characteristics are leveraged by GNNs. Consequently, our taxonomy can aid in selection and development of adequate graph benchmarks, and better informed evaluation of future GNN methods. Finally, our approach and implementation in $\texttt{GTaxoGym}$ package are extendable to multiple graph prediction task types and future datasets.

cs.LG↗

arXiv2022

TW-BAG: Tensor-wise Brain-aware Gate Network for Inpainting Disrupted Diffusion Tensor Imaging

Diffusion Weighted Imaging (DWI) is an advanced imaging technique commonly used in neuroscience and neurological clinical research through a Diffusion Tensor Imaging (DTI) model. Volumetric scalar metrics including fractional anisotropy, mean diffusivity, and axial diffusivity can be derived from the DTI model to summarise water diffusivity and other quantitative microstructural information for clinical studies. However, clinical practice constraints can lead to sub-optimal DWI acquisitions with missing slices (either due to a limited field of view or the acquisition of disrupted slices). To avoid discarding valuable subjects for group-wise studies, we propose a novel 3D Tensor-Wise Brain-Aware Gate network (TW-BAG) for inpainting disrupted DTIs. The proposed method is tailored to the problem with a dynamic gate mechanism and independent tensor-wise decoders. We evaluated the proposed method on the publicly available Human Connectome Project (HCP) dataset using common image similarity metrics derived from the predicted tensors and scalar DTI metrics. Our experimental results show that the proposed approach can reconstruct the original brain DTI volume and recover relevant clinical imaging information.

eess.IV↗

arXiv2022

Novelty Detection in Time Series via Weak Innovations Representation: A Deep Learning Approach

We consider novelty detection in time series with unknown and nonparametric probability structures. A deep learning approach is proposed to causally extract an innovations sequence consisting of novelty samples statistically independent of all past samples of the time series. A novelty detection algorithm is developed for the online detection of novel changes in the probability structure in the innovations sequence. A minimax optimality under a Bayes risk measure is established for the proposed novelty detection method, and its robustness and efficacy are demonstrated in experiments using real and synthetic datasets.

cs.LG↗

arXiv2022

A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models

Recent work on tokenizer-free multilingual pretrained models show promising results in improving cross-lingual transfer and reducing engineering overhead (Clark et al., 2022; Xue et al., 2022). However, these works mainly focus on reporting accuracy on a limited set of tasks and data settings, placing less emphasis on other important factors when tuning and deploying the models in practice, such as memory usage, inference speed, and fine-tuning data robustness. We attempt to fill this gap by performing a comprehensive empirical comparison of multilingual tokenizer-free and subword-based models considering these various dimensions. Surprisingly, we find that subword-based models might still be the most practical choice in many settings, achieving better performance for lower inference latency and memory usage. Based on these results, we encourage future work in tokenizer-free methods to consider these factors when designing and evaluating new models.

cs.CL↗

arXiv2022

Semantic Preserving Adversarial Attack Generation with Autoencoder and Genetic Algorithm

Widely used deep learning models are found to have poor robustness. Little noises can fool state-of-the-art models into making incorrect predictions. While there is a great deal of high-performance attack generation methods, most of them directly add perturbations to original data and measure them using L_p norms; this can break the major structure of data, thus, creating invalid attacks. In this paper, we propose a black-box attack, which, instead of modifying original data, modifies latent features of data extracted by an autoencoder; then, we measure noises in semantic space to protect the semantics of data. We trained autoencoders on MNIST and CIFAR-10 datasets and found optimal adversarial perturbations using a genetic algorithm. Our approach achieved a 100% attack success rate on the first 100 data of MNIST and CIFAR-10 datasets with less perturbation than FGSM.

cs.LG↗

arXiv2022

MHD Simulation of Homologous Eruptions from Solar Active Region 10930 Caused by Sunspot Rotation

The relationship between solar eruption and sunspot rotation has been widely reported, and the underlying mechanism requires to be studied. Here we performed a full 3D MHD simulation of data-constrained approach to study the mechanism of flare eruptions in active region (AR) NOAA 10930, which is characterized by continuous sunspot rotation and homologous eruptions. We reconstructed the potential magnetic field from the magnetogram of Hinode/SOT as the initial condition and drove the MHD system by applying continuous sunspot rotation at the bottom boundary. The key magnetic structure before the major eruptions and the pre-formed current sheet were derived, which is responsible for the complex MHD evolution with multiple stages. The major eruptions were triggered directly by fast reconnection in the pre-formed current sheet above the main polarity inversion line between the two major magnetic polarities of the AR. Furthermore, our simulation shows the homologous eruption successfully. It has reasonable consistence with observations in relative strength, energy release, X-ray and Hα features and time interval of eruptions. In addition, the rotation angle of the sunspot before the first eruption in the simulation is also close to the observed value. Our simulation offers a scenario different from many previous studies based on ideal instabilities of twisted magnetic flux rope, and shows the importance of sunspot rotation and magnetic reconnection in efficiently producing homologous eruptions by continuous energy injection and impulsive energy release in a recurrent way.

astro-ph.SR↗

arXiv2022

Enhancing Document-level Relation Extraction by Entity Knowledge Injection

Document-level relation extraction (RE) aims to identify the relations between entities throughout an entire document. It needs complex reasoning skills to synthesize various knowledge such as coreferences and commonsense. Large-scale knowledge graphs (KGs) contain a wealth of real-world facts, and can provide valuable knowledge to document-level RE. In this paper, we propose an entity knowledge injection framework to enhance current document-level RE models. Specifically, we introduce coreference distillation to inject coreference knowledge, endowing an RE model with the more general capability of coreference reasoning. We also employ representation reconciliation to inject factual knowledge and aggregate KG representations and document representations into a unified space. The experiments on two benchmark datasets validate the generalization of our entity knowledge injection framework and the consistent improvement to several document-level RE models.

cs.CL↗