arXiv subjects

Yue Liu

Publications and source records attributed to Yue Liu.

At least 325 records · Page 18Linked to original sources

arXiv2021

Lagrangian Inference for Ranking Problems

We propose a novel combinatorial inference framework to conduct general uncertainty quantification in ranking problems. We consider the widely adopted Bradley-Terry-Luce (BTL) model, where each item is assigned a positive preference score that determines the Bernoulli distributions of pairwise comparisons' outcomes. Our proposed method aims to infer general ranking properties of the BTL model. The general ranking properties include the "local" properties such as if an item is preferred over another and the "global" properties such as if an item is among the top $K$-ranked items. We further generalize our inferential framework to multiple testing problems where we control the false discovery rate (FDR), and apply the method to infer the top-$K$ ranked items. We also derive the information-theoretic lower bound to justify the minimax optimality of the proposed method. We conduct extensive numerical studies using both synthetic and real datasets to back up our theory.

stat.ML↗

arXiv2021

Mutation frequency time series reveal complex mixtures of clones in the world-wide SARS-CoV-2 viral population

We compute the allele frequencies of the alpha (B.1.1.7), beta (B.1.351) and delta (B.167.2) variants of SARS-CoV-2 from almost two million genome sequences on the GISAID repository. We find that the frequencies of a majority of the defining mutations in alpha rose towards the end of 2020 but drifted apart during spring 2021, a similar pattern being followed by delta during summer of 2021. For beta we find a more complex scenario with frequencies of some mutations rising and some remaining close to zero. Our results point to that what is generally reported as single variants is in fact a collection of variants with different genetic characteristics. For all three variants we further find some alleles with a clearly deviating time series.

q-bio.PE↗

arXiv2021

A Hybrid System for Learning Classical Data in Quantum States

Deep neural network powered artificial intelligence has rapidly changed our daily life with various applications. However, as one of the essential steps of deep neural networks, training a heavily weighted network requires a tremendous amount of computing resources. Especially in the post-Moore's Law era, the limit of semiconductor fabrication technology has restricted the development of learning algorithms to cope with the increasing high-intensity training data. Meanwhile, quantum computing has demonstrated its significant potential in terms of speeding up the traditionally compute-intensive workloads. For example, Google illustrated quantum supremacy by completing a sampling calculation task in 200 seconds, which is otherwise impracticable on the world's largest supercomputers. To this end, quantum-based learning has become an area of interest, with the potential of a quantum speedup. In this paper, we propose GenQu, a hybrid and general-purpose quantum framework for learning classical data through quantum states. We evaluate GenQu with real datasets and conduct experiments on both simulations and real quantum computer IBM-Q. Our evaluation demonstrates that, compared with classical solutions, the proposed models running on GenQu framework achieve similar accuracy with a much smaller number of qubits, while significantly reducing the parameter size by up to 95.86% and converging speedup by 33.33% faster.

quant-ph↗

arXiv2021

Orbital Stability of the sum of Smooth solitons in the Degasperis-Procesi Equation

The Degasperis-Procesi (DP) equation is an integrable Camassa-Holm-type model as an asymptotic approximation for the unidirectional propagation of shallow water waves. This work is to establish the $L^2\cap L^\infty$ orbital stability of a wave train containing $N$ smooth solitons which are well separated. The main difficulties stem from the subtle nonlocal structure of the DP equation. One consequence is that the energy space of the DE equation based on the conserved quantity induced by the translation symmetry is only equivalent to the $L^2$-norm, which by itself can not bound the higher-order nonlinear terms in the Lagrangian. Our remedy is to introduce \textit{a priori } estimates based on certain smooth initial conditions. Moreover, another consequence is that the nonlocal structure of the DP equation significantly complicates the verification of the monotonicity of local momentum and the positive definiteness of a refined quadratic form of the orthogonalized perturbation.

math.AP↗

arXiv2021

MHD analysis on the physical designs of CFETR and HFRC

The China Fusion Engineering Test Reactor (CFETR) and the Huazhong Field Reversed Configuration (HFRC), currently both under intensive physical and engineering designs in China, are the two major projects representative of the low-density steady-state and high-density pulsed pathways to fusion. One of the primary tasks of the physics designs for both CFETR and HFRC is the assessment and analysis of the magnetohydrodynamic (MHD) stability of the proposed design schemes. Comprehensive efforts on the assessment of MHD stability of CFETR and HFRC baseline scenarios have led to preliminary progresses that may further benefit engineering designs.

physics.plasm-ph↗

arXiv2021

Towards Demystifying Serverless Machine Learning Training

The appeal of serverless (FaaS) has triggered a growing interest on how to use it in data-intensive applications such as ETL, query processing, or machine learning (ML). Several systems exist for training large-scale ML models on top of serverless infrastructures (e.g., AWS Lambda) but with inconclusive results in terms of their performance and relative advantage over "serverful" infrastructures (IaaS). In this paper we present a systematic, comparative study of distributed ML training over FaaS and IaaS. We present a design space covering design choices such as optimization algorithms and synchronization protocols, and implement a platform, LambdaML, that enables a fair comparison between FaaS and IaaS. We present experimental results using LambdaML, and further develop an analytic model to capture cost/performance tradeoffs that must be considered when opting for a serverless infrastructure. Our results indicate that ML training pays off in serverless only for models with efficient (i.e., reduced) communication and that quickly converge. In general, FaaS can be much faster but it is never significantly cheaper than IaaS.

cs.DC↗

arXiv2021

Personalized Entity Resolution with Dynamic Heterogeneous Knowledge Graph Representations

The growing popularity of Virtual Assistants poses new challenges for Entity Resolution, the task of linking mentions in text to their referent entities in a knowledge base. Specifically, in the shopping domain, customers tend to use implicit utterances (e.g., "organic milk") rather than explicit names, leading to a large number of candidate products. Meanwhile, for the same query, different customers may expect different results. For example, with "add milk to my cart", a customer may refer to a certain organic product, while some customers may want to re-order products they regularly purchase. To address these issues, we propose a new framework that leverages personalized features to improve the accuracy of product ranking. We first build a cross-source heterogeneous knowledge graph from customer purchase history and product knowledge graph to jointly learn customer and product embeddings. After that, we incorporate product, customer, and history representations into a neural reranking model to predict which candidate is most likely to be purchased for a specific customer. Experiments show that our model substantially improves the accuracy of the top ranked candidates by 24.6% compared to the state-of-the-art product search model.

cs.CL↗

arXiv2021

Energy efficiency of voltage waveform tailoring for the generation of excited species in RF plasma jets operated in He/N$_2$ mixtures

Based on Tunable Diode Laser Absorption Spectroscopy (TDLAS) measurements of the spatially averaged and peak helium metastable atom densities in a capacitively coupled micro atmospheric pressure plasma jet operated in He/N$_2$ mixtures, the energy efficiency of metastable species (He-I 2$^3$S$_1$) generation is compared for three different scenarios: single frequency operation at (i) 13.56 MHz and (ii) 54.12 MHz, and Voltage Waveform Tailoring (VWT) at (iii) "valleys"-waveforms synthesized from four consecutive harmonics of 13.56 MHz. For each case, the dissipated power is measured based on a careful calibration procedure of voltage and current measurements. The results are compared to PIC/MCC simulation results and very good agreement is found. The computational results show that the choice of the surface coefficients in the simulation is important to reproduce the experimental data correctly. Due to the enhanced control of the spatio-temporal electron power absorption dynamics and, thus, of the electron energy distribution function by VWT, this approach does not only provide better control of the generation of excited and reactive species compared to single frequency excitation, but in case of helium metastables the energy efficiency is also shown to be significantly higher in case of VWT.

physics.plasm-ph↗

arXiv2021

Option to survive or surrender: carbon asset management and optimization in thermal power enterprises from China

Carbon emission right allowance is a double-edged sword, one edge is to reduce emission as its original design intention, another edge has in practice slain many less developed coal-consuming enterprises, especially for those in thermal power industry. Partially governed on the hilt in hands of the authority, body of this sword is the prices of carbon emission right. How should the thermal power plants dance on the blade motivates this research. Considering the impact of price fluctuations of carbon emission right allowance, we investigate the operation of Chinese thermal power plant by modeling the decision-making with optimal stopping problem, which is established on the stochastic environment with carbon emission allowance price process simulated by geometric Brownian motion. Under the overall goal of maximizing the ultimate profitability, the optimal stopping indicates the timing of suspend or halt of production, hence the optimal stopping boundary curve implies the edge of life and death with regard to this enterprise. Applying this methodology, real cases of failure and survival of several Chinese representative thermal power plants were analyzed to explore the industry ecotope, which leads to the findings that: 1) The survival environment of existed thermal power plants becomes severer when facing more pressure from the newborn carbon-finance market. 2) Boundaries of survival environment is mainly drawn by the technical improvements for rising the utilization rate of carbon emission. Based on the same optimal stopping model, outlook of this industry is drawn with a demarcation surface defining the vivosphere of thermal power plants with different levels of profitability. This finding provides benchmarks for those enterprises struggling for survival and policy makers scheming better supervision and necessary intervene.

econ.GN↗

arXiv2021

Risk Variance Penalization

The key of the out-of-distribution (OOD) generalization is to generalize invariance from training domains to target domains. The variance risk extrapolation (V-REx) is a practical OOD method, which depends on a domain-level regularization but lacks theoretical verifications about its motivation and utility. This article provides theoretical insights into V-REx by studying a variance-based regularizer. We propose Risk Variance Penalization (RVP), which slightly changes the regularization of V-REx but addresses the theory concerns about V-REx. We provide theoretical explanations and a theory-inspired tuning scheme for the regularization parameter of RVP. Our results point out that RVP discovers a robust predictor. Finally, we experimentally show that the proposed regularizer can find an invariant predictor under certain conditions.

cs.LG↗

arXiv2021

Beyond Visual Attractiveness: Physically Plausible Single Image HDR Reconstruction for Spherical Panoramas

HDR reconstruction is an important task in computer vision with many industrial needs. The traditional approaches merge multiple exposure shots to generate HDRs that correspond to the physical quantity of illuminance of the scene. However, the tedious capturing process makes such multi-shot approaches inconvenient in practice. In contrast, recent single-shot methods predict a visually appealing HDR from a single LDR image through deep learning. But it is not clear whether the previously mentioned physical properties would still hold, without training the network to explicitly model them. In this paper, we introduce the physical illuminance constraints to our single-shot HDR reconstruction framework, with a focus on spherical panoramas. By the proposed physical regularization, our method can generate HDRs which are not only visually appealing but also physically plausible. For evaluation, we collect a large dataset of LDR and HDR images with ground truth illuminance measures. Extensive experiments show that our HDR images not only maintain high visual quality but also top all baseline methods in illuminance prediction accuracy.

cs.CV↗

arXiv2021

Electron heating mode transitions in radio-frequency driven micro atmospheric pressure plasma jets in He/O$_{2}$: A fluid dynamics approach

A two-dimensional fluid model is used to investigate the electron heating dynamics and the production of neutral species in a capacitively coupled radio-frequency micro atmospheric pressure helium plasma jet -- specifically the COST jet -- with a small oxygen admixture. Electron heating mode transitions are found to be induced by varying the driving voltage amplitude and the O$_2$ concentration numerically and experimentally. The helium metastable density, and the charged species densities are highly relevant to the electron heating dynamics. By analyzing the creation and destruction mechanisms of the negative ions, we find that the generation of negative ions strongly depends on the O$_2$ concentration. The increase of the electronegativity with the increasing O$_2$ concentration leads to an enhancement of the bulk drift electric field. The distributions of the different neutral species densities along the direction of the gas flow inside the jet, as well as in the effluent differ a lot due to the relevant chemical reaction rates and the effect of the gas flow. The simulated results show that a fluid model can be an effective tool for qualitative investigations of micro atmospheric pressure plasma jets.

physics.plasm-ph↗

arXiv2021

Out-of-Distribution Generalization Analysis via Influence Function

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we are facing an Out-of-Distribution (OOD) generalization problem that aims to find a model with the best OOD accuracy. One of the definitions of OOD accuracy is worst-domain accuracy. In general, the set of target domains is unknown, and the worst over target domains may be unseen when the number of observed domains is limited. In this paper, we show that the worst accuracy over the observed domains may dramatically fail to identify the OOD accuracy. To this end, we introduce Influence Function, a classical tool from robust statistics, into the OOD generalization problem and suggest the variance of influence function to monitor the stability of a model on training domains. We show that the accuracy on test domains and the proposed index together can help us discern whether OOD algorithms are needed and whether a model achieves good OOD generalization.

cs.LG↗

arXiv2020

Electron pairing in the pseudogap state revealed by shot noise in copper-oxide junctions

In the quest to understand high-temperature superconductivity in copper oxides, a vigorous debate has been focused on the pseudogap - a partial gap that opens over portions of the Fermi surface in the 'normal' state above the bulk critical temperature ($T_{c}$). The pseudogap has been attributed to precursor superconductivity, to the existence of preformed pairs, or to competing orders such as charge-density waves. A direct determination of the charge of carriers as a function of temperature and bias could help resolve among these alternatives. Here, we report measurements of the shot noise of tunneling current in high-quality La$_{2-x}$Sr$_{x}$CuO$_{4}$/La$_{2}$CuO$_{4}$/La$_{2-x}$Sr$_{x}$CuO$_{4}$ (LSCO/LCO/LSCO) heterostructures fabricated using atomic-layer-by-layer molecular beam epitaxy, for several doping levels. The data delineate three distinct regions in the bias voltage-temperature ($V-T$) space. Well outside the superconducting gap region, the shot noise agrees quantitatively with independent tunneling of charge-e carriers. Deep within the gap, shot noise is greatly enhanced, reminiscent of multiple Andreev reflections. Starting above $T_{c}$ and extending to biases much larger than the gap, there is a broad region in which the noise substantially exceeds the expectations of single-charge tunneling, indicating pairing of carriers. Pairs are detectable deep into the pseudogap region of temperature and bias.

cond-mat.supr-con↗

arXiv2020

Reconstruction Condition of Quantized Signals in Unlimited Sampling Framework

The latest theoretical advances in the field of unlimited sampling framework (USF) show the potential to avoid clipping problems of analog-to-digital converters (ADC). To date, most of the related works have focused on real-valued modulo samples, but little has been reported about the impact of quantization. In this paper, we study more practical USF system where modulo samples are quantized to a finite number of bits. In particular, we present a new requirement about the lower bound of sampling rate to ensure exact recovery of original signals from quantized modulo samples. The minimum sampling rate is jointly determined by signal bandwidth and quantization bits. Numerical results show that in the presence of quantization noise, signals with different waveforms and bandwidths are recovered perfectly at the new minimum sampling rate while the recovery fails at minimum sampling rate before modification, which also verifies the correctness of the theory. The trade-offs of sampling rates, quantization bits and computational complexity of recovery algorithm are also given for practitioners to weigh.

eess.SP↗

arXiv2020

Blockchain-based Federated Learning for Device Failure Detection in Industrial IoT

Device failure detection is one of most essential problems in industrial internet of things (IIoT). However, in conventional IIoT device failure detection, client devices need to upload raw data to the central server for model training, which might lead to disclosure of sensitive business data. Therefore, in this paper, to ensure client data privacy, we propose a blockchain-based federated learning approach for device failure detection in IIoT. First, we present a platform architecture of blockchain-based federated learning systems for failure detection in IIoT, which enables verifiable integrity of client data. In the architecture, each client periodically creates a Merkle tree in which each leaf node represents a client data record, and stores the tree root on a blockchain. Further, to address the data heterogeneity issue in IIoT failure detection, we propose a novel centroid distance weighted federated averaging (CDW\_FedAvg) algorithm taking into account the distance between positive class and negative class of each client dataset. In addition, to motivate clients to participate in federated learning, a smart contact based incentive mechanism is designed depending on the size and the centroid distance of client data used in local model training. A prototype of the proposed architecture is implemented with our industry partner, and evaluated in terms of feasibility, accuracy and performance. The results show that the approach is feasible, and has satisfactory accuracy and performance.

cs.DC↗

arXiv2020

Decoupling Inherent Risk and Early Cancer Signs in Image-based Breast Cancer Risk Models

The ability to accurately estimate risk of developing breast cancer would be invaluable for clinical decision-making. One promising new approach is to integrate image-based risk models based on deep neural networks. However, one must take care when using such models, as selection of training data influences the patterns the network will learn to identify. With this in mind, we trained networks using three different criteria to select the positive training data (i.e. images from patients that will develop cancer): an inherent risk model trained on images with no visible signs of cancer, a cancer signs model trained on images containing cancer or early signs of cancer, and a conflated model trained on all images from patients with a cancer diagnosis. We find that these three models learn distinctive features that focus on different patterns, which translates to contrasts in performance. Short-term risk is best estimated by the cancer signs model, whilst long-term risk is best estimated by the inherent risk model. Carelessly training with all images conflates inherent risk with early cancer signs, and yields sub-optimal estimates in both regimes. As a consequence, conflated models may lead physicians to recommend preventative action when early cancer signs are already visible.

eess.IV↗

arXiv2020

Deep Neural Network Approach for Annual Luminance Simulations

Annual luminance maps provide meaningful evaluations for occupants' visual comfort, preferences, and perception. However, acquiring long-term luminance maps require labor-intensive and time-consuming simulations or impracticable long-term field measurements. This paper presents a novel data-driven machine learning approach that makes annual luminance-based evaluations more efficient and accessible. The methodology is based on predicting the annual luminance maps from a limited number of point-in-time high dynamic range imagery by utilizing a deep neural network (DNN). Panoramic views are utilized, as they can be post-processed to study multiple view directions. The proposed DNN model can faithfully predict high-quality annual panoramic luminance maps from one of the three options within 30 minutes training time: a) point-in-time luminance imagery spanning 5% of the year, when evenly distributed during daylight hours, b) one-month hourly imagery generated or collected continuously during daylight hours around the equinoxes (8% of the year); or c) 9 days of hourly data collected around the spring equinox, summer and winter solstices (2.5% of the year) all suffice to predict the luminance maps for the rest of the year. The DNN predicted high-quality panoramas are validated against Radiance (RPICT) renderings using a series of quantitative and qualitative metrics. The most efficient predictions are achieved with 9 days of hourly data collected around the spring equinox, summer and winter solstices. The results clearly show that practitioners and researchers can efficiently incorporate long-term luminance-based metrics over multiple view directions into the design and research processes using the proposed DNN workflow.

cs.CV↗