arXiv subjects

Yuhan Liu

Publications and source records attributed to Yuhan Liu.

At least 199 records · Page 11Linked to original sources

arXiv2021

Learning Based Model Predictive Control for Quadcopters with Dual Gaussian Process

An important issue in quadcopter control is that an accurate dynamic model of the system is nonlinear, complex, and costly to obtain. This limits achievable control performance in practice. Gaussian process (GP) based estimation is an effective tool to learn unknown dynamics from input/output data. However, conventional GP-based control methods often ignore the computational cost associated with accumulating data during the operation of the system and how to handle forgetting in continuous adaption. In this paper, we present a novel Dual Gaussian Process (DGP) based model predictive control strategy that improves the performance of a quadcopter during trajectory tracking. The bio-inspired DGP structure is a combination of a long-term GP and a short-term GP, where the long-term GP is used to keep the learned knowledge in memory and the short-term GP is employed to rapidly compensate unknown dynamics during online operation. Furthermore, a novel recursive online update strategy for the short-term GP is proposed to successively improve the learnt model during online operation in an efficient way. Numerical simulations are used to demonstrate the effectiveness of the proposed strategy.

eess.SY↗

arXiv2021

Interactive Inference under Information Constraints

We study the role of interactivity in distributed statistical inference under information constraints, e.g., communication constraints and local differential privacy. We focus on the tasks of goodness-of-fit testing and estimation of discrete distributions. From prior work, these tasks are well understood under noninteractive protocols. Extending these approaches directly for interactive protocols is difficult due to correlations that can build due to interactivity; in fact, gaps can be found in prior claims of tight bounds of distribution estimation using interactive protocols. We propose a new approach to handle this correlation and establish a unified method to establish lower bounds for both tasks. As an application, we obtain optimal bounds for both estimation and testing under local differential privacy and communication constraints. We also provide an example of a natural testing problem where interactivity helps.

cs.DS↗

arXiv2021

Multipartitioning topological phases by vertex states and quantum entanglement

We discuss multipartitions of the gapped ground states of (2+1)-dimensional topological liquids into three (or more) spatial regions that are adjacent to each other and meet at points. By considering the reduced density matrix obtained by tracing over a subset of the regions, we compute various correlation measures, such as entanglement negativity, reflected entropy, and associated spectra. We utilize the bulk-boundary correspondence to show that such multipartitions can be achieved by using what we call vertex states in (1+1)-dimensional conformal field theory -- these are a type of state used to define an interaction vertex in string field theory and can be thought of as a proper generalization of conformal boundary states. This approach allows an explicit construction of the reduced density matrix near the entangling boundaries. We find the fingerprints of topological liquid in these quantities, such as (universal pieces in) the scaling of the entanglement negativity, and a non-trivial distribution of the spectrum of the partially transposed density matrix. For reflected entropy, we test the recent claim that states the difference between reflected entropy and mutual information is given, once short-range correlations are properly removed, by $(c/3)\ln 2$ where $c$ is the central charge of the topological liquid that measures ungappable edge degrees of freedom. As specific examples, we consider topological chiral $p$-wave superconductors and Chern insulators. We also study a specific lattice fermion model realizing Chern insulator phases and calculate the correlation measures numerically, both in its gapped phases and at critical points separating them.

cond-mat.str-el↗

arXiv2021

Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs

In this work, we perform semantic segmentation of multiple defect types in electron microscopy images of irradiated FeCrAl alloys using a deep learning Mask Regional Convolutional Neural Network (Mask R-CNN) model. We conduct an in-depth analysis of key model performance statistics, with a focus on quantities such as predicted distributions of defect shapes, defect sizes, and defect areal densities relevant to informing modeling and understanding of irradiated Fe-based materials properties. To better understand the performance and present limitations of the model, we provide examples of useful evaluation tests which include a suite of random splits, and dataset size-dependent and domain-targeted cross validation tests. Overall, we find that the current model is a fast, effective tool for automatically characterizing and quantifying multiple defect types in microscopy images, with a level of accuracy on par with human domain expert labelers. More specifically, the model can achieve average defect identification F1 scores as high as 0.8, and, based on random cross validation, have low overall average (+/- standard deviation) defect size and density percentage errors of 7.3 (+/- 3.8)% and 12.7 (+/- 5.3)%, respectively. Further, our model predicts the expected material hardening to within 10-20 MPa (about 10% of total hardening), which is about the same error level as experiments. Our targeted evaluation tests also suggest the best path toward improving future models is not expanding existing databases with more labeled images but instead data additions that target weak points of the model domain, such as images from different microscopes, imaging conditions, irradiation environments, and alloy types. Finally, we discuss the first phase of an effort to provide an easy-to-use, open-source object detection tool to the broader community for identifying defects in new images.

cs.CV↗

arXiv2021

OpenRooms: An End-to-End Open Framework for Photorealistic Indoor Scene Datasets

We propose a novel framework for creating large-scale photorealistic datasets of indoor scenes, with ground truth geometry, material, lighting and semantics. Our goal is to make the dataset creation process widely accessible, transforming scans into photorealistic datasets with high-quality ground truth for appearance, layout, semantic labels, high quality spatially-varying BRDF and complex lighting, including direct, indirect and visibility components. This enables important applications in inverse rendering, scene understanding and robotics. We show that deep networks trained on the proposed dataset achieve competitive performance for shape, material and lighting estimation on real images, enabling photorealistic augmented reality applications, such as object insertion and material editing. We also show our semantic labels may be used for segmentation and multi-task learning. Finally, we demonstrate that our framework may also be integrated with physics engines, to create virtual robotics environments with unique ground truth such as friction coefficients and correspondence to real scenes. The dataset and all the tools to create such datasets will be made publicly available.

cs.CV↗

arXiv2021

Multi defect detection and analysis of electron microscopy images with deep learning

Electron microscopy is widely used to explore defects in crystal structures, but human detecting of defects is often time-consuming, error-prone, and unreliable, and is not scalable to large numbers of images or real-time analysis. In this work, we discuss the application of machine learning approaches to find the location and geometry of different defect clusters in irradiated steels. We show that a deep learning based Faster R-CNN analysis system has a performance comparable to human analysis with relatively small training data sets. This study proves the promising ability to apply deep learning to assist the development of automated microscopy data analysis even when multiple features are present and paves the way for fast, scalable, and reliable analysis systems for massive amounts of modern electron microscopy data.

cs.CV↗

arXiv2021

Textual Analysis of Communications in COVID-19 Infected Community on Social Media

During the COVID-19 pandemic, people started to discuss about pandemic-related topics on social media. On subreddit \textit{r/COVID19positive}, a number of topics are discussed or being shared, including experience of those who got a positive test result, stories of those who presumably got infected, and questions asked regarding the pandemic and the disease. In this study, we try to understand, from a linguistic perspective, the nature of discussions on the subreddit. We found differences in linguistic characteristics (e.g. psychological, emotional and reasoning) across three different categories of topics. We also classified posts into the different categories using SOTA pre-trained language models. Such classification model can be used for pandemic-related research on social media.

cs.SI↗

arXiv2021

AutoFreeze: Automatically Freezing Model Blocks to Accelerate Fine-tuning

With the rapid adoption of machine learning (ML), a number of domains now use the approach of fine tuning models which were pre-trained on a large corpus of data. However, our experiments show that even fine-tuning on models like BERT can take many hours even when using modern accelerators like GPUs. While prior work proposes limiting the number of layers that are fine-tuned, e.g., freezing all layers but the last layer, we find that such static approaches lead to reduced accuracy. We propose, AutoFreeze, a system that uses an adaptive approach to choose which layers are trained and show how this can accelerate model fine-tuning while preserving accuracy. We also develop mechanisms to enable efficient caching of intermediate activations which can reduce the forward computation time when performing fine-tuning. We extend AutoFreeze to perform distributed fine-tuning and design two execution modes that minimize cost and running time respectively. Our evaluation on ten NLP tasks shows that AutoFreeze, with caching enabled, can improve fine-tuning on a single GPU by up to 2.55x. On a 64 GPU cluster, for fine-tuning on the AG's news dataset, AutoFreeze is able to achieve up to 4.38x speedup when optimizing for end-to-end training time and 5.03x reduction in total cost when optimizing for efficiency, without affecting model accuracy.

cs.LG↗

arXiv2021

Auto-calibration Method Using Stop Signs for Urban Autonomous Driving Applications

Calibration of sensors is fundamental to robust performance for intelligent vehicles. In natural environments, disturbances can easily challenge calibration. One possibility is to use natural objects of known shape to recalibrate sensors. An approach based on recognition of traffic signs, such as stop signs, and use of them for recalibration of cameras is presented. The approach is based on detection, geometry estimation, calibration, and recursive updating. Results from natural environments are presented that clearly show convergence and improved performance.

cs.CV↗

arXiv2021

Tidal surface states as fingerprints of non-Hermitian nodal knot metals

Non-Hermitian nodal knot metals (NKMs) contains intricate complex-valued energy bands gives rise to knotted exceptional loops and new topological surface states. We introduce a formalism that connects the algebraic, geometric, and topological aspects of these surface states with their parent knots, and provide an optimized constructive ansatz for tight-binding models for non-Hermitian NKMs of arbitrary knot complexity and minimal hybridization range. Specifically, various representative non-Hermitian torus knots Hamiltonians are constructed in real-space, and their nodal topologies studied via winding numbers that avoid the explicit construction of generalized Brillouin zones. In particular, we identify the surface state boundaries as "tidal" intersections of the complex band structure in a marine landscape analogy. Beyond topological quantities based on Berry phases, we further find these tidal surface states to be intimately connected to the band vorticity and the layer structure of their dual Seifert surface, and as such provide a fingerprint for non-Hermitian NKMs.

cond-mat.mes-hall↗

arXiv2021

Estimating Sparse Discrete Distributions Under Local Privacy and Communication Constraints

We consider the problem of estimating sparse discrete distributions under local differential privacy (LDP) and communication constraints. We characterize the sample complexity for sparse estimation under LDP constraints up to a constant factor and the sample complexity under communication constraints up to a logarithmic factor. Our upper bounds under LDP are based on the Hadamard Response, a private coin scheme that requires only one bit of communication per user. Under communication constraints, we propose public coin schemes based on random hashing functions. Our tight lower bounds are based on the recently proposed method of chi squared contractions.

cs.IT↗

arXiv2021

Accelerating Deep Learning Inference via Learned Caches

Deep Neural Networks (DNNs) are witnessing increased adoption in multiple domains owing to their high accuracy in solving real-world problems. However, this high accuracy has been achieved by building deeper networks, posing a fundamental challenge to the low latency inference desired by user-facing applications. Current low latency solutions trade-off on accuracy or fail to exploit the inherent temporal locality in prediction serving workloads. We observe that caching hidden layer outputs of the DNN can introduce a form of late-binding where inference requests only consume the amount of computation needed. This enables a mechanism for achieving low latencies, coupled with an ability to exploit temporal locality. However, traditional caching approaches incur high memory overheads and lookup latencies, leading us to design learned caches - caches that consist of simple ML models that are continuously updated. We present the design of GATI, an end-to-end prediction serving system that incorporates learned caches for low-latency DNN inference. Results show that GATI can reduce inference latency by up to 7.69X on realistic workloads.

cs.LG↗

arXiv2021

Learning discrete distributions: user vs item-level privacy

Much of the literature on differential privacy focuses on item-level privacy, where loosely speaking, the goal is to provide privacy per item or training example. However, recently many practical applications such as federated learning require preserving privacy for all items of a single user, which is much harder to achieve. Therefore understanding the theoretical limit of user-level privacy becomes crucial. We study the fundamental problem of learning discrete distributions over $k$ symbols with user-level differential privacy. If each user has $m$ samples, we show that straightforward applications of Laplace or Gaussian mechanisms require the number of users to be $\mathcal{O}(k/(mα^2) + k/εα)$ to achieve an $\ell_1$ distance of $α$ between the true and estimated distributions, with the privacy-induced penalty $k/εα$ independent of the number of samples per user $m$. Moreover, we show that any mechanism that only operates on the final aggregate counts should require a user complexity of the same order. We then propose a mechanism such that the number of users scales as $\tilde{\mathcal{O}}(k/(mα^2) + k/\sqrt{m}εα)$ and hence the privacy penalty is $\tildeΘ(\sqrt{m})$ times smaller compared to the standard mechanisms in certain settings of interest. We further show that the proposed mechanism is nearly-optimal under certain regimes. We also propose general techniques for obtaining lower bounds on restricted differentially private estimators and a lower bound on the total variation between binomial distributions, both of which might be of independent interest.

cs.LG↗

arXiv2020

Gauging anomalous unitary operators

Boundary theories of static bulk topological phases of matter are obstructed in the sense that they cannot be realized on their own as isolated systems. The obstruction can be quantified/characterized by quantum anomalies, in particular when there is a global symmetry. Similarly, topological Floquet evolutions can realize obstructed unitary operators at their boundaries. In this paper, we discuss the characterization of such obstructions by using quantum anomalies. As a particular example, we discuss time-reversal symmetric boundary unitary operators in one and two spatial dimensions, where the anomaly emerges as we gauge the so-called Kubo-Martin-Schwinger (KMS) symmetry. We also discuss mixed anomalies between particle number conserving U(1) symmetry and discrete symmetries, such as C and CP, for unitary operators in odd spatial dimensions that can be realized at the boundaries of topological Floquet systems in even spatial dimensions.

cond-mat.str-el↗

arXiv2020

Imaging nodal knots in momentum space through topolectrical circuits

Knots are intricate structures that cannot be unambiguously distinguished with any single topological invariant. Momentum space knots, in particular, have been elusive due to their requisite finely tuned long-ranged hoppings. Even if constructed, probing their intricate linkages and topological "drumhead" surface states will be challenging due to the high precision needed. In this work, we overcome these practical and technical challenges with RLC circuits, transcending existing theoretical constructions which necessarily break reciprocity, by pairing nodal knots with their mirror image partners in a fully reciprocal setting. Our nodal knot circuits can be characterized with impedance measurements that resolve their drumhead states and image their 3D nodal structure. Doing so allows for reconstruction of the Seifert surface and hence knot topological invariants like the Alexander polynomial. We illustrate our approach with large-scale simulations of various nodal knots and an experiment that maps out the topological drumhead region of a Hopf-link.

cond-mat.mes-hall↗

arXiv2018

Topological corner modes in a brick lattice with nonsymmorphic symmetry

The quest for new realizations of higher-order topological system has garnered much recent attention. In this work, we propose a paradigmatic brick lattice model where corner modes requires protection by nonsymmorphic symmetry in addition to two commuting mirror symmetries. Unlike the well-known square corner mode lattice, it has an odd number of occupied bands, which necessitates a different definition for the $\mathbb Z_2\times \mathbb Z_2$ topological invariant. By studying both the quadrupolar polarization and effective edge model, our study culminates in a phase diagram containing two distinct topological regimes. Our brick lattice corner modes can be realized in a RLC circuit setup and detected via collossal "topolectrical" resonances.

cond-mat.str-el↗

arXiv2018

Entanglement-guided architectures of machine learning by quantum tensor network

It is a fundamental, but still elusive question whether the schemes based on quantum mechanics, in particular on quantum entanglement, can be used for classical information processing and machine learning. Even partial answer to this question would bring important insights to both fields of machine learning and quantum mechanics. In this work, we implement simple numerical experiments, related to pattern/images classification, in which we represent the classifiers by many-qubit quantum states written in the matrix product states (MPS). Classical machine learning algorithm is applied to these quantum states to learn the classical data. We explicitly show how quantum entanglement (i.e., single-site and bipartite entanglement) can emerge in such represented images. Entanglement characterizes here the importance of data, and such information are practically used to guide the architecture of MPS, and improve the efficiency. The number of needed qubits can be reduced to less than 1/10 of the original number, which is within the access of the state-of-the-art quantum computers. We expect such numerical experiments could open new paths in charactering classical machine learning algorithms, and at the same time shed lights on the generic quantum simulations/computations of machine learning tasks.

stat.ML↗

arXiv2017

Topological dynamics of gyroscopic and Floquet lattices from Newton's laws

Despite intense interest in realizing topological phases across a variety of electronic, photonic and mechanical platforms, the detailed microscopic origin of topological behavior often remains elusive. To bridge this conceptual gap, we show how hallmarks of topological modes - boundary localization and chirality - emerge from Newton's laws in mechanical topological systems. We first construct a gyroscopic lattice with analytically solvable edge modes, and show how the Lorentz and spring restoring forces conspire to support very robust "dangling bond" boundary modes. The chirality and locality of these modes intuitively emerges from microscopic balancing of restoring forces and cyclotron tendencies. Next, we introduce the highlight of this work, a very experimentally realistic mechanical non-equilibrium (Floquet) Chern lattice driven by AC electromagnets. Through appropriate synchronization of the AC driving protocol, the Floquet lattice is "pushed around" by a rotating potential analogous to an object washed ashore by water waves. Besides hosting "dangling bond" chiral modes analogous to the gyroscopic boundary modes, our Floquet Chern lattice also supports peculiar half-period chiral modes with no static analog. With key parameters controlled electronically, our setup has the advantage of being dynamically tunable for applications involving arbitrary Floquet modulations. The physical intuition gleaned from our two prototypical topological systems are applicable not just to arbitrarily complicated mechanical systems, but also photonic and electrical topological setups.

cond-mat.mes-hall↗