arXiv Science⌕ Search

arXiv subjects

Cheng Zhang

Publications and source records attributed to Cheng Zhang.

At least 451 records · Page 25Linked to original sources
arXiv2019

Restriction of toral eigenfunctions to totally geodesic submanifolds

We estimate the $L^2$ norm of the restriction to a totally geodesic submanifold of the eigenfunctions of the Laplace-Beltrami operator on the standard flat torus $\mathbb{T}^d$, $d\ge2$. We reduce getting correct bounds to counting lattice points in the intersection of some $ν$-transverse bands on the sphere. Moreover, we prove the correct bounds for rational totally geodesic submanifolds of arbitrary codimension. In particular, we verify the conjecture of Bourgain-Rudnick on $L^2$-restriction estimates for rational hyperplanes. On $\mathbb{T}^2$, we prove the uniform $L^2$ restriction bounds for closed geodesics. On $\mathbb{T}^3$, we obtain explicit $L^2$ restriction estimates for the totally geodesic submanifolds, which improve the corresponding results by Burq-Gérard-Tzvetkov, Hu, Chen-Sogge.

math.AP↗
arXiv2019

Neuropathic Pain Diagnosis Simulator for Causal Discovery Algorithm Evaluation

Discovery of causal relations from observational data is essential for many disciplines of science and real-world applications. However, unlike other machine learning algorithms, whose development has been greatly fostered by a large amount of available benchmark datasets, causal discovery algorithms are notoriously difficult to be systematically evaluated because few datasets with known ground-truth causal relations are available. In this work, we handle the problem of evaluating causal discovery algorithms by building a flexible simulator in the medical setting. We develop a neuropathic pain diagnosis simulator, inspired by the fact that the biological processes of neuropathic pathophysiology are well studied with well-understood causal influences. Our simulator exploits the causal graph of the neuropathic pain pathology and its parameters in the generator are estimated from real-life patient cases. We show that the data generated from our simulator have similar statistics as real-world data. As a clear advantage, the simulator can produce infinite samples without jeopardizing the privacy of real-world patients. Our simulator provides a natural tool for evaluating various types of causal discovery algorithms, including those to deal with practical issues in causal discovery, such as unknown confounders, selection bias, and missing data. Using our simulator, we have evaluated extensively causal discovery algorithms under various settings.

cs.LG↗
arXiv2019

Generalization in Reinforcement Learning with Selective Noise Injection and Information Bottleneck

The ability for policies to generalize to new environments is key to the broad application of RL agents. A promising approach to prevent an agent's policy from overfitting to a limited set of training environments is to apply regularization techniques originally developed for supervised learning. However, there are stark differences between supervised learning and RL. We discuss those differences and propose modifications to existing regularization techniques in order to better adapt them to RL. In particular, we focus on regularization techniques relying on the injection of noise into the learned function, a family that includes some of the most widely used approaches such as Dropout and Batch Normalization. To adapt them to RL, we propose Selective Noise Injection (SNI), which maintains the regularizing effect the injected noise has, while mitigating the adverse effects it has on the gradient quality. Furthermore, we demonstrate that the Information Bottleneck (IB) is a particularly well suited regularization technique for RL as it is effective in the low-data regime encountered early on in training RL agents. Combining the IB with SNI, we significantly outperform current state of the art results, including on the recently proposed generalization benchmark Coinrun.

cs.LG↗
arXiv2019

Tightening Bounds for Variational Inference by Revisiting Perturbation Theory

Variational inference has become one of the most widely used methods in latent variable modeling. In its basic form, variational inference employs a fully factorized variational distribution and minimizes its KL divergence to the posterior. As the minimization can only be carried out approximately, this approximation induces a bias. In this paper, we revisit perturbation theory as a powerful way of improving the variational approximation. Perturbation theory relies on a form of Taylor expansion of the log marginal likelihood, vaguely in terms of the log ratio of the true posterior and its variational approximation. While first order terms give the classical variational bound, higher-order terms yield corrections that tighten it. However, traditional perturbation theory does not provide a lower bound, making it inapt for stochastic optimization. In this paper, we present a similar yet alternative way of deriving corrections to the ELBO that resemble perturbation theory, but that result in a valid bound. We show in experiments on Gaussian Processes and Variational Autoencoders that the new bounds are more mass covering, and that the resulting posterior covariances are closer to the true posterior and lead to higher likelihoods on held-out data.

stat.ML↗
arXiv2019

An Imprint of the Galactic Magnetic Field in the Diffuse Unpolarized Dust Emission

It is well known that aligned, aspherical dust grains emit polarized radiation and that the degree of polarization depends on the angle $ψ$ between the interstellar magnetic field and the line of sight. However, anisotropy of the dust absorption cross sections also modulates the $total\ intensity$ of the radiation as the viewing geometry changes. We report a detection of this effect in the high Galactic latitude $Planck$ data, finding that the 353 GHz dust intensity per $N_{\rm HI}$ is smaller when the Galactic magnetic field is mostly in the plane of the sky and larger when the field is mostly along the line of sight. These variations are of opposite sign and roughly equal magnitude as the changes in polarized intensity per $N_{\rm HI}$ with $ψ$, as predicted. In principle, the variation in intensity can be used in conjunction with the dust polarization angle to constrain the full 3D orientation of the Galactic magnetic field.

astro-ph.GA↗
arXiv2019

Interpretable Outcome Prediction with Sparse Bayesian Neural Networks in Intensive Care

Clinical decision making is challenging because of pathological complexity, as well as large amounts of heterogeneous data generated as part of routine clinical care. In recent years, machine learning tools have been developed to aid this process. Intensive care unit (ICU) admissions represent the most data dense and time-critical patient care episodes. In this context, prediction models may help clinicians determine which patients are most at risk and prioritize care. However, flexible tools such as artificial neural networks (ANNs) suffer from a lack of interpretability limiting their acceptability to clinicians. In this work, we propose a novel interpretable Bayesian neural network architecture which offers both the flexibility of ANNs and interpretability in terms of feature selection. In particular, we employ a sparsity inducing prior distribution in a tied manner to learn which features are important for outcome prediction. We evaluate our approach on the task of mortality prediction using two real-world ICU cohorts. In collaboration with clinicians we found that, in addition to the predicted outcome results, our approach can provide novel insights into the importance of different clinical measurements. This suggests that our model can support medical experts in their decision making process.

cs.LG↗
arXiv2019

Crystal electric field splitting and f-electron hybridization in heavy fermion CePt2In7

We use high-resolution angle-resolved photoemission spectroscopy to investigate the electronic structure of the antiferromagnetic heavy fermion compound CePt2In7, which is a member of the CeIn3-derived heavy fermion material family. Weak hybridization among 4f electron states and conduction bands was identified in CePt2In7 at low temperature much weaker than that in the other heavy fermion compounds like CeIrIn5 and CeRhIn5. The Ce 4f spectrum shows fine structures near the Fermi energy, reflecting the crystal electric field splitting of the 4f^1_5/2 and 4f^1_7/2 states. Also, we find that the Fermi surface has a strongly three-dimensional topology, in agreement with density-functional theory calculations.

cond-mat.str-el↗
arXiv2019

Generating an Overview Report over Many Documents

How to efficiently generate an accurate, well-structured overview report (ORPT) over thousands of related documents is challenging. A well-structured ORPT consists of sections of multiple levels (e.g., sections and subsections). None of the existing multi-document summarization (MDS) algorithms is directed toward this task. To overcome this obstacle, we present NDORGS (Numerous Documents' Overview Report Generation Scheme) that integrates text filtering, keyword scoring, single-document summarization (SDS), topic modeling, MDS, and title generation to generate a coherent, well-structured ORPT. We then devise a multi-criteria evaluation method using techniques of text mining and multi-attribute decision making on a combination of human judgments, running time, information coverage, and topic diversity. We evaluate ORPTs generated by NDORGS on two large corpora of documents, where one is classified and the other unclassified. We show that, using Saaty's pairwise comparison 9-point scale and under TOPSIS, the ORPTs generated on SDS's with the length of 20% of the original documents are the best overall on both datasets.

cs.CL↗
arXiv2019

Icebreaker: Element-wise Active Information Acquisition with Bayesian Deep Latent Gaussian Model

In this paper we introduce the ice-start problem, i.e., the challenge of deploying machine learning models when only little or no training data is initially available, and acquiring each feature element of data is associated with costs. This setting is representative for the real-world machine learning applications. For instance, in the health-care domain, when training an AI system for predicting patient metrics from lab tests, obtaining every single measurement comes with a high cost. Active learning, where only the label is associated with a cost does not apply to such problem, because performing all possible lab tests to acquire a new training datum would be costly, as well as unnecessary due to redundancy. We propose Icebreaker, a principled framework to approach the ice-start problem. Icebreaker uses a full Bayesian Deep Latent Gaussian Model (BELGAM) with a novel inference method. Our proposed method combines recent advances in amortized inference and stochastic gradient MCMC to enable fast and accurate posterior inference. By utilizing BELGAM's ability to fully quantify model uncertainty, we also propose two information acquisition functions for imputation and active prediction problems. We demonstrate that BELGAM performs significantly better than the previous VAE (Variational autoencoder) based models, when the data set size is small, using both machine learning benchmarks and real-world recommender systems and health-care applications. Moreover, based on BELGAM, Icebreaker further improves the performance and demonstrate the ability to use minimum amount of the training data to obtain the highest test time performance.

cs.LG↗
arXiv2019

Simultaneous Measurement Imputation and Outcome Prediction for Achilles Tendon Rupture Rehabilitation

Achilles Tendon Rupture (ATR) is one of the typical soft tissue injuries. Rehabilitation after such a musculoskeletal injury remains a prolonged process with a very variable outcome. Accurately predicting rehabilitation outcome is crucial for treatment decision support. However, it is challenging to train an automatic method for predicting the ATR rehabilitation outcome from treatment data, due to a massive amount of missing entries in the data recorded from ATR patients, as well as complex nonlinear relations between measurements and outcomes. In this work, we design an end-to-end probabilistic framework to impute missing data entries and predict rehabilitation outcomes simultaneously. We evaluate our model on a real-life ATR clinical cohort, comparing with various baselines. The proposed method demonstrates its clear superiority over traditional methods which typically perform imputation and prediction in two separate stages.

q-bio.QM↗
arXiv2019

An Empirical Study on Leveraging Scene Graphs for Visual Question Answering

Visual question answering (Visual QA) has attracted significant attention these years. While a variety of algorithms have been proposed, most of them are built upon different combinations of image and language features as well as multi-modal attention and fusion. In this paper, we investigate an alternative approach inspired by conventional QA systems that operate on knowledge graphs. Specifically, we investigate the use of scene graphs derived from images for Visual QA: an image is abstractly represented by a graph with nodes corresponding to object entities and edges to object relationships. We adapt the recently proposed graph network (GN) to encode the scene graph and perform structured reasoning according to the input question. Our empirical studies demonstrate that scene graphs can already capture essential information of images and graph networks have the potential to outperform state-of-the-art Visual QA algorithms but with a much cleaner architecture. By analyzing the features generated by GNs we can further interpret the reasoning process, suggesting a promising direction towards explainable Visual QA.

cs.CV↗
arXiv2019

EDDI: Efficient Dynamic Discovery of High-Value Information with Partial VAE

Many real-life decision-making situations allow further relevant information to be acquired at a specific cost, for example, in assessing the health status of a patient we may decide to take additional measurements such as diagnostic tests or imaging scans before making a final assessment. Acquiring more relevant information enables better decision making, but may be costly. How can we trade off the desire to make good decisions by acquiring further information with the cost of performing that acquisition? To this end, we propose a principled framework, named EDDI (Efficient Dynamic Discovery of high-value Information), based on the theory of Bayesian experimental design. In EDDI, we propose a novel partial variational autoencoder (Partial VAE) to predict missing data entries problematically given any subset of the observed ones, and combine it with an acquisition function that maximizes expected information gain on a set of target variables. We show cost reduction at the same decision quality and improved decision quality at the same cost in multiple machine learning benchmarks and two real-world health-care applications.

cs.LG↗
arXiv2019

Direct measurement of the quantum state of photons in a cavity

We propose a scheme to measure the quantum state of photons in a cavity. The proposal is based on the concept of quantum weak values and applies equally well to both the solid-state circuit and atomic cavity quantum electrodynamics (QED) systems. The proposed scheme allows us to access directly the superposition components in Fock state basis, rather than the Wigner function as usual in phase space. Moreover, the separate access feature held in the direct scheme does not require a global reconstruction for the quantum state, which provides a particular advantage beyond the conventional method of quantum state tomography.

quant-ph↗
arXiv2019

Bending sound around sharp corners without using topological edge states

Routing and guiding acoustic waves around sharp corners without backscattering losses is of great interest in the acoustics community. Sonic crystals have been primarily utilized to design backscattering-immune waveguides. While conventional approaches use defects to guide waves, a considerably more sophisticated and robust approach was recently developed based on topological edge states. In this paper, we propose a radically different theoretical framework based on extremely anisotropic metamaterials for engineering backscattering-immune waveguides. We theoretically derived the exact condition for one-way wave propagation in zigzag paths, and identified a number of key advantages of the current design over topologically protected waveguides. While the theoretical underpinning is universal and is applicable to acoustic and electromagnetic waves, the experimental validation was conducted using spoof surface acoustic waves. The proposed metamaterial could open up new possibilities for wave manipulation and lead to applications in on-chip devices and noise control.

physics.app-ph↗
arXiv2019

Gradual partial-collapse theory for ideal nondemolition measurements of qubits in circuit QED

The conventional method of qubit measurements in circuit QED is employing the dispersive regime of qubit-cavity coupling, which results in an approximated scheme of quantum nondemolition (QND) readout. This scheme becomes problematic in the case of strong coupling and/or strong measurement drive, owing to the so-called Purcell effect. A recent proposal by virtue of longitudinal coupling suggests a new scheme to realize fast, high-fidelity, and {\it ideal QND} readout of qubit state. The aim of the present work is twofold: (i) In parallel to what has been done in the past years for the dispersive readout, we carry out the gradual partial-collapse theory for this recent scheme, in terms of both the quantum trajectory equation and quantum Bayesian approaches. The partial-collapse weak measurement theory is useful for such as the measurement-based feedback control and other quantum applications. (ii) In the physical aspect, we construct the joint qubit-plus-cavity entangled state under continuous measurement and present a comprehensive analysis for the quantum efficiency,qubit-state purity, and signal-to-noise ratio in the output currents. The combination of the joint state and the quantum Bayesian rule provides a generalized scheme of cavity reset associated with the longitudinal coupling, which can restore the qubit to a quantum pure state from entanglement with the cavity states, and thus benefits the successive partial-collapse measurements after qubit rotations.

quant-ph↗
arXiv2019

Estimation of parameters in circuit QED by continuous quantum measurement

Designing high-precision and efficient schemes is of crucial importance for quantum parameter estimation in practice. The estimation scheme based on continuous quantum measurement is one possible type of this, which looks also the most natural choice in case such as continuous dynamical process. In this work we specify the study to the stat-of-the-art superconducting circuit quantum-electrodynamics (QED) system, where the high-quality continuous measurement has been extensively exploited in the past decade. Within the framework of Bayesian estimation and particularly using the quantum Bayesian rule in circuit QED, we numerically simulate the likelihood function as estimator for the Rabi frequency of qubit oscillation. We find that, by proper design of the interaction strength of measurement, the estimate precision can scale with the measurement time beyond the standard quantum limit, which is usually assumed for this type of continuous measurement since no more special quantum resource is involved. We understand this remarkable result by quantum correlation in time between the output signals, and simulate the effect of quantum efficiency of the measurement on the precision scaling behavior.

quant-ph↗
arXiv2019

Revisiting the Photon-Drag Effect in Metal Films

The photon-drag effect, the rectified current in a medium induced by conservation of momentum of absorbed or redirected light, is a unique probe of the detailed mechanisms underlying radiation pressure. We revisit this effect in gold, a canonical Drude metal. We discover that the signal for p-polarized illumination in ambient air is affected in both sign and magnitude by adsorbed molecules, opening previous measurements for reinterpretation. Further, we show that the intrinsic sign of the photon-drag effect is contrary to the prevailing intuitive model of direct momentum transfer to free electrons.

physics.optics↗