arXiv Science⌕ Search

arXiv subjects

Yihong Wu

Publications and source records attributed to Yihong Wu.

At least 145 records · Page 8Linked to original sources

Counting Motifs with Graph Sampling

Applied researchers often construct a network from a random sample of nodes in order to infer properties of the parent network. Two of the most widely used sampling schemes are subgraph sampling, where we sample each vertex independently with probability $p$ and observe the subgraph induced by the sampled vertices, and neighborhood sampling, where we additionally observe the edges between the sampled vertices and their neighbors. In this paper, we study the problem of estimating the number of motifs as induced subgraphs under both models from a statistical perspective. We show that: for any connected $h$ on $k$ vertices, to estimate $s=\mathsf{s}(h,G)$, the number of copies of $h$ in the parent graph $G$ of maximum degree $d$, with a multiplicative error of $ε$, (a) For subgraph sampling, the optimal sampling ratio $p$ is $Θ_{k}(\max\{ (sε^2)^{-\frac{1}{k}}, \; \frac{d^{k-1}}{sε^{2}} \})$, achieved by Horvitz-Thompson type of estimators. (b) For neighborhood sampling, we propose a family of estimators, encompassing and outperforming the Horvitz-Thompson estimator and achieving the sampling ratio $O_{k}(\min\{ (\frac{d}{sε^2})^{\frac{1}{k-1}}, \; \sqrt{\frac{d^{k-2}}{sε^2}}\})$. This is shown to be optimal for all motifs with at most $4$ vertices and cliques of all sizes. The matching minimax lower bounds are established using certain algebraic properties of subgraph counts. These results quantify how much more informative neighborhood sampling is than subgraph sampling, as empirically verified by experiments on both synthetic and real-world data. We also address the issue of adaptation to the unknown maximum degree, and study specific problems for parent graphs with additional structures, e.g., trees or planar graphs.

math.ST↗

Recovering a Hidden Community Beyond the Kesten-Stigum Threshold in $O(|E| \log^*|V|)$ Time

Community detection is considered for a stochastic block model graph of n vertices, with K vertices in the planted community, edge probability p for pairs of vertices both in the community, and edge probability q for other pairs of vertices. The main focus of the paper is on weak recovery of the community based on the graph G, with o(K) misclassified vertices on average, in the sublinear regime $n^{1-o(1)} \leq K \leq o(n).$ A critical parameter is the effective signal-to-noise ratio $λ=K^2(p-q)^2/((n-K)q)$, with $λ=1$ corresponding to the Kesten-Stigum threshold. We show that a belief propagation algorithm achieves weak recovery if $λ>1/e$, beyond the Kesten-Stigum threshold by a factor of $1/e.$ The belief propagation algorithm only needs to run for $\log^\ast n+O(1) $ iterations, with the total time complexity $O(|E| \log^*n)$, where $\log^*n$ is the iterated logarithm of $n.$ Conversely, if $λ\leq 1/e$, no local algorithm can asymptotically outperform trivial random guessing. Furthermore, a linear message-passing algorithm that corresponds to applying power iteration to the non-backtracking matrix of the graph is shown to attain weak recovery if and only if $λ>1$. In addition, the belief propagation algorithm can be combined with a linear-time voting procedure to achieve the information limit of exact recovery (correctly classify all vertices with high probability) for all $K \ge \frac{n}{\log n} \left( ρ_{\rm BP} +o(1) \right),$ where $ρ_{\rm BP}$ is a function of $p/q$.

stat.ML↗

Sample complexity of the distinct elements problem

We consider the distinct elements problem, where the goal is to estimate the number of distinct colors in an urn containing $ k $ balls based on $n$ samples drawn with replacements. Based on discrete polynomial approximation and interpolation, we propose an estimator with additive error guarantee that achieves the optimal sample complexity within $O(\log\log k)$ factors, and in fact within constant factors for most cases. The estimator can be computed in $O(n)$ time for an accurate estimation. The result also applies to sampling without replacement provided the sample size is a vanishing fraction of the urn size. One of the key auxiliary results is a sharp bound on the minimum singular values of a real rectangular Vandermonde matrix, which might be of independent interest.

math.ST↗

Statistical and Computational Limits for Sparse Matrix Detection

This paper investigates the fundamental limits for detecting a high-dimensional sparse matrix contaminated by white Gaussian noise from both the statistical and computational perspectives. We consider $p\times p$ matrices whose rows and columns are individually $k$-sparse. We provide a tight characterization of the statistical and computational limits for sparse matrix detection, which precisely describe when achieving optimal detection is easy, hard, or impossible, respectively. Although the sparse matrices considered in this paper have no apparent submatrix structure and the corresponding estimation problem has no computational issue at all, the detection problem has a surprising computational barrier when the sparsity level $k$ exceeds the cubic root of the matrix size $p$: attaining the optimal detection boundary is computationally at least as hard as solving the planted clique problem. The same statistical and computational limits also hold in the sparse covariance matrix model, where each variable is correlated with at most $k$ others. A key step in the construction of the statistically optimal test is a structural property for sparse matrices, which can be of independent interest.

math.ST↗

Strong Data Processing Inequalities for Input Constrained Additive Noise Channels

This paper quantifies the intuitive observation that adding noise reduces available information by means of non-linear strong data processing inequalities. Consider the random variables $W\to X\to Y$ forming a Markov chain, where $Y=X+Z$ with $X$ and $Z$ real-valued, independent and $X$ bounded in $L_p$-norm. It is shown that $I(W;Y) \le F_I(I(W;X))$ with $F_I(t) 0$, if and only if $Z$ has a density whose support is not disjoint from any translate of itself. A related question is to characterize for what couplings $(W,X)$ the mutual information $I(W;Y)$ is close to maximum possible. To that end we show that in order to saturate the channel, i.e. for $I(W;Y)$ to approach capacity, it is mandatory that $I(W;X)\to\infty$ (under suitable conditions on the channel). A key ingredient for this result is a deconvolution lemma which shows that post-convolution total variation distance bounds the pre-convolution Kolmogorov-Smirnov distance. Explicit bounds are provided for the special case of the additive Gaussian noise channel with quadratic cost constraint. These bounds are shown to be order-optimal. For this case simplified proofs are provided leveraging Gaussian-specific tools such as the connection between information and estimation (I-MMSE) and Talagrand's information-transportation inequality.

cs.IT↗

A deep learning model integrating FCNNs and CRFs for brain tumor segmentation

Accurate and reliable brain tumor segmentation is a critical component in cancer diagnosis, treatment planning, and treatment outcome evaluation. Build upon successful deep learning techniques, a novel brain tumor segmentation method is developed by integrating fully convolutional neural networks (FCNNs) and Conditional Random Fields (CRFs) in a unified framework to obtain segmentation results with appearance and spatial consistency. We train a deep learning based segmentation model using 2D image patches and image slices in following steps: 1) training FCNNs using image patches; 2) training CRFs as Recurrent Neural Networks (CRF-RNN) using image slices with parameters of FCNNs fixed; and 3) fine-tuning the FCNNs and the CRF-RNN using image slices. Particularly, we train 3 segmentation models using 2D image patches and slices obtained in axial, coronal and sagittal views respectively, and combine them to segment brain tumors using a voting based fusion strategy. Our method could segment brain images slice-by-slice, much faster than those based on image patches. We have evaluated our method based on imaging data provided by the Multimodal Brain Tumor Image Segmentation Challenge (BRATS) 2013, BRATS 2015 and BRATS 2016. The experimental results have demonstrated that our method could build a segmentation model with Flair, T1c, and T2 scans and achieve competitive performance as those built with Flair, T1, T1c, and T2 scans.

cs.CV↗

Macro-spin Modeling and Experimental Study of Spin-orbit Torque Biased Magnetic Sensors

We reported a systematic study of spin-orbit torque biased magnetic sensors based on NiFe/Pt bilayers through both macro-spin modeling and experiments. The simulation results show that it is possible to achieve a linear sensor with a dynamic range of 0.1 - 10 Oe, power consumption of 1uW - 1 mW, and sensitivity of 0.1-0.5 Ohm/Oe. These characteristics can be controlled by varying the sensor dimension and current density in the Pt layer. The latter is in the range of 1 x 10^5 - 10^7 A/cm^2. Experimental results of fabricated sensors with selected sizes agree well with the simulation results. For a Wheatstone bridge sensor comprising of four sensing elements, a sensitivity up to 0.548 Ohm/Oe, linearity error below 6%, and detectivity of about 2.8 nT/Sqrt(Hz) were obtained. The simple structure and ultrathin thickness greatly facilitate the integration of these sensors for on-chip applications. As a proof-of-concept experiment, we demonstrate its application in detection of current flowing in an on-chip Cu wire.

cond-mat.mes-hall↗

Selective multiple domain wall injection using spin-orbit torque

We demonstrate from both simulation and experiment a simple scheme for selective injection of multiple domain walls in a magnetic nanowire. The structure consists of a side-contact misaligned Hall bar made of ferromagnet/heavy metal bilayers. The combination of current-induced spin-orbit torque and an external magnetic field allows for the formation of localized domains with specific magnetization direction and length, thereby creating domain walls in predetermined locations. With the side contacts at two sides misaligned for a distance that is comparable to the contact width, it is possible to create densely packed domains by simply applying current between different pairs of side contacts. Simulation results show that the proposed scheme is scalable to a large number of domains with its dimension limited only by the domain wall width.

cond-mat.mtrl-sci↗

Room temperature magnetization switching in topological insulator-ferromagnet heterostructures by spin-orbit torques

Topological insulators (TIs) with spin momentum locked topological surface states (TSS) are expected to exhibit a giant spin-orbit torque (SOT) in the TI/ferromagnet systems. To date, the TI SOT driven magnetization switching is solely reported in a Cr doped TI at 1.9 K. Here, we directly show giant SOT driven magnetization switching in a Bi2Se3/NiFe heterostructure at room temperature captured using a magneto-optic Kerr effect microscope. We identify a large charge to spin conversion efficiency of ~1-1.75 in the thin TI films, where the TSS is dominant. In addition, we find the current density required for the magnetization switching is extremely low, ~6x10^5 A cm-2, which is one to two orders of magnitude smaller than that with heavy metals. Our demonstration of room temperature magnetization switching of a conventional 3d ferromagnet using Bi2Se3 may lead to potential innovations in TI based spintronic applications.

cond-mat.mtrl-sci↗

Semitransparent anisotropic and spin Hall magnetoresistance sensor enabled by spin-orbit toque biasing

We demonstrate an ultrathin and semitransparent anisotropic and spin Hall magnetoresistance sensor based on NiFe/Pt heterostructure. The use of spin-orbit torque effective field for transverse biasing allows to reduce the total thickness of the sensors down to 3 - 4 nm and thereby leading to the semitransparency. Despite the extremely simple design, the spin-orbit torque effective field biased NiFe/Pt sensor exhibits level of linearity and sensitivity comparable to those of sensors using more complex linearization schemes. In a proof-of-concept design using a full Wheatstone bridge comprising of four sensing elements, we obtained a sensitivity up to 202.9 mΩ/Oe, linearity error below 5%, and a detection limit down to 20 nT. The transmittance of the sensor is over 50% in the visible range.

cond-mat.mtrl-sci↗

Static and Dynamic Magnetic Properties of FeMn/Pt Multilayers

Recently we have demonstrated the presence of spin-orbit toque in FeMn/Pt multilayers which, in combination with the anisotropy field, is able to rotate its magnetization consecutively from 0o to 360o without any external field. Here, we report on an investigation of static and dynamic magnetic properties of FeMn/Pt multilayers using combined techniques of magnetometry, ferromagnetic resonance, inverse spin Hall effect and spin Hall magnetoresistance measurements. The FeMn/Pt multilayer was found to exhibit ferromagnetic properties, and its temperature dependence of saturation magnetization can be fitted well using a phenomenological model by including a finite distribution in Curie temperature due to subtle thickness variations across the multilayer samples. The non-uniformity in static magnetic properties is also manifested in the ferromagnetic resonance spectra, which typically exhibit a broad resonance peak. A damping parameter of around 0.106 is derived from the frequency dependence of ferromagnetic resonance linewidth, which is comparable to the reported values for other types of Pt-based multilayers. Clear inverse spin Hall signals and spin Hall magnetoresistance have been observed in all samples below the Curie temperature, which corroborate the strong spin-orbit torque effect observed previously.

cond-mat.mtrl-sci↗

Unveiling the role of Co-O-Mg bond in magnetic anisotropy of Pt/Co/MgO using atomically controlled deposition and in-situ electrical measurement

Despite the crucial role of interfacial perpendicular magnetic anisotropy in Co(Fe)/MgO based magnetic tunnel junction, the underlying mechanism is still being debated. Here, we report an anatomical study of oxygen and Mg effect on Pt/Co bilayers through repeated in-situ anomalous Hall effect measurements, controlled oxygen exposure and Mg deposition in an ultrahigh vacuum system. We found that chemisorbed oxygen not only quenches the effective magnetic moment of the Co surface layer, but also softens its magnetic anisotropy. However, a subsequent Mg dusting on the oxygen pre-exposed Pt/Co surface can recover the magnetic anisotropy. The ab initio calculations on the exchange splitting and orbital hybridization near the Fermi level give a clear physical explanation of the experimental observations. Our results suggest that Co(Fe)-O-M bond plays a more important role than the widely perceived Co(Fe)-O bond does in realizing interfacial perpendicular magnetic anisotropy in Co(Fe)/MgO heterostructures.

cond-mat.mtrl-sci↗

Chebyshev polynomials, moment matching, and optimal estimation of the unseen

We consider the problem of estimating the support size of a discrete distribution whose minimum non-zero mass is at least $ \frac{1}{k}$. Under the independent sampling model, we show that the sample complexity, i.e., the minimal sample size to achieve an additive error of $εk$ with probability at least 0.1 is within universal constant factors of $ \frac{k}{\log k}\log^2\frac{1}ε $, which improves the state-of-the-art result of $ \frac{k}{ε^2 \log k} $ in \cite{VV13}. Similar characterization of the minimax risk is also obtained. Our procedure is a linear estimator based on the Chebyshev polynomial and its approximation-theoretic properties, which can be evaluated in $O(n+\log^2 k)$ time and attains the sample complexity within a factor of six asymptotically. The superiority of the proposed estimator in terms of accuracy, computational efficiency and scalability is demonstrated in a variety of synthetic and real datasets.

math.ST↗

Thickness dependence of spin Hall magnetoresistance in FeMn/Pt bilayers

We investigated spin Hall magnetoresistance in FeMn/Pt bilayers, which was found to be one order of magnitude larger than that of heavy metal and insulating ferromagnet or antiferromagnet bilayer systems, and comparable to that of NiFe/Pt bilayers. The spin Hall magnetoresistance shows a non-monotonic dependence on the thicknesses of both FeMn and Pt. The former can be accounted for by the thickness dependence of net magnetization in FeMn thin films, whereas the latter is mainly due to spin accumulation and diffusion in Pt. Through analysis of the Pt thickness dependence, the spin Hall angle, spin diffusion length of Pt and the real part of spin mixing conductance were determined to be 0.2, 1.1 nm, and $5.5 * 10^{14} Ω^{-1} m^{-2}$, respectively. The results corroborate the spin orbit torque effect observed in this system recently.

cond-mat.mes-hall↗

Field-like spin orbit torque in ultra-thin polycrystalline FeMn films

Field-like spin orbit torque in FeMn/Pt bilayers with ultra-thin polycrystalline FeMn has been characterized through planar Hall effect measurements. A large effective field is obtained for FeMn in the thickness range of 2 to 5 nm. The experimental observations can be reasonably accounted for by using a macro-spin model under the assumption that the FeMn layer is composed of two spin sublattices with unequal magnetizations. The large effective field corroborates the spin Hall origin of the effective field considering the much smaller uncompensated net moments in FeMn as compared to NiFe. The effective absorption of spin current by FeMn is further confirmed by the fact that spin current generated by Pt in NiFe/FeMn/Pt trilayers can only travel through the FeMn layer with a thickness of 1 to 4 nm. By quantifying the field-like effective field induced in NiFe, a spin diffusion length of 2 nm is estimated in FeMn, in consistence with values reported in literature by ferromagnetic resonance and spin-pumping experiments.

cond-mat.mes-hall↗

Interstellar Pickup Ion Production in the Global Heliosphere and Heliosheath

Interstellar Pickup ions (PUIs) play a significant part in mediating the solar wind (SW) interaction with the interstellar medium. In this paper, we examine the details of spatial variation of the PUI velocity distribution function (VDF) in the SW by solving the PUI transport equation. We assume the PUI distribution is isotropic resulting from strong pitch-angle scattering by wave-particle interaction. A three-dimensional model combining the MHD treatment of the background SW and neutrals with a kinetic treatment of PUIs throughout the heliosphere and the surrounding local interstellar medium (LISM) has been developed. The model generates PUI power law tails via second-order Fermi process. We analyze how PUIs transform across the heliospheric termination shock (TS) and obtain the PUI phase space distribution in the inner heliosheath including continuing velocity diffusion. Our simulated PUI spectra are compared with observations made by New Horizons, Ulysses, Voyager 1, 2 and Cassini, and a satisfactory agreement is demonstrated. Some specific features in the observations, for example, a cutoff of PUI VDF at $v = V_{SW}$ and a $f \propto v^{-5}$ tail in the reference frame of the SW, are well represented by the model.

astro-ph.SR↗

Equivalence of additive-combinatorial linear inequalities for Shannon entropy and differential entropy

This paper addresses the correspondence between linear inequalities of Shannon entropy and differential entropy for sums of independent group-valued random variables. We show that any balanced (with the sum of coefficients being zero) linear inequality of Shannon entropy holds if and only if its differential entropy counterpart also holds; moreover, any linear inequality for differential entropy must be balanced. In particular, our result shows that recently proved differential entropy inequalities by Kontoyiannis and Madiman \cite{KM14} can be deduced from their discrete counterparts due to Tao \cite{Tao10} in a unified manner. Generalizations to certain abelian groups are also obtained. Our proof of extending inequalities of Shannon entropy to differential entropy relies on a result of Rényi \cite{Renyi59} which relates the Shannon entropy of a finely discretized random variable to its differential entropy and also helps in establishing the entropy of the sum of quantized random variables is asymptotically equal to that of the quantized sum; the converse uses the asymptotics of the differential entropy of convolutions with weak additive noise.

cs.IT↗

Strong data-processing inequalities for channels and Bayesian networks

The data-processing inequality, that is, $I(U;Y) \le I(U;X)$ for a Markov chain $U \to X \to Y$, has been the method of choice for proving impossibility (converse) results in information theory and many other disciplines. Various channel-dependent improvements (called strong data-processing inequalities, or SDPIs) of this inequality have been proposed both classically and more recently. In this note we first survey known results relating various notions of contraction for a single channel. Then we consider the basic extension: given SDPI for each constituent channel in a Bayesian network, how to produce an end-to-end SDPI? Our approach is based on the (extract of the) Evans-Schulman method, which is demonstrated for three different kinds of SDPIs, namely, the usual Ahslwede-Gács type contraction coefficients (mutual information), Dobrushin's contraction coefficients (total variation), and finally the $F_I$-curve (the best possible non-linear SDPI for a given channel). Resulting bounds on the contraction coefficients are interpreted as probability of site percolation. As an example, we demonstrate how to obtain SDPI for an $n$-letter memoryless channel with feedback given an SDPI for $n=1$. Finally, we discuss a simple observation on the equivalence of a linear SDPI and comparison to an erasure channel (in the sense of "less noisy" order). This leads to a simple proof of a curious inequality of Samorodnitsky (2015), and sheds light on how information spreads in the subsets of inputs of a memoryless channel.

cs.IT↗