arXiv Science⌕ Search

arXiv subjects

Yun Yang

Publications and source records attributed to Yun Yang.

At least 127 records · Page 7Linked to original sources

Stable and non-symmetric pitchfork bifurcations

In this paper, we present a criterion for pitchfork bifurcation of smooth vector fields based on a topological argument. Our result expands Rajapakse and Smale's result \cite{RS2} significantly. Based on our criterion, we present a class of families of non-symmetric vector fields undergoing a pitchfork bifurcation.

math.DS↗

A topological classification of locally constant potentials via zero-temperature measures

We provide a topological classification of locally constant functions over subshifts of finite type via their zero-temperature measures. Our approach is to analyze the relationship between the distribution of the zero-temperature measures and the boundary of higher dimensional generalized rotation sets. We also discuss the regularity of the localized entropy function on the boundary of the generalized rotation sets.

math.DS↗

Bayesian Regression Tree Ensembles that Adapt to Smoothness and Sparsity

Ensembles of decision trees are a useful tool for obtaining for obtaining flexible estimates of regression functions. Examples of these methods include gradient boosted decision trees, random forests, and Bayesian CART. Two potential shortcomings of tree ensembles are their lack of smoothness and vulnerability to the curse of dimensionality. We show that these issues can be overcome by instead considering sparsity inducing soft decision trees in which the decisions are treated as probabilistic. We implement this in the context of the Bayesian additive regression trees framework, and illustrate its promising performance through testing on benchmark datasets. We provide strong theoretical support for our methodology by showing that the posterior distribution concentrates at the minimax rate (up-to a logarithmic factor) for sparse functions and functions with additive structures in the high-dimensional regime where the dimensionality of the covariate space is allowed to grow near exponentially in the sample size. Our method also adapts to the unknown smoothness and sparsity levels, and can be implemented by making minimal modifications to existing BART algorithms.

stat.ME↗

Non-stationary Almost Sure Invariance Principle for Hyperbolic Systems with Singularities

We investigate a wide class of two-dimensional hyperbolic systems with singularities, and prove the almost sure invariance principle (ASIP) for the random process generated by sequences of dynamically Hölder observables. The observables could be unbounded, and the process may be non-stationary and need not have linearly growing variances. Our results apply to Anosov diffeomorphisms, Sinai dispersing billiards and their perturbations. The random processes under consideration are related to the fluctuation of Lyapunov exponents, the shrinking target problem, etc.

math.DS↗

Entropy rigidity and flexibility for suspension flows over Anosov diffeomorphisms

For any $C^\infty$, area-preserving Anosov diffeomorphism $f$ of a surface, we show that a suspension flow over $f$ is $C^\infty$-conjugate to a constant-time suspension flow of a hyperbolic automorphism of the two torus if and only if the volume measure is the measure with maximal entropy. We also show that the the metric entropy with respect to the volume measure and the topological entropy of suspension flow over Anosov diffeomorphisms on torus achieve all possible values. Our results fit into two programs related to entropy rigidity and flexibility of Anosov systems.

math.DS↗

$α$-Variational Inference with Statistical Guarantees

We propose a family of variational approximations to Bayesian posterior distributions, called $α$-VB, with provable statistical guarantees. The standard variational approximation is a special case of $α$-VB with $α=1$. When $α\in(0,1]$, a novel class of variational inequalities are developed for linking the Bayes risk under the variational approximation to the objective function in the variational optimization problem, implying that maximizing the evidence lower bound in variational inference has the effect of minimizing the Bayes risk within the variational density family. Operating in a frequentist setup, the variational inequalities imply that point estimates constructed from the $α$-VB procedure converge at an optimal rate to the true parameter in a wide range of problems. We illustrate our general theory with a number of examples, including the mean-field variational approximation to (low)-high-dimensional Bayesian linear regression with spike and slab priors, mixture of Gaussian models, latent Dirichlet allocation, and (mixture of) Gaussian variational approximation in regular parametric models.

math.ST↗

On Statistical Optimality of Variational Bayes

The article addresses a long-standing open problem on the justification of using variational Bayes methods for parameter estimation. We provide general conditions for obtaining optimal risk bounds for point estimates acquired from mean-field variational Bayesian inference. The conditions pertain to the existence of certain test functions for the distance metric on the parameter space and minimal assumptions on the prior. A general recipe for verification of the conditions is outlined which is broadly applicable to existing Bayesian models with or without latent variables. As illustrations, specific applications to Latent Dirichlet Allocation and Gaussian mixture models are discussed.

math.ST↗

Frequentist coverage and sup-norm convergence rate in Gaussian process regression

Gaussian process (GP) regression is a powerful interpolation technique due to its flexibility in capturing non-linearity. In this paper, we provide a general framework for understanding the frequentist coverage of point-wise and simultaneous Bayesian credible sets in GP regression. As an intermediate result, we develop a Bernstein von-Mises type result under supremum norm in random design GP regression. Identifying both the mean and covariance function of the posterior distribution of the Gaussian process as regularized $M$-estimators, we show that the sampling distribution of the posterior mean function and the centered posterior distribution can be respectively approximated by two population level GPs. By developing a comparison inequality between two GPs, we provide exact characterization of frequentist coverage probabilities of Bayesian point-wise credible intervals and simultaneous credible bands of the regression function. Our results show that inference based on GP regression tends to be conservative; when the prior is under-smoothed, the resulting credible intervals and bands have minimax-optimal sizes, with their frequentist coverage converging to a non-degenerate value between their nominal level and one. As a byproduct of our theory, we show that the GP regression also yields minimax-optimal posterior contraction rate relative to the supremum norm, which provides a positive evidence to the long standing problem on optimal supremum norm contraction rate in GP regression.

math.ST↗

Statistical inference for high dimensional regression via Constrained Lasso

In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator, is obtained by simultaneously solving two estimating equations---one imposing a zero-bias constraint for the low-dimensional parameter and the other forming an $\ell_1$-penalized procedure for the high-dimensional nuisance parameter. By carefully choosing the zero-bias constraint, the resulting estimator of the low dimensional parameter is shown to admit an asymptotically normal limit attaining the Cramér-Rao lower bound in a semiparametric sense. We propose a tuning-free iterative algorithm for implementing the CLasso. We show that when the algorithm is initialized at the Lasso estimator, the de-sparsified estimator proposed in van de Geer et al. [\emph{Ann. Statist.} {\bf 42} (2014) 1166--1202] is asymptotically equivalent to the first iterate of the algorithm. We analyse the asymptotic properties of the CLasso estimator and show the globally linear convergence of the algorithm. We also demonstrate encouraging empirical performance of the CLasso through numerical studies.

stat.ME↗

Information Management for Decentralized Energy Storages under Market Uncertainties

In this paper, we propose a model of decentralized energy storages, who serve as instruments to shift energy supply intertemporally. From storages' perspective, we investigate their optimal buying or selling decisions under market uncertainty. The goal of this paper is to understand the economic value of future market information, as energy storages mitigate market uncertainty by forward-looking strategies. At a system level, we evaluate different information management policies to coordinate storages' actions and improve their aggregate profitability: (1) providing a publicly available market forecasting channel; (2) encouraging decentralized storages to share their private forecasts with each other; (3) releasing additional market information to a targeted subset of storages exclusively. We highlight the perils of too much market information provision and advice on exclusiveness of market forecast channel.

math.OC↗

The generalization of Sierpinski carpet and Sierpinski triangle in $n$-dimensional space

We obtain a nature generalization for an affine Sierpinski carpet and Sierpinski triangle to $n$-dimensional space, by using the generations and characterizations of affinely-equivalent Sierpinski carpet. Exactly, in this paper, a Menger sponge and Sierpinski simplex in $4$-dimensional space could be drawn out clearly under an affine transformation. Furthermore, the method could be used to a much broader class in fractals.

math.DG↗

Non-asymptotic theory for nonparametric testing

We consider nonparametric testing in a non-asymptotic framework. Our statistical guarantees are exact in the sense that Type I and II errors are controlled for any finite sample size. Meanwhile, one proposed test is shown to achieve minimax optimality in the asymptotic sense. An important consequence of this non-asymptotic theory is a new and practically useful formula for selecting the optimal smoothing parameter in nonparametric testing. The leading example in this paper is smoothing spline models under Gaussian errors. The results obtained therein can be further generalized to the kernel ridge regression framework under possibly non-Gaussian errors. Simulations demonstrate that our proposed test improves over the conventional asymptotic test when sample size is small to moderate.

math.ST↗

Bayesian model selection consistency and oracle inequality with intractable marginal likelihood

In this article, we investigate large sample properties of model selection procedures in a general Bayesian framework when a closed form expression of the marginal likelihood function is not available or a local asymptotic quadratic approximation of the log-likelihood function does not exist. Under appropriate identifiability assumptions on the true model, we provide sufficient conditions for a Bayesian model selection procedure to be consistent and obey the Occam's razor phenomenon, i.e., the probability of selecting the "smallest" model that contains the truth tends to one as the sample size goes to infinity. In order to show that a Bayesian model selection procedure selects the smallest model containing the truth, we impose a prior anti-concentration condition, requiring the prior mass assigned by large models to a neighborhood of the truth to be sufficiently small. In a more general setting where the strong model identifiability assumption may not hold, we introduce the notion of local Bayesian complexity and develop oracle inequalities for Bayesian model selection procedures. Our Bayesian oracle inequality characterizes a trade-off between the approximation error and a Bayesian characterization of the local complexity of the model, illustrating the adaptive nature of averaging-based Bayesian procedures towards achieving an optimal rate of posterior convergence. Specific applications of the model selection theory are discussed in the context of high-dimensional nonparametric regression and density regression where the regression function or the conditional density is assumed to depend on a fixed subset of predictors. As a result of independent interest, we propose a general technique for obtaining upper bounds of certain small ball probability of stationary Gaussian processes.

math.ST↗

The moving frame on the fractal curves

Using the moving frame and invariants, any discrete curve in $\R^3$ could be uniquely identified by its centroaffine curvatures and torsions. In this paper, depending on the affine curvatures of the fractal curves, such as Koch curve and Hilbert curve, we can clearly describe their iterative regularities. Interestingly, by the affine curvatures, the fractal curves can be quantified and encoded accordingly to a sequence. Hence, it is more convenient for future reference. Given three starting points, we can directly generate the affine Koch curve and affine Hilbert curve at the step $n, \forall n\in \mathbb{Z}^+$. Certainly, if the initial three points are standard, the curve is the traditional Koch curve or Hilbert curve. By this method, the characteristic of some fractal curves which look like irregular could be quantified, and the regularities would become more obvious.

math.DG↗

Moving frame and integrable system of the discrete centroaffine curves in R^3

Any two equivalent discrete curves must have the same invariants at the corresponding points under an affine transformation. In this paper, we construct the moving frame and invariants for the discrete centroaffine curves, which could be used to discriminate the same discrete curves from different graphics, and estimate whether a polygon flow is stable or periodically stable. In fact, using the similar method as the Frenet-Serret frame, a discrete curve can be uniquely identified by its centroaffine curvatures and torsions. In 1878, Darboux studied the problem of midpoint iteration of polygons[12]. Berlekamp et al studied this problem in detail[2]. Now, through the centroaffine curvatures and torsions, the iteration process can be clearly quantified. Exactly, we describe the whole iteration process by using centroaffine curvatures and torsions, and its periodicity could be directly exhibited. As an application, we would obtain some stable discrete space curves with changeless curvatures and torsions after multistep iteration. For the pentagram map of a polygon, the affinely regular polygons are stable. Furthermore, we find the convex hexagons with parallel and equi-length opposite sides are periodically stable, and some convex parallel and equi-length opposite sides octagons are also periodically stable. The proofs of these results are obtained using the structure equations of the discrete cnetroaffine curves and the integrable conditions of its flows.

math.DG↗

Bayesian fractional posteriors

We consider the fractional posterior distribution that is obtained by updating a prior distribution via Bayes theorem with a fractional likelihood function, a usual likelihood function raised to a fractional power. First, we analyze the contraction property of the fractional posterior in a general misspecified framework. Our contraction results only require a prior mass condition on certain Kullback-Leibler (KL) neighborhood of the true parameter (or the KL divergence minimizer in the misspecified case), and obviate constructions of test functions and sieves commonly used in the literature for analyzing the contraction property of a regular posterior. We show through a counterexample that some condition controlling the complexity of the parameter space is necessary for the regular posterior to contract, rendering additional flexibility on the choice of the prior for the fractional posterior. Second, we derive a novel Bayesian oracle inequality based on a PAC-Bayes inequality in misspecified models. Our derivation reveals several advantages of averaging based Bayesian procedures over optimization based frequentist procedures. As an application of the Bayesian oracle inequality, we derive a sharp oracle inequality in the convex regression problem under an arbitrary dimension. We also illustrate the theory in Gaussian process regression and density estimation problems.

math.ST↗

Communication-Efficient Distributed Statistical Inference

We present a Communication-efficient Surrogate Likelihood (CSL) framework for solving distributed statistical inference problems. CSL provides a communication-efficient surrogate to the global likelihood that can be used for low-dimensional estimation, high-dimensional regularized estimation and Bayesian inference. For low-dimensional estimation, CSL provably improves upon naive averaging schemes and facilitates the construction of confidence intervals. For high-dimensional regularized estimation, CSL leads to a minimax-optimal estimator with controlled communication cost. For Bayesian inference, CSL can be used to form a communication-efficient quasi-posterior distribution that converges to the true posterior. This quasi-posterior procedure significantly improves the computational efficiency of MCMC algorithms even in a non-distributed setting. We present both theoretical analysis and experiments to explore the properties of the CSL approximation.

stat.ML↗

The discrete centroaffine indefinite surface

In this paper we build the structure equations and the integrable systems for a discrete centroaffine indefinite surface in $\R^3$. At the same time, some centroaffine invariants are obtained according to the structure equations. Using these centroaffine invariants, we study the Laplacian operator and the convexity of a discrete centroaffine indefinite surface. Furthermore, some interest examples are provided.

math.DG↗