arXiv subjects

Nicholas Syring

Publications and source records attributed to Nicholas Syring.

8 recordsLinked to original sources

arXiv2022

Direct Gibbs posterior inference on risk minimizers: construction, concentration, and calibration

Real-world problems, often couched as machine learning applications, involve quantities of interest that have real-world meaning, independent of any statistical model. To avoid potential model misspecification bias or over-complicating the problem formulation, a direct, model-free approach is desired. The traditional Bayesian framework relies on a model for the data-generating process so, apparently, the desired direct, model-free, posterior-probabilistic inference is out of reach. Fortunately, likelihood functions are not the only means of linking data and quantities of interest. Loss functions provide an alternative link, where the quantity of interest is defined, or at least could be defined, as a minimizer of the corresponding risk, or expected loss. In this case, one can obtain what is commonly referred to as a Gibbs posterior distribution by using the empirical risk function directly. This manuscript explores the Gibbs posterior construction, its asymptotic concentration properties, and the frequentist calibration of its credible regions. By being free from the constraints of model specification, Gibbs posteriors create new opportunities for probabilistic inference in modern statistical learning problems.

stat.ME↗

arXiv2022

Valid predictions of random quantities in linear mixed models

In applications of linear mixed-effects models, experimenters often desire uncertainty quantification for random quantities, like predicted treatment effects for unobserved individuals or groups. For example, consider an agricultural experiment measuring a response on animals receiving different treatments and residing on different farms. A farmer deciding whether to adopt the treatment is most interested in farm-level uncertainty quantification, for example, the range of plausible treatment effects predicted at a new farm. The two-stage linear mixed-effects model is often used to model this type of data. However, standard techniques for linear mixed model-based prediction do not produce calibrated uncertainty quantification. In general, the prediction intervals used in practice are not valid -- they do not meet or exceed their nominal coverage level over repeated sampling. We propose new methods for constructing prediction intervals within the two-stage model framework based on an inferential model (IM). The IM method generates prediction intervals that are guaranteed valid for any sample size. Simulation experiments suggest variations of the IM method that are both valid and efficient, a major improvement over existing methods. We illustrate the use of the IM method using two agricultural data sets, including an on-farm study where the IM-based prediction intervals suggest a higher level of uncertainty in farm-specific effects compared to the standard Student-$t$ based intervals, which are not valid.

stat.ME↗

arXiv2021

Robust posterior inference for Youden's index cutoff

Youden's index cutoff is a classifier mapping a patient's diagnostic test outcome and available covariate information to a diagnostic category. Typically the cutoff is estimated indirectly by first modeling the conditional distributions of test outcomes given diagnosis and then choosing the optimal cutoff for the estimated distributions. Here we present a Gibbs posterior distribution for direct inference on the cutoff. Our approach makes incorporating prior information about the cutoff much easier compared to existing methods, and does so without specifying probability models for the data, which may be misspecified. The proposed Gibbs posterior distribution is robust with respect to data distributions, is supported by large-sample theory, and performs well in simulations compared to alternative Bayesian and bootstrap-based methods. In addition, two real data sets are examined which illustrate the flexibility of the Gibbs posterior approach and its ability to utilize direct prior information about the cutoff.

stat.ME↗

arXiv2021

Stochastic optimization for numerical evaluation of imprecise probabilities

In applications of imprecise probability, analysts must compute lower (or upper) expectations, defined as the infimum of an expectation over a set of parameter values. Monte Carlo methods consistently approximate expectations at fixed parameter values, but can be costly to implement in grid search to locate minima over large subsets of the parameter space. We investigate the use of stochastic iterative root-finding methods for efficiently computing lower expectations. In two examples we illustrate the use of various stochastic approximation methods, and demonstrate their superior performance in comparison to grid search.

stat.CO↗

arXiv2020

Gibbs posterior concentration rates under sub-exponential type losses

Bayesian posterior distributions are widely used for inference, but their dependence on a statistical model creates some challenges. In particular, there may be lots of nuisance parameters that require prior distributions and posterior computations, plus a potentially serious risk of model misspecification bias. Gibbs posterior distributions, on the other hand, offer direct, principled, probabilistic inference on quantities of interest through a loss function, not a model-based likelihood. Here we provide simple sufficient conditions for establishing Gibbs posterior concentration rates when the loss function is of a sub-exponential type. We apply these general results in a range of practically relevant examples, including mean regression, quantile regression, and sparse high-dimensional classification. We also apply these techniques in an important problem in medical statistics, namely, estimation of a personalized minimum clinically important difference.

math.ST↗

arXiv2016

BayesBD: An R Package for Bayesian Inference on Image Boundaries

We present the BayesBD package providing Bayesian inference for boundaries of noisy images. The BayesBD package implements flexible Gaussian process priors indexed by the circle to recover the boundary in a binary or Gaussian noised image, with the benefits of guaranteed geometric restrictions on the estimated boundary, (nearly) minimax optimal and smoothness adaptive convergence rates, and convenient joint inferences under certain assumptions. The core sampling tasks for our model have linear complexity, and our implementation in c++ using packages Rcpp and RcppArmadillo is computationally efficient. Users can access the full functionality of the package in both Rgui and the corresponding shiny application. Additionally, the package includes numerous utility functions to aid users in data preparation and analysis of results. We compare BayesBD with selected existing packages using both simulations and real data applications, and demonstrate the excellent performance and flexibility of BayesBD even when the observation contains complicated structural information that may violate its assumptions.

stat.CO↗

arXiv2016

Robust and rate-optimal Gibbs posterior inference on the boundary of a noisy image

Detection of an image boundary when the pixel intensities are measured with noise is an important problem in image segmentation, with numerous applications in medical imaging and engineering. From a statistical point of view, the challenge is that likelihood-based methods require modeling the pixel intensities inside and outside the image boundary, even though these are typically of no practical interest. Since misspecification of the pixel intensity models can negatively affect inference on the image boundary, it would be desirable to avoid this modeling step altogether. Towards this, we develop a robust Gibbs approach that constructs a posterior distribution for the image boundary directly, without modeling the pixel intensities. We prove that, for a suitable prior on the image boundary, the Gibbs posterior concentrates asymptotically at the minimax optimal rate, adaptive to the boundary smoothness. Monte Carlo computation of the Gibbs posterior is straightforward, and simulation experiments show that the corresponding inference is more accurate than that based on existing Bayesian methodology.

stat.ME↗

arXiv2015

Calibrating general posterior credible regions

An advantage of methods that base inference on a posterior distribution is that credible regions are readily obtained. Except in well-specified situations, however, there is no guarantee that such regions will achieve the nominal frequentist coverage probability, even approximately. To overcome this difficulty, we propose a general strategy that introduces an additional scalar tuning parameter to control the posterior spread, and we develop an algorithm that chooses this parameter so that the corresponding credible region achieves the nominal coverage probability.

stat.ME↗