arXiv subjects

Sujit Ghosh

Publications and source records attributed to Sujit Ghosh.

13 recordsLinked to original sources

arXiv2026

Asymptotic Theory of Tail Dependence and Bootstrap for Checkerboard Copulas

A comprehensive asymptotic and bootstrap theory is established for checkerboard-based estimation of the copula and its lower and upper tail copula counterparts under unknown marginal distributions. The proposed estimator of the tail copula extends a local bilinear interpolation of the empirical copula to the tail region, providing a flexible nonparametric approach for modeling extremal dependence. Almost sure uniform consistency is established under mild conditions on the checkerboard grid. Weak convergence of the checkerboard copula process is derived, showing that smoothing preserves the first-order asymptotic limit of the empirical copula process, including the effect of marginal estimation. These results are further extended to lower and upper tail copula processes, yielding asymptotic normality for tail dependence measures. Since the limiting processes depend on unknown characteristics of the underlying true copula, a multiplier bootstrap procedure adapted to the checkerboard structure is proposed and shown to be asymptotically valid. Simulation studies and statistical applications validate our theoretical findings under a range of dependence structures. Although the limiting processes match with that observed for the empirical copula, the finite sample performance shows a noticeable improvement under checkerboard smoothing.

stat.ME↗

arXiv2024

Conformal Prediction for Astronomy Data with Measurement Error

Astronomers often deal with data where the covariates and the dependent variable are measured with heteroscedastic non-Gaussian error. For instance, while TESS and Kepler datasets provide a wealth of information, addressing the challenges of measurement errors and systematic biases is critical for extracting reliable scientific insights and improving machine learning models' performance. Although techniques have been developed for estimating regression parameters for these data, few techniques exist to construct prediction intervals with finite sample coverage guarantees. To address this issue, we tailor the conformal prediction approach to our application. We empirically demonstrate that this method gives finite sample control over Type I error probabilities under a variety of assumptions on the measurement errors in the observed data. Further, we demonstrate how the conformal prediction method could be used for constructing prediction intervals for unobserved exoplanet masses using established broken power-law relationships between masses and radii found in the literature.

astro-ph.IM↗

arXiv2023

Nonparametric Estimation of Conditional Copula using Smoothed Checkerboard Bernstein Sieves

Conditional copulas are useful tools for modeling the dependence between multiple response variables that may vary with a given set of predictor variables. Conditional dependence measures such as conditional Kendall's tau and Spearman's rho that can be expressed as functionals of the conditional copula are often used to evaluate the strength of dependence conditioning on the covariates. In general, semiparametric estimation methods of conditional copulas rely on an assumed parametric copula family where the copula parameter is assumed to be a function of the covariates. The functional relationship can be estimated nonparametrically using different techniques but it is required to choose an appropriate copula model from various candidate families. In this paper, by employing the empirical checkerboard Bernstein copula (ECBC) estimator we propose a fully nonparametric approach for estimating conditional copulas, which doesn't require any selection of parametric copula models. Closed-form estimates of the conditional dependence measures are derived directly from the proposed ECBC-based conditional copula estimator. We provide the large-sample consistency of the proposed estimator as well as the estimates of conditional dependence measures. The finite-sample performance of the proposed estimator and comparison with semiparametric methods are investigated through simulation studies. An application to real case studies is also provided.

stat.ME↗

arXiv2023

ProGO: Probabilistic Global Optimizer

In the field of global optimization, many existing algorithms face challenges posed by non-convex target functions and high computational complexity or unavailability of gradient information. These limitations, exacerbated by sensitivity to initial conditions, often lead to suboptimal solutions or failed convergence. This is true even for Metaheuristic algorithms designed to amalgamate different optimization techniques to improve their efficiency and robustness. To address these challenges, we develop a sequence of multidimensional integration-based methods that we show to converge to the global optima under some mild regularity conditions. Our probabilistic approach does not require the use of gradients and is underpinned by a mathematically rigorous convergence framework anchored in the nuanced properties of nascent optima distribution. In order to alleviate the problem of multidimensional integration, we develop a latent slice sampler that enjoys a geometric rate of convergence in generating samples from the nascent optima distribution, which is used to approximate the global optima. The proposed Probabilistic Global Optimizer (ProGO) provides a scalable unified framework to approximate the global optima of any continuous function defined on a domain of arbitrary dimension. Empirical illustrations of ProGO across a variety of popular non-convex test functions (having finite global optima) reveal that the proposed algorithm outperforms, by order of magnitude, many existing state-of-the-art methods, including gradient-based, zeroth-order gradient-free, and some Bayesian Optimization methods, in term regret value and speed of convergence. It is, however, to be noted that our approach may not be suitable for functions that are expensive to compute.

math.OC↗

arXiv2023

Scalable Resampling in Massive Generalized Linear Models via Subsampled Residual Bootstrap

Residual bootstrap is a classical method for statistical inference in regression settings. With massive data sets becoming increasingly common, there is a demand for computationally efficient alternatives to residual bootstrap. We propose a simple and versatile scalable algorithm called subsampled residual bootstrap (SRB) for generalized linear models (GLMs), a large class of regression models that includes the classical linear regression model as well as other widely used models such as logistic, Poisson and probit regression. We prove consistency and distributional results that establish that the SRB has the same theoretical guarantees under the GLM framework as the classical residual bootstrap, while being computationally much faster. We demonstrate the empirical performance of SRB via simulation studies and a real data analysis of the Forest Covertype data from the UCI Machine Learning Repository.

stat.ME↗

arXiv2022

PaEBack: Pareto-Efficient Backsubsampling for Time Series Data

Time series forecasting has been a quintessential topic in data science, but traditionally, forecasting models have relied on extensive historical data. In this paper, we address a practical question: How much recent historical data is required to attain a targeted percentage of statistical prediction efficiency compared to the full time series? We propose the Pareto-Efficient Backsubsampling (PaEBack) method to estimate the percentage of the most recent data needed to achieve the desired level of prediction accuracy. We provide a theoretical justification based on asymptotic prediction theory for the AutoRegressive (AR) models. In particular, through several numerical illustrations, we show the application of the PaEBack for some recently developed machine learning forecasting methods even when the models might be misspecified. The main conclusion is that only a fraction of the most recent historical data provides near-optimal or even better relative predictive accuracy for a broad class of forecasting methods.

stat.AP↗

arXiv2022

Transporting survival of an HIV clinical trial to the external target populations

Due to the heterogeneity of the randomized controlled trial (RCT) and external target populations, the estimated treatment effect from the RCT is not directly applicable to the target population. For example, the patient characteristics of the ACTG 175 HIV trial are significantly different from that of the three external target populations of interest: US early-stage HIV patients, Thailand HIV patients, and southern Ethiopia HIV patients. This paper considers several methods to transport the treatment effect from the ACTG 175 HIV trial to the target populations beyond the trial population. Most transport methods focus on continuous and binary outcomes; on the contrary, we derive and discuss several transport methods for survival outcomes: an outcome regression method based on a Cox proportional hazard (PH) model, an inverse probability weighting method based on the models for treatment assignment, sampling score, and censoring, and a doubly robust method that combines both methods, called the augmented calibration weighting (ACW) method. However, as the PH assumption was found to be incorrect for the ACTG 175 trial, the methods that depend on the PH assumption may lead to the biased quantification of the treatment effect. To account for the violation of the PH assumption, we extend the ACW method with the linear spline-based hazard regression model that does not require the PH assumption. Applying the aforementioned methods for transportability, we explore the effect of PH assumption, or the violation thereof, on transporting the survival results from the ACTG 175 trial to various external populations.

stat.AP↗

arXiv2022

Shape-constrained Estimation in Functional Regression with Bernstein Polynomials

Shape restrictions on functional regression coefficients such as non-negativity, monotonicity, convexity or concavity are often available in the form of a prior knowledge or required to maintain a structural consistency in functional regression models. A new estimation method is developed in shape-constrained functional regression models using Bernstein polynomials. Specifically, estimation approaches from nonparametric regression are extended to functional data, properly accounting for shape-constraints in a large class of functional regression models such as scalar-on-function regression (SOFR), function-on-scalar regression (FOSR), and function-on-function regression (FOFR). Theoretical results establish the asymptotic consistency of the constrained estimators under standard regularity conditions. A projection based approach provides point-wise asymptotic confidence intervals for the constrained estimators. A bootstrap test is developed facilitating testing of the shape constraints. Numerical analysis using simulations illustrate improvement in efficiency of the estimators from the use of the proposed method under shape constraints. Two applications include i) modeling a drug effect in a mental health study via shape-restricted FOSR and ii) modeling subject-specific quantile functions of accelerometry-estimated physical activity in the Baltimore Longitudinal Study of Aging (BLSA) as outcomes via shape-restricted quantile-function on scalar regression (QFOSR). R software implementation and illustration of the proposed estimation method and the test is provided.

stat.ME↗

arXiv2021

Nonparametric estimation of multivariate copula using empirical bayes method

In the field of finance, insurance, and system reliability, etc., it is often of interest to measure the dependence among variables by modeling a multivariate distribution using a copula. The copula models with parametric assumptions are easy to estimate but can be highly biased when such assumptions are false, while the empirical copulas are non-smooth and often not genuine copula making the inference about dependence challenging in practice. As a compromise, the empirical Bernstein copula provides a smooth estimator but the estimation of tuning parameters remains elusive. In this paper, by using the so-called empirical checkerboard copula we build a hierarchical empirical Bayes model that enables the estimation of a smooth copula function for arbitrary dimensions. The proposed estimator based on the multivariate Bernstein polynomials is itself a genuine copula and the selection of its dimension-varying degrees is data-dependent. We also show that the proposed copula estimator provides a more accurate estimate of several multivariate dependence measures which can be obtained in closed form. We investigate the asymptotic and finite-sample performance of the proposed estimator and compare it with some nonparametric estimators through simulation studies. An application to portfolio risk management is presented along with a quantification of estimation uncertainty.

stat.ME↗

arXiv2018

Predicting Exoplanets Mass and Radius: A Nonparametric Approach

A fundamental endeavor in exoplanetary research is to characterize the bulk compositions of planets via measurements of their masses and radii. With future sample sizes of hundreds of planets to come from TESS and PLATO, we develop a statistical method that can flexibly yet robustly characterize these compositions empirically, via the exoplanet M-R relation. Although the M-R relation has been explored in many prior works, they mostly use a power-law model, with assumptions that are not flexible enough to capture important features in current and future M-R diagrams. To address these shortcomings, a nonparametric approach is developed using a sequence of Bernstein polynomials. We demonstrate the benefit of taking the nonparametric approach by benchmarking our findings with previous work and showing that a power-law can only reasonably describe the M-R relation of the smallest planets and that the intrinsic scatter can change non-monotonically with different values of a radius. We then apply this method to a larger dataset, consisting of all the Kepler observations in the NASA Exoplanet Archive. Our nonparametric approach provides a tool to estimate the M-R relation by incorporating heteroskedastic measurement errors into the model. As more observations will be obtained in the near future, this approach can be used with the provided R code to analyze a larger dataset for a better understanding of the M-R relation.

astro-ph.EP↗

arXiv2018

A Statistical Exploration of Duckworth-Lewis Method Using Bayesian Inference

Duckworth-Lewis (D/L) method is the incumbent rain rule used to decide the result of a limited overs cricket match should it not be able to reach its natural conclusion. Duckworth and Lewis (1998) devised a two factor relationship between the numbers of overs a team had remaining and the number of wickets they had lost in order to quantify the percentage resources a team has at any stage of the match. As number of remaining overs decrease and lost wickets increase the resources are expected to decrease. The resource table which is still being used by ICC (International Cricket Council) for 50 overs cricket match suffers from lack of monotonicity both in numbers of overs left and number of wickets lost. We apply Bayesian inference to build a resource table which overcomes the non monotonicity problem of the current D/L resource table and show that it gives better prediction for teams in first innings score and hence it is more suitable for using in rain affected matches.

stat.AP↗

arXiv2018

Multivariate Density Estimation with Missing Data

Multivariate density estimation is a popular technique in statistics with wide applications including regression models allowing for heteroskedasticity in conditional variances. The estimation problems become more challenging when observations are missing in one or more variables of the multivariate vector. A flexible class of mixture of tensor products of kernel densities is proposed which allows for easy implementation of imputation methods using Gibbs sampling and shown to have superior performance compared to some of the exisiting imputation methods currently available in literature. Numerical illustrations are provided using several simulated data scenarios and applications to couple of case studies are also presented.

stat.ME↗

arXiv2015

On the estimation of the order of smoothness of the regression function

The order of smoothness chosen in nonparametric estimation problems is critical. This choice balances the tradeoff between model parsimony and data overfitting. The most common approach used in this context is cross-validation. However, cross-validation is computationally time consuming and often precludes valid post-selection inference without further considerations. With this in mind, borrowing elements from the objective Bayesian variable selection literature, we propose an approach to select the degree of a polynomial basis. Although the method can be extended to most series-based smoothers, we focus on estimates arising from Bernstein polynomials for the regression function, using mixtures of g-priors on the model parameter space and a hierarchical specification for the priors on the order of smoothness. We prove the asymptotic predictive optimality for the method, and through simulation experiments, demonstrate that, compared to cross-validation, our approach is one or two orders of magnitude faster and yields comparable predictive accuracy. Moreover, our method provides simultaneous quantification of model uncertainty and parameter estimates. We illustrate the method with real applications for continuous and binary responses.

stat.ME↗