arXiv ScienceSearch

arXiv subjects

Peter Chien

Publications and source records attributed to Peter Chien.

3 recordsLinked to original sources

Efficient Experimental Design for Regularized Linear Models

Regularized linear models, such as Lasso, have attracted great attention in statistical learning and data science. However, there is sporadic work on constructing efficient data collection for regularized linear models. In this work, we propose an experimental design approach, using nearly orthogonal Latin hypercube designs, to enhance the variable selection accuracy of the regularized linear models. Systematic methods for constructing such designs are presented. The effectiveness of the proposed method is illustrated with several examples.

stat.ME

Another Look at Statistical Calibration: A Non-Asymptotic Theory and Prediction-Oriented Optimality

We provide another look at the statistical calibration problem in computer models. This viewpoint is inspired by two overarching practical considerations of computer models: (i) many computer models are inadequate for perfectly modeling physical systems, even with the best-tuned calibration parameters; (ii) only a finite number of data points are available from the physical experiment associated with a computer model. Following this new line of thinking, we provide a non-asymptotic theory and derive a prediction-oriented calibration method. Our calibration method minimizes the predictive mean squared error for a finite sample size with statistical guarantees. We introduce an algorithm to perform the proposed calibration method and connect it to existing Bayesian calibration methods. Synthetic and real examples are provided to corroborate the derived theory and illustrate some advantages of the proposed calibration method.

stat.ME

Minimax Optimal Rates of Estimation in Functional ANOVA Models with Derivatives

We establish minimax optimal rates of convergence for nonparametric estimation in functional ANOVA models when data from first-order partial derivatives are available. Our results reveal that partial derivatives can improve convergence rates for function estimation with deterministic or random designs. In particular, for full $d$-interaction models, the optimal rates with first-order partial derivatives on $p$ covariates are identical to those for $(d-p)$-interaction models without partial derivatives. For additive models, the rates by using all first-order partial derivatives are root-$n$ to achieve the "parametric rate". We also investigate the minimax optimal rates for first-order partial derivative estimations when derivative data are available. Those rates coincide with the optimal rate for estimating the first-order derivative of a univariate function.

math.ST