SoftBART-CORM Models for Density Regression

Abstract

Flexible modelling of the conditional distribution of a response given predictors is important in many applications where nonlinear effects, heteroskedasticity, and multimodality may be present. We introduce the SoftBART-CoRM, a predictor-dependent infinite mixture model that combines the interpretable component structure of Compound Random Measures (CoRMs) with SoftBART priors on both mixture weights and component-specific parameters. The model flexibly captures complex distributional features, while global--local shrinkage and predictor-selection priors mitigate overfitting and identify the covariates driving component allocation and kernel parameters. Posterior inference is performed using an efficient Markov chain Monte Carlo algorithm that leverages existing \texttt{R} implementations of SoftBART. Through simulation studies and real-data applications, we show that the proposed approach can adaptively shrink towards simpler mixture representations, provide interpretable inference on the predictors governing different aspects of the conditional distribution, and achieve superior out-of-sample predictive performance relative to benchmark models.