Empowering Bayes with sources of uncertainty: from confidence modelling to sparse estimation
We introduce sources of uncertainty (SoU) inference, a general framework that extends Bayesian inference by allowing researchers to explicitly encode heterogeneous confidence across model components. This heterogeneity allows the probabilistic treatment to vary selectively across the model, controlling both the uncertainty retained within each component and its propagation to the rest of the model. Empirical Bayes and profiling-type inference emerge as limiting configurations of this selective treatment. Because confidence acts through a mechanism distinct from prior informativeness, the two can be controlled separately, providing an additional degree of freedom for Bayesian model design. Building on this selective treatment, we develop a general approach for inducing sparsity in statistical models and illustrate its use in linear and logistic regression, as well as in Bayesian neural networks, where it enables self-pruning.