OT-FairBoost: Optimal Transport-Guided Gradient Boosting for Fairness Regularization on Tabular Data

Abstract

Although neural-based machine learning models have received a lot of attention recently, tree-based models such as gradient boosting are competitive for tabular data and therefore remain widely used in various applications of AI. As when using other machine learning predictive models, they can however yield discriminative predictions across demographic groups, due to so-called algorithmic biases. These undesirable phenomena have motivated the emergence of new regulatory frameworks and various AI fairness strategies. While several pre-and post-processing methodologies exist to mitigate such bias on gradient boosting models, only a few in-processing methods have been proposed. To bridge this gap, we introduce OT-FairBoost, a novel in-processing framework that incorporates a Wasserstein-2 distance penalty directly into the objective function of gradient-boosted trees. This OT-based mitigation strategy has been shown to efficiently optimize group fairness criteria such as Demographic Parity and Equalized Odds on neural-based predictions. To adapt this approach for gradient boosting, we extend the sample-wise gradient estimation of the Wasserstein-2 distance between group predictions to discrete distributions and hessian diagonals. We then integrate our approach into the LightGBM training procedure and evaluate it across binary classification, regression, and multi-group sensitive attribute settings. Experimental results in each of these settings demonstrate that OT-FairBoost achieves best accuracy-fairness trade-offs against alternatives.