Wasserstein Target Diagram for Model Evaluation
The target diagram is often used in geosciences, which provides a visualization tool for model evaluation and shows the temporal or spatial matching of data. However, its construction requires paired data of equal sample sizes, limiting its application to model comparisons involving unpaired samples or probability distributions. In this study, we propose the Wasserstein target diagram based on the 2-Wasserstein distance from optimal transport. Unlike the original target diagram, the Wasserstein target diagram does not require paired data of equal sizes and evaluates models from the probability distribution perspective. We further establish that the two target diagrams coincide when the given paired data are comonotone, which is common in climate science, such as cumulative precipitation and solar radiation. Through two simulation studies and an application to wind speed distribution fitting, we demonstrate that the proposed diagram can detect the probability distribution discrepancies that the original target diagram may not distinguish. The Wasserstein target diagram therefore lifts the model evaluation to the probability level and provides a complementary approach to estimating the agreement in probability distributions.