arXiv · 2611.12752
Transport, Entropy, and the Cost of Dependence: Maximum Conditional Entropy under Transport Constraints
Abstract
Maximum-entropy inference under Wasserstein constraints can be computationally challenging due to the underlying optimization over transport couplings. We investigate a tractable alternative based on maximizing conditional entropy under an average transport constraint. On Euclidean spaces, this formulation admits an explicit generalized-Gaussian additive-noise solution, providing a feasible approximation to the Wasserstein-constrained problem without solving an optimal transport problem. We establish quantitative bounds on the resulting optimality gap by showing that the two formulations admit a common feasible-marginal representation, with their discrepancy characterized by the mutual information retained between the nominal and perturbed variables. For discretely supported nominal distributions, we further obtain an exact decomposition of the gap into a marginal-entropy gain and a weighted Jensen-Shannon divergence.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Andre Bertolace, Konstantinos Gatsis, Kostas Margellos. 2026-11-09. Transport, Entropy, and the Cost of Dependence: Maximum Conditional Entropy under Transport Constraints. https://arxiv.science/abs/2611.12752
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.