Statistical Dark Matter: Synergy is everywhere but is hard to capture

Abstract

The information-theoretic construct of synergy refers to the statistical structure that is contained in three or more variables, but not in any subset of them. Here we leverage recent advances in multivariate information theory to show that synergy is far more prevalent in complex systems than previously thought. In particular, we show that many-body systems tend to become strongly dominated by synergy as the number of subcomponents grows. At the same time, our results also reveal that commonly used tools for statistical modelling severely underestimate synergistic structures. These findings imply that synergy constitutes a prevalent, yet often invisible, informational component of complex systems. With a certain poetic licence, we interpret these results as suggesting that synergy is the dark matter of statistics - interdependencies that we know exist, but standard instruments fail to detect.