arXiv Science⌕ Search

arXiv subjects

Rostislav Matveev

Publications and source records attributed to Rostislav Matveev.

12 recordsLinked to original sources
arXiv2026

Shapes and Norms of Random Pairs

The shape function of a pair of finite-valued random variables was introduced in arXiv:2606.23849, where it was used to derive a spectral bound on the entanglement of the pair, a quantity measuring the extent to which their mutual information can be extracted. In this article, we further develop the theory of shape functions for pairs of random variables. We prove that, when $(X,Y)$ is uniformly supported on the edges of a biregular bipartite graph, the value of the shape function $\mathcal{S}(X,Y)(\alpha,\beta)$ equals the logarithm of the operator norm of the graph's incidence matrix with respect to Lebesgue exponents determined by $(\alpha,\beta)$.This identification, in particular, enables the numerical approximation of the shape function and, by duality, of the extension profile, also known as the tension region, of the pair. We also establish a collection of relations and inequalities satisfied by shape functions, including convexity and monotonicity properties, composition inequalities, and relations describing their behavior under conditioning and the adjoining of variables.

cs.IT↗
arXiv2026

Beyond Mutual Information: Extension Profiles and Shape Functions of Random Variable Pairs

We study the extension profile of a pair of jointly distributed finite-valued random variables $(X,Y)$, defined as the set of all triples of numbers $ (H(X|W), H(Y|W), I(X:Y|W)) $ obtained by extending the pair with an auxiliary random variable $W$. This object captures structural properties of joint distributions that are not determined solely by the entropies of $X$ and $Y$ and their mutual information. To describe the boundary of the extension profile, we introduce the associated shape function, defined as the Legendre--Fenchel transform of the nontrivial part of the profile boundary. We establish general upper and lower bounds on the shape function in terms of classical information-theoretic quantities. For pairs that are uniform on their support, we interpret the support as a biregular bipartite graph and relate the extension profile to combinatorial and spectral properties of this graph. In this setting, we derive bounds on the shape function in terms of the second-largest eigenvalue of the graph. Thus, pairs whose support graphs have a small second eigenvalue admit only a restricted class of extensions. Our results provide a new perspective on the information-theoretic structure of joint distributions and highlight connections among non-Shannon-type information inequalities, the G\'acs--K\"orner common information, and spectral graph theory. We discuss several applications of the developed framework to problems concerning the structure and representation of mutual information.

cs.IT↗
arXiv2026

Spectral Conditions for the Ingleton Inequality

The Ingleton inequality is a classical linear information inequality that holds for representable matroids but fails to be universally valid for entropic vectors. Understanding the extent to which this inequality can be violated has been a longstanding problem in information theory. In this paper, we show that for a broad class of jointly distributed random variables $(X,Y)$ the Ingleton inequality holds up to a small additive error, even even though the mutual information between $X$ and $Y$ is far from being extractable. Contrary to common intuition, strongly non-extractable mutual information does not lead to large violations of the Ingleton inequality in this setting. More precisely, we consider pairs $(X,Y)$ that are uniformly distributed on their joint support and whose associated biregular bipartite graph is an expander. For all auxiliary random variables $A$ and $B$ jointly distributed with $(X,Y)$, we establish a lower bound on the Ingleton quantity $I(X;Y | A) + I(X;Y | B) + I(A;B) - I(X;Y)$ in terms of the spectral parameters of the underlying graph. Our proof combines the expander mixing lemma with a partitioning technique for finite sets.

cs.IT↗
arXiv2025

Structural Properties of Entropic Vectors and Stability of the Ingleton Inequality

We study constrained versions of the Ingleton inequality in the entropic setting and quantify its stability under small violations of conditional independence. Although the classical Ingleton inequality fails for general entropy profiles, it is known to hold under certain exact independence constraints. We focus on the regime where selected conditional mutual information terms are small (but not zero), and the inequality continues to hold up to controlled error terms. A central technical tool is a structural lemma that materializes part of the mutual information between two random variables, implicitly capturing the effect of infinitely many non-Shannon--type inequalities. This leads to conceptually transparent proofs without explicitly invoking such infinite families. Some of our bounds recover, in a unified way, what can also be deduced from the infinite families of inequalities of Mat\'u\v{s} (2007) and of Dougherty--Freiling--Zeger (2011), while others appear to be new.

cs.IT↗
arXiv2023

Reverse Bernstein Inequality on the Circle

The more then hundred years old Bernstein inequality states that the supremum norm of the derivative of a trigonometric polynomial of fixed degree can be bounded from above by supremum norm of the polynomial itself. The reversed Bernstein inequality, that we prove in this note, says that the reverse inequality holds for functions in the orthogonal complement of the space of polynomials of fixed degree. In fact, we derived a more general result for the lower bounds on higher derivatives. These bounds are better then those obtained by applying bound for the first derivative successively several times.

math.CA↗
arXiv2019

Tropical diagrams of probability spaces

After endowing the space of diagrams of probability spaces with an entropy distance, we study its large-scale geometry by identifying the asymptotic cone as a closed convex cone in a Banach space. We call this cone the tropical cone, and its elements tropical diagrams of probability spaces. Given that the tropical cone has a rich structure, while tropical diagrams are rather flexible objects, we expect the theory of tropical diagrams to be useful for information optimization problems in information theory and artificial intelligence. In a companion article, we give a first application to derive a statement about the entropic cone.

math.DS↗
arXiv2019

Tropical probability theory and an application to the entropic cone

In a series of articles, we have been developing a theory of tropical diagrams of probability spaces, expecting it to be useful for information optimization problems in information theory and artificial intelligence. In this article, we give a summary of our work so far and apply the theory to derive a dimension-reduction statement about the shape of the entropic cone.

cs.IT↗
arXiv2019

Conditioning in tropical probability theory

We define a natural operation of conditioning of tropical diagrams of probability spaces and show that it is Lipschitz continuous with respect to the asymptotic entropy distance.

math.PR↗
arXiv2019

Arrow Contraction and Expansion in Tropical Diagrams

Arrow contraction applied to a tropical diagram of probability spaces is a modification of the diagram, replacing one of the morphisms by an isomorphims, while preserving other parts of the diagram. It is related to the rate regions introduced by Ahlswede and Körner. In a companion article we use arrow contraction to derive information about the shape of the entropic cone. Arrow expansion is the inverse operation to the arrow contraction.

math.PR↗
arXiv2017

Tropical Limits of Probability Spaces, Part I: The Intrinsic Kolmogorov-Sinai Distance and the Asymptotic Equipartition Property for Configurations

The entropy of a finite probability space $X$ measures the observable cardinality of large independent products $X^{\otimes n}$ of the probability space. If two probability spaces $X$ and $Y$ have the same entropy, there is an almost measure-preserving bijection between large parts of $X^{\otimes n}$ and $Y^{\otimes n}$. In this way, $X$ and $Y$ are asymptotically equivalent. It turns out to be challenging to generalize this notion of asymptotic equivalence to configurations of probability spaces, which are collections of probability spaces with measure-preserving maps between some of them. In this article we introduce the intrinsic Kolmogorov-Sinai distance on the space of configurations of probability spaces. Concentrating on the large-scale geometry we pass to the asymptotic Kolmogorov-Sinai distance. It induces an asymptotic equivalence relation on sequences of configurations of probability spaces. We will call the equivalence classes \emph{tropical probability spaces}. In this context we prove an Asymptotic Equipartition Property for configurations. It states that tropical configurations can always be approximated by homogeneous configurations. In addition, we show that the solutions to certain Information-Optimization problems are Lipschitz-con\-tinuous with respect to the asymptotic Kolmogorov-Sinai distance. It follows from these two statements that in order to solve an Information-Optimization problem, it suffices to consider homogeneous configurations. Finally, we show that spaces of trajectories of length $n$ of certain stochastic processes, in particular stationary Markov chains, have a tropical limit.

math.MG↗
arXiv2016

On the regular representation of measures

We give sufficient conditions for a parametrised family of probability measures on a Riemannian manifold with boundary to be represented by random maps of class $C^k$. The conditions allow for the probability densities to approach zero towards the boundary of the manifold. We also formulate two obstructions to regular representability.

math.DG↗