arXiv ScienceSearch

arXiv · 2407.06988

Limiting Over-Smoothing and Over-Squashing of Graph Message Passing by Deep Scattering Transforms

Abstract

Graph neural networks (GNNs) have become pivotal tools for processing graph-structured data, leveraging the message passing scheme as their core mechanism. However, traditional GNNs often grapple with issues such as instability, over-smoothing, and over-squashing, which can degrade performance and create a trade-off dilemma. In this paper, we introduce a discriminatively trained, multi-layer Deep Scattering Message Passing (DSMP) neural network designed to overcome these challenges. By harnessing spectral transformation, the DSMP model aggregates neighboring nodes with global information, thereby enhancing the precision and accuracy of graph signal processing. We provide theoretical proofs demonstrating the DSMP's effectiveness in mitigating these issues under specific conditions. Additionally, we support our claims with empirical evidence and thorough frequency analysis, showcasing the DSMP's superior ability to address instability, over-smoothing, and over-squashing.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yuanhong Jiang, Dongmian Zou, Xiaoqun Zhang, Yu Guang Wang. 2026-05-19. Limiting Over-Smoothing and Over-Squashing of Graph Message Passing by Deep Scattering Transforms. https://arxiv.org/abs/2407.06988

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Sharp bounds for higher mixed Steklov-Robin eigenvalues on domains with holes

This article is concerned with mixed Steklov--Robin eigenvalues on bounded domains in $\mathbb{R}^{n}, n \geq 2$, with Lipschitz boundary. Specifically, we consider domains with symmetry of order $4$ containing a spherical hole. We obtain isoperimetric inequalities for the $k$-th Steklov-Robin eigenvalues for each $k \in \{2, 3, \dots, n+1\}$. We provide examples to emphasize the fact that the symmetry assumptions, on the family of domains considered, are crucial.

math.SP

Steklov isospectrality of conformal metrics

The Steklov spectrum of a smooth compact Riemannian manifold $(M,g)$ with boundary is the set of eigenvalues counted with multiplicities of its Dirichlet-to-Neumann map. (DN map) This article is devoted to the Steklov spectral inverse problem of recovering the metric $g$, up to natural gauge invariance, from its Steklov spectrum. Positive results are established in dimension $n\geq 3$ for conformal metrics under the assumption that the geodesic flow on the boundary is Anosov with simple length spectrum. The paper combines wave trace formula techniques with the injectivity of the geodesic X-ray transform for functions on closed Anosov manifolds. It is shown that knowledge of the Steklov spectrum determines the jet at the boundary of the underlying Riemannian metric within its conformal class. In this particular context, this parallels the well-known results of the Calderón problem, where we are given the entire Dirichlet-to-Neumann map instead. As a simple corollary, assuming real-analyticity of the conformal factor, Steklov isospectral metrics must coincide. Using similar arguments, we are also able to prove under the same assumption of hyperbolicity of the geodesic flow on the boundary, that generically any smooth potential $q$ can be recovered from the Steklov spectrum, in the sense that its jet at the boundary is determined by the spectrum of the DN map for the Schrödinger operator with potential $q$. Consequently, in this case, two analytic Steklov isospectral potentials must be equal.

math.SP

Revisiting the Weak Coupling Phenomenon for Two-Dimensional Schrödinger Operators

We study the existence of negative eigenvalues for two-dimensional Schrödinger operators with real-valued potentials in the weak coupling regime. In his pioneering paper [Simon 1976] from half a century ago, Simon was the first to describe the unique negative eigenvalue emerging from the threshold of the essential spectrum of one- and two-dimensional Schrödinger operators. The aim of this paper is to extend Simon's results in two dimensions to a broader class of potentials, allowing for both stronger singularities and slower decay at infinity, at the cost of losing uniqueness of weakly coupled eigenvalues.

math.SP