arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.08508

Budget-Constrained Multi-Consensus Decentralized Gradient Descent

Shuyi Ren·Nicol`o Michelusi·Erik G. Larsson
View original source ↗Read source document ↗Export metadata ↓

Abstract

We investigate decentralized gradient descent (DGD) with emphasis on efficient communication and computation resource utilization under budget constraints. As a first step toward the broader communication-computation allocation problem, we consider and analyze a \textit{multi-consensus decentralized gradient descent} (mcDGD) scheme, where the number of consensus rounds and the stepsize are allowed to vary across iterations. Building on a unified analytical framework for DGD, we derive finite-time convergence bounds that explicitly characterize the interaction between consensus quality and optimization dynamics. Our analysis requires only convexity of the local objective functions while assuming smoothness and strong convexity of the global objective. The resulting bounds enable a principled consensus-allocation strategy under resource constraints, for which we show that equal allocation of consensus rounds across iterations is optimal under our stepsize rule, up to integer rounding. Numerical experiments corroborate the theoretical findings and demonstrate favorable communication-computation tradeoffs compared with existing multi-consensus decentralized optimization baselines.

Explore related subjects

math.OCcs.SYeess.SY

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Shuyi Ren, Nicol`o Michelusi, Erik G. Larsson. 2026-10-06. Budget-Constrained Multi-Consensus Decentralized Gradient Descent. https://arxiv.org/abs/2610.08508

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Combining additivity and active subspaces for high-dimensional Gaussian process modeling

Gaussian processes are a widely embraced technique for regression due to their good prediction accuracy, analytical tractability, and built-in capabilities for uncertainty quantification. However, they suffer from the curse of dimensionality whenever the number of variables increases. This challenge is generally addressed by assuming additional structure in the problem, the preferred options being either additivity or low intrinsic dimensionality. After discussing their relative merits, our contribution for high-dimensional Gaussian process modeling is to combine them with a multi-fidelity strategy. We detail the corresponding construction and showcase the advantages through experiments on synthetic functions and datasets.

math.OC↗
arXiv2026

Constrained portfolio game with heterogeneous agents

We investigate stochastic utility maximization games under relative performance concerns in both finite-agent and infinite-agent (graphon) settings. An incomplete market model is considered where agents with power (CRRA) utility functions trade in a common risk-free bond and individual stocks driven by both common and idiosyncratic noise. The Nash equilibrium for both settings is characterized by forward-backward stochastic differential equations (FBSDEs) with a quadratic growth generator, where the solution of the graphon game leads to a novel form of infinite-dimensional McKean-Vlasov FBSDEs. Under mild conditions, we prove the existence of Nash equilibrium for both the graphon game and the $n$-agent game without common noise. Furthermore, we establish a convergence result showing that, with modest assumptions on the sensitivity matrix, as the number of agents increases, the Nash equilibrium and associated equilibrium value of the finite-agent game converge to those of the graphon game.

math.OC↗
arXiv2026

Controllability of Forward Stochastic Reaction--Convection--Diffusion Systems with Cascade Structure

We investigate the null and approximate controllability of coupled linear forward stochastic reaction--convection--diffusion systems under suitable cascade coupling conditions. The model consists of two forward stochastic parabolic equations governed by general second-order differential operators with time-, space-, and random-dependent coefficients. We consider a localized control acting on the drift term of the first equation, together with controls acting on the diffusion terms. By means of a duality argument, the controllability problem is reduced to an observability problem for the associated adjoint backward stochastic parabolic system. We establish a new global Carleman estimate for coupled backward stochastic parabolic systems whose drift terms belong to a negative Sobolev space. As an application of this estimate, we derive the required observability properties and establish the null and approximate controllability of the original forward system.

math.OC↗