Factor-Wise Parameter Learning in Score-Based VAMP
Score-based vector approximate message passing (SC-VAMP) builds state-evolution-predictable inference from modular soft-input soft-output (SISO) factors, but every factor must be handed correct parameters: a wrong sparsity rate, signal variance, or noise level distorts the tilted distributions and Onsager terms, raises the fixed-point mean-squared error (MSE), and invalidates matched state-evolution (SE) prediction. We let each factor learn its own parameters instead. An expectation-maximization (EM) M-step taken under the module's tilted distribution is attached to every parameterized factor and costs O(N) per module, because that distribution and its moments are precisely what the SISO rule already computes on the way to the score; the score-based interface and the Onsager correction are left untouched. Under standard large-system SE assumptions and identifiability conditions, the true parameters and the matched SE variance form a fixed point of the recursion, at which the estimate attains the replica minimum MSE (MMSE); prior factors and likelihood/linear-MMSE (LMMSE) factors are treated separately, the latter under the Gaussian cavity induced by the VAMP transformed-error model. On linear and one-bit Bernoulli-Gaussian compressed sensing, the updates recover near-oracle accuracy from strongly mismatched initializations.