arXiv · 2611.16650
Learning the Missing Derivative: Neural Multiple-Scattering Operators for Inverse Volume Rendering
Abstract
Reconstructing optically thick media from photographs requires modeling multiple scattering and its response to changes in extinction. Frozen-source tomography discards this derivative; differentiable path tracing estimates it through expensive, noisy sampling. We instead predict the multiple-scattering field with a neural operator and differentiate through it during inverse rendering, while computing transmittance and single scattering directly. A further challenge arises during optimization: an operator that predicts the field accurately on held-out media can still produce poor derivatives at the density states visited by the optimizer. We address this by fine-tuning on states generated during inversions driven by the operator, using Monte Carlo scattering-field supervision. On held-out optically thick clouds, our method improves relighting over frozen-source tomography at equal time and outperforms differentiable path tracing given substantially more time. Training on inversion trajectories also improves derivative alignment at visited states and reduces optimization drift.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Sipeng Chen, Shibo Li. 2026-11-12. Learning the Missing Derivative: Neural Multiple-Scattering Operators for Inverse Volume Rendering. https://arxiv.science/abs/2611.16650
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.