arXiv · 2611.20246
TileCache: Serving Multi-Round Diffusion Image Editing with Compressed Activation Caches
Abstract
Multi-round diffusion image editing can reduce computation by reusing intermediate activations, but retaining these activations across editing rounds introduces substantial memory and bandwidth overheads. Compression can reduce these overheads, but efficient cache construction is challenging: compressing only after editing requires buffering over 100 GB of activations per request. Moreover, the compressed cache must support selective reuse, as future masked edits require only a subset of the cached activations. It also exposes a scheduling challenge, as cached edits are faster than initial generations, causing naive policies to severely delay either initial generations or editing requests. In this paper, we aim to address both challenges through compression-informed serving. We develop TileCache, a serving system for multi-round diffusion editing. It compresses reusable activations and incorporates a scheduler that balances both edits and initial generation requests. Compared with the state-of-the-art image editing baseline, TileCache sustains over 2x the request arrival rate at 90% SLO attainment. It completes edits 2.4-4.5x and initial generations 1.3-2.2x faster than the baseline, while preserving image quality.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Yuyang Tian, Desen Sun, Shuncheng Jie, Lishan Yang, Sihang Liu. 2026-11-15. TileCache: Serving Multi-Round Diffusion Image Editing with Compressed Activation Caches. https://arxiv.science/abs/2611.20246
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.