arXiv · 2611.21312
PointZip: Statistically Lossless Compression for Climate Data with Pointwise Error Bounds
Abstract
High-resolution climate simulations generate data volumes that increasingly strain storage, I/O, and data dissemination. Error-bounded lossy compressors can reduce these costs, but their tolerances are usually user-chosen and difficult to standardize across heterogeneous climate datasets. We address this limitation with statistically lossless compression, where the pointwise compression error is bounded by the pointwise data uncertainty. We propose PointZip, a two-stage compressor that combines a rate-distortion-efficient base layer with error-bound-aware residual coding to enforce pointwise guarantees. On outputs from the widely used climate modeling framework ICON, PointZip makes 1km simulations practical by reducing storage bandwidth requirements by 72x. On the ERA5 climate dataset, PointZip reaches 69.3x on the most representative variables, reducing the commonly used subset to 4 TB. In downstream evaluations, PointZip preserves data spectra, extreme events, and air parcel trajectories, while increasing neural weather forecast RMSE by less than 1%, with negligible impact on the Fractions Skill Score (FSS).
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Jiayong Li, Pratyai Mazumder, Yuejiang Yu, Langwen Huang, Alexandru Calotoiu, Torsten Hoefler. 2026-11-16. PointZip: Statistically Lossless Compression for Climate Data with Pointwise Error Bounds. https://arxiv.science/abs/2611.21312
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.