arXiv Science⌕ Search

arXiv · 2611.23419

LIC-Audit: How Comparable Are Reported Gains in Learned Image Compression?

Abstract

Learned image compression (LIC) papers often report BD-rate improvements of only a few percent. They are measured against VTM reference software whose version keeps changing: the claims we audit name 7 versions, 5 in 2025 papers alone. But how comparable are these numbers across papers, and what evidence should future papers give for such small gains? We introduce LIC-Audit, an analysis of 353 released rate-distortion curves from 36 repositories, and a controlled re-evaluation of eight public codec releases with 28,193 encode-decode records. We identify three problems. First, different VTM reference runs change BD-rates by up to 3.56 percentage points, and on CLIC Pro published numbers order 10 of 55 method pairs differently from a common computation; comparing codecs directly over a fixed quality range removes this dependence. Second, releases use different and mostly undocumented conventions for counting bits, computing PSNR, and padding images. Under consistent measurement, the GLIC method's 1.00% lead over the HPCM method on Tecnick becomes a 1.43% deficit, changing only the padding reverses the comparison of HPCM and CMIC, and most gaps narrow when MS-SSIM replaces PSNR. Third, average curves hide how much results vary from image to image, so whether a small gain is statistically significant depends on the assumed variation. An optimistic assumption calls 12.0% of comparisons between equally good codecs significant on test sets as small as Kodak, instead of 5%; a cautious one leaves 18 of 45 differences between recent codecs undecided, yet per-image results show 12 of them to be significant. Beyond auditing past results, LIC-Audit provides a versioned evaluation protocol, a public leaderboard website with a scoring tool, source-linked benchmark data, per-image measurements, and reporting guidelines, to help future LIC papers make comparable and verifiable claims of progress.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Haisheng Fu, Jie Liang, Runyu Yang, Feng Ding, Xin Dong, Zixiao Jin, Jingning Han. 2026-11-17. LIC-Audit: How Comparable Are Reported Gains in Learned Image Compression?. https://arxiv.science/abs/2611.23419

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

Physics-Aware Zero-Shot Learning for Low-Dose CT from a Single Sinogram

Low-dose computed tomography (CT) imaging remains a persistent challenge, especially under heterogeneous acquisition conditions. Zero-shot learning, which enables models to learn directly from individual images without external supervision, represents a compelling approach to mitigate distribution mismatches arising from variations in scanner hardware, imaging protocols, and patient demographics. However, most existing zero-shot approaches employ down-sampling operations that reduce spatial resolution and cause domain shifts, which become particularly evident when applied to raw sinogram data. Here, we propose a physics-aware zero-shot CT denoising framework to exploit the conjugate symmetry property intrinsic to CT sinograms. Conjugate X-ray pencil beams traverse identical anatomical paths and ideally yield the same expected attenuation values but with independent noise realizations. By randomly mapping sinogram values between conjugate-ray pairs, we synthesize structurally consistent yet noise-diverse sinogram pairs, enabling self-supervised network training without external data. The resulting lightweight denoising network demonstrates strong generalization across low-dose simulation, clinical helical CT, and preclinical photon-counting CT datasets. Quantitative and qualitative results demonstrate competitive denoising performance, with favorable noise suppression and structural preservation across diverse acquisition settings. This work establishes a generalizable and data-efficient paradigm for CT denoising that integrates physical redundancy into learning-based image reconstruction. The code for the proposed method is openly available at: https://github.com/shiyongyi/Physics-Aware-Zero-Shot-CT-Sinogram-Denoising

eess.IV↗

QUTCC: Quantile Uncertainty Training and Conformal Calibration for Imaging Inverse Problems

While deep learning offers tremendous promise for scientific and medical imaging, any failures and hallucinations (predictions that do not coincide with reality) are hard to pinpoint and can have serious downstream consequences. Uncertainty estimation techniques, such as conformal prediction, can help by predicting statistically valid error bars for a model's prediction. However, popular conformal prediction methods were not designed for high-dimensional image-valued problems and do not take into account spatial correlations within an image during conformal calibration, resulting in larger-than-necessary uncertainty intervals. We propose a practical simultaneous quantile regression method that enables non-linear, spatially-adaptive scaling during conformal calibration. Our method, QUTCC uses a U-Net architecture with a quantile embedding to learn a full conditional quantile distribution during training, and then leverages this non-linear, learned function for spatially-adaptive conformal calibration. At test time, our method can efficiently estimate uncertainty intervals with pixel-marginal coverage guarantees. In addition, QUTCC can also predict pixel-wise conditional probability density estimates without any built-in distributional assumptions. We evaluate our method on several denoising problems, accelerated magnetic resonance imaging, and quantitative phase microscopy. Our method consistently produces tighter uncertainty intervals than prior conformal methods at the same coverage level, can predict plausible conditional distributions for different tasks, and in some cases, high-uncertainty regions can help us locate hallucinations in a model's prediction.

eess.IV↗

GroundGazer: An optical reference system for planar localization with millimeter accuracy at low cost

Highly accurate indoor localization systems with absolute mm positioning accuracy are currently expensive. They include laser trackers, total stations, and motion capture systems relying on multiple high-end cameras. In this work, we introduce a high-accuracy, planar indoor localization system named GroundGazer (GG) for autonomous mobile robots (AMRs). GG estimates the AMR's planar position with mm and its heading with sub-degree accuracy. The system requires only a monocular (fisheye) camera, a chessboard floor, and an optional laser diode. Our system is simple and low-cost due to the chessboard floor, robust, scalable to multiple robots, and extendable to 3D position and orientation estimation.

eess.IV↗