arXiv Science⌕ Search

arXiv · 2610.24046

LUMINR: Intensity-conditioned Meta-learned INRs for Accelerated Medical Image Registration

Abstract

Implicit neural representations (INRs) have been applied to deformable image registration, where a lightweight network maps a spatial coordinate to a deformation vector. Because an INR encodes one specific signal in its parameters, a fresh network must be optimized for every image pair at test time, which is slow. Existing methods reduce this cost by meta-learning an initialization across a population of image pairs, and condition the weights of the INR globally, so the same conditioning applies at every coordinate while the deformation field it initializes varies across the domain. We propose LUMINR, a meta-learning framework that accelerates this per-pair fitting and in which the conditioning is local instead. LUMINR uses an INR that maps a coordinate, together with local intensity and gradient features, to a deformation vector, so the conditioning varies over the domain at the resolution of the field being modelled. Its objective is to find an initialization of the INR parameters from which the network can be fine-tuned to register any unseen pair in only a few optimization iterations. We evaluate LUMINR on 3D deformable registration of brain MRI from the OASIS dataset, where local conditioning and the meta-learned initialization prove complementary: early in fitting they reach a markedly higher accuracy than either does alone. Fine-tuned from that initialization, LUMINR matches the accuracy of the same conditioned INR fit from scratch in roughly a tenth of the gradient steps and a tenth of the wall-clock time, while the deformation fields stay smooth with negligible folding.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Damian Rynczak, Marek Wodzinski. 2026-10-16. LUMINR: Intensity-conditioned Meta-learned INRs for Accelerated Medical Image Registration. https://arxiv.org/abs/2610.24046

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

SLIM: Semantic-based Low-bitrate Image compression for Machines

In recent years, the demand of image compression models for machine vision has increased dramatically. However, the training frameworks of image compression still focus on the vision of human, preserving unnecessary details and limiting bitrate efficiency for machine vision tasks. In this paper, we propose Semantic-based Low-bitrate Image compression for Machines, termed SLIM. This proposed framework consists of two key components: RoI-focused latent compression and semantic latent enhancement with dual cues. First, the latent compressor is trained to focus on Region-of-Interest (RoI) areas that are semantically and functionally important for machine vision tasks in the latent space, while requiring no explicit masks during inference. Second, to compensate for severe information loss at extremely low bitrates, a diffusion-based semantic decoder enhances the compressed latent with a pretrained diffusion model guided by two complementary cues provided by an RoI-focused latent and text-based semantic guidance. This design preserves RoI details that are critical for machine perception while maintaining semantically coherent and artifact-suppressed non-RoI regions under extremely low bitrates. Experimental results show that SLIM consistently achieves strong performance across diverse machine vision tasks under the same bits per pixel condition, compared to conventional image compression models for machines. Our code is available at https://github.com/mcml-official/SLIM

eess.IV↗

Severity-Channel Conditioning: An Injection-Level Study for Consumer-Device Deblurring

Motion-deblurring models lose substantial accuracy when transferred from professional cameras to smartphone-derived imagery. This paper studies whether a severity descriptor, partly derived from the paired sharp target, helps adaptation on the iPhoneBlur consumer-device benchmark. Under a shared update budget, input concatenation of a severity map is compared with global feature modulation by capture metadata, spatial feature modulation by the severity map, and a tier-contrastive output objective, together with an unconditioned spectral-loss control, all fine-tuned from the same domain-adapted latent-diffusion baseline. The primary experiment is an oracle diagnostic: target-derived information is supplied at inference. For the evaluated model pair, input concatenation improves overall peak signal-to-noise ratio from 31.23 to 31.30 dB, whereas feature modulation, the contrastive objective, and the spectral-loss control do not exceed the baseline. The gain is positive on 87.2% of test images and on 14 of 15 held-out source videos; this video-level analysis describes the evaluated checkpoint pair and does not establish robustness to retraining, and three training seeds are reported separately. The input-level gain recurs on a transformer backbone. In one exploratory run, zeroing the channel at inference retains most of the gain in peak signal-to-noise ratio but lowers structural similarity below the baseline. A normalized-step diagnostic does not support the expected larger-gradient explanation. The results characterize the evaluated configurations and do not establish injection location as the sole cause, a spatial-locality mechanism, or a reliable deployment advantage.

eess.IV↗

CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstruction

As a critical modality for structural biology, cryogenic electron microscopy (cryo-EM) facilitates the determination of macromolecular structures at near-atomic resolution. The core computational task in single-particle cryo-EM is to reconstruct the 3D electrostatic potential of a molecule from noisy 2D projections acquired at unknown orientations. Gaussian mixture models (GMMs) provide a continuous, compact, and physically interpretable representation for molecular density and have recently gained interest in cryo-EM reconstruction. However, existing methods rely on external consensus maps or atomic models for initialization, limiting their use in self-contained pipelines. In parallel, differentiable rendering techniques such as Gaussian splatting have demonstrated remarkable scalability and efficiency for volumetric representations, suggesting a natural fit for GMM-based cryo-EM reconstruction. However, off-the-shelf Gaussian splatting methods are designed for photorealistic view synthesis and remain incompatible with cryo-EM due to mismatches in the image formation physics, reconstruction objectives, and coordinate systems. Addressing these issues, we propose cryoSplat, a GMM-based method that integrates Gaussian splatting with the physics of cryo-EM image formation. In particular, we develop an orthogonal projection-aware Gaussian splatting, with adaptations such as a view-dependent normalization term and FFT-aligned coordinate system tailored for cryo-EM imaging. These innovations enable stable and efficient homogeneous reconstruction directly from raw cryo-EM particle images using random initialization. Experimental results on real datasets validate the effectiveness and robustness of cryoSplat over representative baselines. The code will be released at https://github.com/Chen-Suyi/cryosplat.

eess.IV↗