arXiv ScienceSearch

arXiv · 2212.13731

Pixel Relationships-based Regularizer for Retinal Vessel Image Segmentation

Abstract

The task of image segmentation is to classify each pixel in the image based on the appropriate label. Various deep learning approaches have been proposed for image segmentation that offers high accuracy and deep architecture. However, the deep learning technique uses a pixel-wise loss function for the training process. Using pixel-wise loss neglected the pixel neighbor relationships in the network learning process. The neighboring relationship of the pixels is essential information in the image. Utilizing neighboring pixel information provides an advantage over using only pixel-to-pixel information. This study presents regularizers to give the pixel neighbor relationship information to the learning process. The regularizers are constructed by the graph theory approach and topology approach: By graph theory approach, graph Laplacian is used to utilize the smoothness of segmented images based on output images and ground-truth images. By topology approach, Euler characteristic is used to identify and minimize the number of isolated objects on segmented images. Experiments show that our scheme successfully captures pixel neighbor relations and improves the performance of the convolutional neural network better than the baseline without a regularization term.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Lukman Hakim, Takio Kurita. 2022-12-28. Pixel Relationships-based Regularizer for Retinal Vessel Image Segmentation. https://doi.org/10.23919/ipec-himeji2022-ecce53331.2022.9806976

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

SONAR: A Structure-Consistent Neural Operator for Null-Space-Aware Sparse View CT Reconstruction

Sparse-view computed tomography (CT) reduces radiation dose and acquisition time but remains severely ill-posed because incomplete projections poorly constrain null-space information. Existing learning-based methods often estimate this information in high-dimensional image space, conflate physical measurement errors with prediction errors, and depend on fixed discretizations. We propose SONAR, a Structure-Consistent Neural Operator for Null-Space-Aware Reconstruction. Instead of recovering the full null-space component, SONAR predicts a low-dimensional null-space-aware representation from the acquired projections as pseudo-measurements. It separates measurement and pseudo-measurement residuals, lifts them into the image domain through physics operators, and applies independent neural operators to constrain their structural effects, thereby accommodating admissible errors while suppressing unsupported structures. To support cross-discretization reconstruction, an anisotropic U-shaped neural operator models the periodic angular and nonperiodic detector dimensions using direction-dependent continuous supports, while image-domain neural operators re-discretize continuous kernels on target grids. These components form an optimization-inspired unrolled network. Experiments on simulated AAPM and clinical MARS photon-counting CT data demonstrate consistent improvements across seen and unseen view settings and unseen image resolutions. On AAPM dataset, SONAR improves PSNR by 1.87~dB at 62 views and by 7.63~dB under zero-shot transfer to a $512\times512$ grid over the strongest competing methods. SONAR also achieves the best overall performance in all clinical settings evaluated, demonstrating accurate, structurally reliable, and discretization-robust sparse-view CT reconstruction.

eess.IV

Deformable 2D Gaussian Splatting for Efficient 4K Video Compression

Ultra-High-Definition (UHD) video presents significant challenges for efficient storage and real-time decoding. Learning-based methods, such as Neural Video Compression (NVC) and Implicit Neural Representations (INR), achieve competitive rate-distortion performance but suffer from high decoding latency and excessive memory usage. Meanwhile, Gaussian Splatting has recently attracted attention in the computer graphics community due to its ultra-fast rendering and high-fidelity visual quality. Despite these advantages, its application in video compression remains largely unexplored. To bridge this gap, we propose a real-time video compression framework that represents and compresses a Group of Pictures (GOP) using a coarse-to-fine multi-scale 2D Gaussian Splatting (2DGS) structure coupled with a lightweight deformation network. Experiments demonstrate that our method delivers rate-distortion performance in LPIPS that surpasses H.265 and other state-of-the-art learning-based video compression methods. Our work demonstrates the potential of Gaussian Splatting as a practical solution for efficient high-resolution video compression.

eess.IV

Physics-informed denoising method for image reconstruction in quantitative low-field MRI

Low-field magnetic resonance imaging (MRI) is becoming increasingly important for medical imaging because it can reduce healthcare costs while ensuring high diagnostic output. Nevertheless, quantitative imaging in low-field MRI faces challenges, such as low signal-to-noise ratio and long scan durations. Deep learning approaches have been proposed for image reconstruction to overcome these challenges. Still, deep learning often requires large high-quality training datasets which are usually not available for low-field applications. Here we propose a modular unrolled end-to-end deep learning method for the denoised reconstruction of quantitative parameter maps directly from k-space data for low-field MRI. It consists of three sub-networks that are iteratively applied. They are used for the regularization of the quantitative parameter estimation, as well as for the signal estimation that is based on simulated signal curves. It generalises well and can be applied to different field strengths and even different quantitative MR sequences without the need for new training data. We applied the presented method to noisy data of knees acquired at 0.55 T for the reconstruction of $T_2$-maps and compared it to other classical and deep learning methods. We also applied the proposed approach to $T_1$-mapping of knees at 72 mT and $T_2$-mapping of brains at 0.6 T. The presented approach outperforms the other reconstruction methods with a median difference below 4 ms to the ground truth $T_2$-map. Even though the network was trained with $T_2$-maps acquired at 0.55 T, it successfully denoised data acquired at different field strengths, sequences, and of different anatomies. As a result, the proposed network and its underlying method offer an efficient and flexible solution to denoise low-field MR data and make quantitative low-field MRI a feasible diagnostic tool for clinical applications.

eess.IV