Image-Based Breast Implant Detection for Mammography Dataset Curation and Near-Real-Time Deployment: Comparing Foundation Models and Task-Specific Convolutional Models

Vasisht Ishwar; Hari Trivedi; Young Seok Jeon; Beatrice Brown-Mulry; Frank Li; Rohan Satya Isaac; Mohammadreza Chavoshi; Judy Wawira Gichoya

arXiv · 2610.03817

Image-Based Breast Implant Detection for Mammography Dataset Curation and Near-Real-Time Deployment: Comparing Foundation Models and Task-Specific Convolutional Models

Vasisht Ishwar·Hari Trivedi·Young Seok Jeon·Beatrice Brown-Mulry·Frank Li·Rohan Satya Isaac·Mohammadreza Chavoshi·Judy Wawira Gichoya

View original source ↗Read source document ↗Export metadata ↓

Abstract

Purpose: To evaluate the performance-feasibility tradeoffs of foundation models (FMs) and task-specific convolutional neural networks (CNNs) trained from scratch for breast implant classification in 2D mammography, with emphasis on suitability for near real-time clinical deployment. Methods: We evaluated four models: two FMs (RAD-DINO and MammoCLIP) and two CNNs trained from scratch for implant prediction (ResNet18 and our lightweight ResNetLite). Using the Emory Breast Imaging Dataset, 5,000 unilateral screening mammograms were used for training/validation and 1,000 manually reviewed unilateral images were held out for testing. For the FMs, global image embeddings from the pretrained encoder were classified using a support vector machine (SVM). The CNNs were trained end-to-end on 2D mammograms, with ResNetLite optimized via grid search over depth and width to balance accuracy and efficiency. Performance was evaluated using AUROC, sensitivity, specificity, accuracy, embedding visualization, and inference-latency. Results: All models demonstrated strong performance on held-out test data (n = 1,000). MammoCLIP achieved the highest AUROC (0.999) with the quickest training time of 493 seconds. RAD-DINO achieved the highest sensitivity (0.980; accuracy 0.989) but had the slowest inference and training times. ResNet18 and MammoCLIP achieved comparable accuracy (0.985). ResNetLite showed no statistically significant difference from ResNet18 (AUROC 0.993; accuracy 0.976) despite using only 1.4% of ResNet18's parameters, and had the fastest inference time. Conclusion: FMs and task-specific CNN models reliably detect breast implants on 2D mammography. Model selection is best guided by deployment context: MammoCLIP for GPU-equipped hospital settings requiring scalable integration, and lightweight CNNs such as ResNetLite for resource-constrained or edge deployments.

Explore related subjects

eess.IV cs.CV q-bio.TO

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Vasisht Ishwar, Hari Trivedi, Young Seok Jeon, Beatrice Brown-Mulry, Frank Li, Rohan Satya Isaac, Mohammadreza Chavoshi, Judy Wawira Gichoya. 2026-10-01. Image-Based Breast Implant Detection for Mammography Dataset Curation and Near-Real-Time Deployment: Comparing Foundation Models and Task-Specific Convolutional Models. https://arxiv.org/abs/2610.03817

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

SLIM: Semantic-based Low-bitrate Image compression for Machines

In recent years, the demand of image compression models for machine vision has increased dramatically. However, the training frameworks of image compression still focus on the vision of human, preserving unnecessary details and limiting bitrate efficiency for machine vision tasks. In this paper, we propose Semantic-based Low-bitrate Image compression for Machines, termed SLIM. This proposed framework consists of two key components: RoI-focused latent compression and semantic latent enhancement with dual cues. First, the latent compressor is trained to focus on Region-of-Interest (RoI) areas that are semantically and functionally important for machine vision tasks in the latent space, while requiring no explicit masks during inference. Second, to compensate for severe information loss at extremely low bitrates, a diffusion-based semantic decoder enhances the compressed latent with a pretrained diffusion model guided by two complementary cues provided by an RoI-focused latent and text-based semantic guidance. This design preserves RoI details that are critical for machine perception while maintaining semantically coherent and artifact-suppressed non-RoI regions under extremely low bitrates. Experimental results show that SLIM consistently achieves strong performance across diverse machine vision tasks under the same bits per pixel condition, compared to conventional image compression models for machines. Our code is available at https://github.com/mcml-official/SLIM

eess.IV↗

arXiv2026

Severity-Channel Conditioning: An Injection-Level Study for Consumer-Device Deblurring

Motion-deblurring models lose substantial accuracy when transferred from professional cameras to smartphone-derived imagery. This paper studies whether a severity descriptor, partly derived from the paired sharp target, helps adaptation on the iPhoneBlur consumer-device benchmark. Under a shared update budget, input concatenation of a severity map is compared with global feature modulation by capture metadata, spatial feature modulation by the severity map, and a tier-contrastive output objective, together with an unconditioned spectral-loss control, all fine-tuned from the same domain-adapted latent-diffusion baseline. The primary experiment is an oracle diagnostic: target-derived information is supplied at inference. For the evaluated model pair, input concatenation improves overall peak signal-to-noise ratio from 31.23 to 31.30 dB, whereas feature modulation, the contrastive objective, and the spectral-loss control do not exceed the baseline. The gain is positive on 87.2% of test images and on 14 of 15 held-out source videos; this video-level analysis describes the evaluated checkpoint pair and does not establish robustness to retraining, and three training seeds are reported separately. The input-level gain recurs on a transformer backbone. In one exploratory run, zeroing the channel at inference retains most of the gain in peak signal-to-noise ratio but lowers structural similarity below the baseline. A normalized-step diagnostic does not support the expected larger-gradient explanation. The results characterize the evaluated configurations and do not establish injection location as the sole cause, a spatial-locality mechanism, or a reliable deployment advantage.

eess.IV↗

arXiv2026

CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstruction

As a critical modality for structural biology, cryogenic electron microscopy (cryo-EM) facilitates the determination of macromolecular structures at near-atomic resolution. The core computational task in single-particle cryo-EM is to reconstruct the 3D electrostatic potential of a molecule from noisy 2D projections acquired at unknown orientations. Gaussian mixture models (GMMs) provide a continuous, compact, and physically interpretable representation for molecular density and have recently gained interest in cryo-EM reconstruction. However, existing methods rely on external consensus maps or atomic models for initialization, limiting their use in self-contained pipelines. In parallel, differentiable rendering techniques such as Gaussian splatting have demonstrated remarkable scalability and efficiency for volumetric representations, suggesting a natural fit for GMM-based cryo-EM reconstruction. However, off-the-shelf Gaussian splatting methods are designed for photorealistic view synthesis and remain incompatible with cryo-EM due to mismatches in the image formation physics, reconstruction objectives, and coordinate systems. Addressing these issues, we propose cryoSplat, a GMM-based method that integrates Gaussian splatting with the physics of cryo-EM image formation. In particular, we develop an orthogonal projection-aware Gaussian splatting, with adaptations such as a view-dependent normalization term and FFT-aligned coordinate system tailored for cryo-EM imaging. These innovations enable stable and efficient homogeneous reconstruction directly from raw cryo-EM particle images using random initialization. Experimental results on real datasets validate the effectiveness and robustness of cryoSplat over representative baselines. The code will be released at https://github.com/Chen-Suyi/cryosplat.

eess.IV↗