arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2610.36364

When Slides Met Scans: Cross-Attention for Renal Cancer Prognosis

Anusha Krishnamoorthy·Basudha Pal
View original source ↗Read source document ↗Export metadata ↓

Abstract

Histopathology and computed tomography (CT) provide complementary views of renal cancer. We connect these modalities through bidirectional cross-attention between 16 histology prototypes and up to 32 kidney-centered CT tokens from frozen foundation models. In 210 TCGA-KIRC patients with 46 disease-specific survival (DSS) events, 5-fold evaluation yielded a C-index of $0.760\pm0.081$ and 3-year AUROC of 0.773 (95\% CI 0.678--0.860), the highest averages among evaluated unimodal and fusion baselines. External testing in 180 CPTAC-CCRCC patients yielded DSS C-index of 0.629 with CT withheld. Attribution analysis linked predictions to image regions while exposing acquisition artifacts. These findings support further study of cross-scale fusion and independent multimodal validation.

Explore related subjects

eess.IVcs.CV

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Anusha Krishnamoorthy, Basudha Pal. 2026-10-26. When Slides Met Scans: Cross-Attention for Renal Cancer Prognosis. https://arxiv.org/abs/2610.36364

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

FermatSyn: SAM2-Enhanced Bidirectional Mamba with Isotropic Spiral Scanning for Multi-Modal Medical Image Synthesis

Multi-modal medical image synthesis is pivotal for alleviating clinical data scarcity, yet existing methods fail to reconcile global anatomical consistency with high-fidelity local detail. We propose FermatSyn, which addresses three persistent limitations: (1) SAM2-based Prior Encoder that injects domain-aware anatomical knowledge via LoRA$^{+}$ efficient fine-tuning of a frozen SAM2 Vision Transformer; (2) Hierarchical Residual Downsampling Module (HRDM) coupled with a Cross-scale Integration Network (CIN) that preserves high-frequency lesion details and adaptively fuses global--local representations; and (3) continuity constrained Fermat Spiral Scanning strategy within a Bidirectional Fermat Scan Mamba (BFS-Mamba), constructing an approximately isotropic receptive field that substantially reduces the directional bias of raster or spiral serialization. Experiments on SynthRAD2023, BraTS2019, BraTS-MEN, and BraTS-MET show FermatSyn surpasses state-of-the-art methods in PSNR, SSIM, FID, and 3D structural consistency. Downstream segmentation on synthesized images yields no significant difference from real-image training ($p{>}0.05$), confirming clinical utility. Code is available at https://github.com/exsinger-hub/ FermatSyn.

eess.IV↗
arXiv2026

Decoding Motion-Blurred QR Codes: Motion-Parameter Error Tolerance and Model-Based Recovery

Quick Response (QR) code deblurring must ultimately recover the encoded payload, yet how accurately the underlying camera motion must be estimated remains an open question. To address this question, we formulate motion-blurred QR recovery within a unified mathematical framework of identifiability and systematically measure the decoding tolerance to perturbations in motion length, direction, rotation or scaling centre, and speed profile. These controlled experiments reveal three structural laws: 1) parameter tolerances shrink rapidly as blur amplitude grows and are tightest under uniform speed, whereas accelerating motion is substantially more forgiving; 2) length tolerance can differ markedly between underestimation and overestimation; 3) errors that are individually benign interact strongly and prevent decoding when combined. Guided by these findings, we propose a grey-box recovery pipeline in which two compact networks predict an initial corner trajectory, followed by tolerance-guided candidate search, alternating image-and-path fitting, and regularised linear inversion. On a new benchmark of 955 handheld motion-blurred photographs captured across four phone models and four motion categories, our method recovers the exact payload on 93.1% of the images, outperforming the strongest fine-tuned deblurring network at 83.6% and reducing the decoding error rate by 58.0%.

eess.IV↗
arXiv2026

Accuracy and efficiency of compact foundation models for surface-water mapping during floods

Pretrained Earth observation models may reduce the effort needed to map surface water, but their value depends on the alternative against which they are compared. We evaluated Prithvi-EO-2.0-Tiny using the 446 hand-labeled Sentinel-2 chips from 11 flood events in Sen1Floods11. A fine-tuned model, a frozen-encoder model, and an identical randomly initialized architecture were compared with a similarly sized U-Net, a larger Prithvi model, and spectral-index thresholds. Experiments varied the number of training chips, excluded events from model fitting, and measured computational cost and prediction reliability. With 252 training chips, U-Net achieved a water intersection-over-union (IoU) of 0.856 on the official test set, compared with 0.833 for fine-tuned Prithvi-Tiny. Pretraining improved the tiny transformer over random initialization by a reported 0.046 IoU with 25 training chips and 0.023 with 252 chips, but did not reverse the U-Net ranking. Across 11 event-exclusion evaluations, mean IoU was 0.768 for fine-tuned Prithvi-Tiny and 0.777 for U-Net; the paired interval included zero. Fine-tuned Prithvi-Tiny processed a 512x512-pixel chip in 16.1 ms on a GPU and 258 ms on a laptop CPU, compared with 30.6 and 665 ms for U-Net. Errors were concentrated near water boundaries, and high predictive entropy identified many, but not all, erroneous pixels. These results support a specific role for compact pretrained models: lower measured computational demand with competitive accuracy, rather than consistent superiority. Event-dependent performance, shared hyperparameter selection, and the distinction between observed water and newly inundated land delimit the conclusions.

eess.IV↗