arXiv Science⌕ Search

arXiv · 2609.28775

Physics-Guided Multi-Objective Deep Learning for Ultrasound RF Data Interpolation in Resource-Constrained Imaging

Abstract

Ultrasound imaging increasingly targets portable, point-of-care, and wearable settings where constraints on power, bandwidth, and hardware complexity often necessitate sparse data acquisition in spatiotemporal scanning. However, image reconstruction using the sparse data can introduce insufficient phase information in coherent beamforming process, resulting in grating-lobe artifacts that degrade imaging contrast resolution. We present a physics-guided, data-driven framework for sparse-to-dense radio-frequency (RF) reconstruction that aligns training with downstream image formation. Our approach trains an end-to-end interpolation network using a hybrid supervision scheme that combines an RF-domain and a beamforming-domain loss with exponential moving average (EMA) to stabilize the multi-objective training. To improve generalization under variable acquisition layouts, we also introduce a random-skip masking strategy that varies sparsity patterns during training so a single model can handle diverse decimation factors and irregular channel configurations. We evaluate the framework on a held-out test set using the mean structural similarity index measure (SSIM) between reconstructed and ground-truth beamformed images. Across decimation factors $\times 2$ to $\times 13$, the best-performing configuration maintains mean SSIM around 0.95. Overall, the results show consistent gains in RF reconstruction and post-beamforming image quality across diverse acquisition conditions. This approach enables robust, high-quality ultrasound imaging at resource-constrained settings by allowing more sparse scanning in spatiotemporal domain.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Luoyuan Zhang, Yiyang You, Ananya Tandri, Yinan Feng, Hyunwoo Song, Jeeun Kang, Youzuo Lin. 2026-09-23. Physics-Guided Multi-Objective Deep Learning for Ultrasound RF Data Interpolation in Resource-Constrained Imaging. https://arxiv.org/abs/2609.28775

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Cyst-X: A Multicenter MRI Benchmark for Pancreatic Cyst Risk Stratification and Cross-Institutional AI

Intraductal papillary mucinous neoplasms (IPMNs) are pancreatic cancer precursors, and guideline-based risk stratification both over-treats indolent lesions and misses progression. We present Cyst-X, a public benchmark of 1,461 T1-weighted (T1W) and T2-weighted (T2W) MRI volumes from 764 patients at seven centers, with expert pancreas masks, risk labels, splits and reference AI risk-prediction models. PanSegNet segmented the pancreas with Dice of 86.34% (T1W) and 89.26% (T2W) on held-out centers. For the primary task, high-risk versus low-risk IPMN, a 3D DenseNet-121 achieved cross-validated AUCs of 74.59% and 73.45%; complementary broad binary and three-class tasks reached 78.67--81.28% and 73.47--75.76%. Because patient images often cannot be pooled across institutions, we also simulated federated learning across the seven centers. On T2W MRI, FedProx was similar to centralized training in center-averaged external AUC (71.00% versus 71.18%) but not in pooled AUC (62.35% versus 77.49%). Radiologist comparisons showed cohort-dependent sensitivity--specificity tradeoffs. Cyst-X supports reproducible method development and identifies within-IPMN risk discrimination and cross-center score comparability as open challenges.

eess.IV↗

Beyond Visibility: Real-Time Surface Accessibility Fields from Sparse LiDAR

Understanding which surfaces a given tool can physically access is fundamental to robotic interaction, yet 3D perception typically stops at geometric reconstruction or visibility estimation. Visibility does not imply accessibility: a visible point may still be blocked by tool geometry or approach-corridor clearance. We propose the Accessibility Field: a per-point surface accessibility labelling, computed from streaming sparse LiDAR and updated at sensor rate as the platform moves. Our GPU-based method evaluates surface points against precomputed tool-geometry kernels across rotated approach orientations, underpinned by a scan-centric TSDF integration scheme suited to non-repetitive sensors such as the Livox Mid-360. The system is tool-agnostic, requires no prior scene model, and runs in real time on both workstation and Jetson Orin edge hardware. On synthetic primitives, our method achieves F1=90.8%, against 69.8% for a Hidden Point Removal baseline; ablations within our own pipeline give 81.5% replacing the TSDF query with a point-cloud collision check, and 33.9% replacing scan-centric integration with projective, nvblox-style integration. On a mature synthetic Pinus radiata model, the method labels 56.8% of visible pine branch surfaces as physically inaccessible.

eess.IV↗

Forecasting Brain Tracer Distribution from Pre-Contrast MRI: A Comparison of Direct Regression and Flow Matching

The brain fluid clearance system can be studied with intrathecal contrast-enhanced magnetic resonance imaging (MRI). By injecting a tracer into the spinal canal and performing MRI over 24--48\,h, one can measure how a tracer injected into the cerebrospinal fluid spreads through the brain. As this is an invasive procedure requiring several MRI scans, we ask how much of the later tracer distribution can be predicted from the pre-contrast scan and elapsed time alone. Using 104 training patients (878 MRI volumes), we compared a direct image-to-image regression model with a more complex generative model based on conditional flow matching, and tested both on 23 held-out patients and on 51 patients from a separate cohort with idiopathic normal pressure hydrocephalus (iNPH). Relative to simply copying the pre-contrast scan, the direct model reduced the mean absolute error (intensities normalized to $[0,1]$) from 0.089 to 0.036, about 60\%, in held-out patients and from 0.075 to 0.056, about 25\%, in the iNPH cohort. The reduction held in every sampled elapsed-time interval and brain compartment, and errors remained largest at 20--30\,h and in the ventricles, where enhancement is strongest. Its predicted change maps agreed with the observed tracer enhancement rather than only reproducing anatomy. The generative model was less accurate in both cohorts. A substantial part of the later tracer distribution is therefore predictable from the patient's brain anatomy as seen on pre-contrast MRI, and the added model complexity gave no benefit at this data scale. Whether this accuracy suffices for a given clinical use remains to be established; with prospective validation, such forecasts could help simplify the MRI protocol used to assess brain clearance.

eess.IV↗