arXiv Science⌕ Search

arXiv subjects

Lucas Hoefs

Publications and source records attributed to Lucas Hoefs.

3 recordsLinked to original sources

SAM-VTP: Video Memory and Measured Geometry for Continuous Traversability Segmentation

Traversability prediction is a core component of autonomous navigation, yet most vision-based methods operate frame-wise and produce temporally inconsistent predictions. We present SAM-VTP (Video Traversability Prediction), which fine-tunes SAM2's video memory pathway for dense, prompt-free traversability segmentation, conditioning each frame on a persistent memory of prior observations. Rather than inferring terrain geometry from appearance, we measure it: slope, roughness and height are computed from depth and fused into the image features. We also introduce an offline continuous supervision pipeline that generates dense per-pixel traversability targets in [0,1] from depth-derived geometry and semantic priors, requiring no robot deployment and no per-pixel annotation, capturing conditional feasibility that binary labels cannot represent. On TartanGround, a large-scale synthetic ground-robot dataset, SAM-VTP improves fuzzy Jaccard from 0.908 to 0.924 and binary IoU from 0.854 to 0.886 over SAM-TP, a frame-wise SAM2 baseline, against a seed-to-seed spread below 0.001, and cuts frame-to-frame flicker by 31%. In closed-loop trials at two field sites, driving the same planner and controller, the baseline's dropouts leave the planner without a feasible path 3.3x more often on a paved course and 6.9x on rough ground, while SAM-VTP runs at 21.4 FPS on the Orin Nano the robot carries.

cs.RO↗

Deep Learning VLBI Image Reconstruction with Closure Invariants

Interferometric closure invariants, constructed from triangular loops of mixed Fourier components, capture calibration-independent information on source morphology. While a complete set of closure invariants is directly obtainable from measured visibilities, the inverse transformation from closure invariants to the source intensity distribution is not established. In this work, we demonstrate a deep learning approach, Deep learning Image Reconstruction with Closure Terms (DIReCT), to directly reconstruct the image from closure invariants. Trained on both well-defined mathematical shapes (two-dimensional gaussians, disks, ellipses, $m$-rings) and natural images (CIFAR-10), the results from our specially designed model are insensitive to station-based corruptions and thermal noise. The median fidelity score between the reconstruction and the blurred ground truth achieved is $\gtrsim 0.9$ even for untrained morphologies, where a unit score denotes perfect reconstruction. In our validation tests, DIReCT's results are comparable to other state-of-the-art deconvolution and regularised maximum-likelihood image reconstruction algorithms, with the advantage that DIReCT does not require hand-tuned hyperparameters for each individual prediction. This independent approach shows promising results and offers a calibration-independent constraint on source morphology, ultimately complementing and improving the reliability of sparse VLBI imaging results.

astro-ph.IM↗

Interferometric Image Reconstruction using Closure Invariants and Machine Learning

Interferometric closure invariants encode calibration-independent details of an object's morphology. Excepting simple cases, a direct backward transformation from closure invariants to morphologies is not well established. We demonstrate using simple Machine Learning models that closure invariants can aid in morphological classification and parameter estimation. We consider six phenomenologically parametrised morphologies: point-like, uniform circular disc, crescent, dual disc, crescent with elliptical accretion disc, and crescent with double jet lobes. Using logistic regression (LR), multi-layer perceptron (MLP), and random forest models on closure invariants obtained from a sparsely covered aperture, we find that all methods except LR can classify morphologies with $\gtrsim$80% accuracy, which improves with greater aperture coverage. Separately from the classification problem, given an independently confirmed class, we estimate parameters of uniform circular disc, crescent, and dual disc morphologies using simple MLP models, and parametrically reconstruct images. The estimated parameters and images correspond well with inputs, but the accuracy worsens when degeneracies between parameters are present. This independent approach to interferometric imaging under challenging observing conditions such as that faced by the Event Horizon Telescope and Very Long Baseline Interferometry in general can complement other methods in robustly constraining an object's morphology.

astro-ph.IM↗