arXiv subjects

Wei-Teng Chu

Publications and source records attributed to Wei-Teng Chu.

3 recordsLinked to original sources

arXiv2026

Reliability-Aware Monocular Depth Supervision for Sparse-View Neural Reconstruction

Sparse-view neural reconstruction in outdoor driving is challenging due to narrow forward-facing trajectories and limited multi-view overlap, and monocular depth priors, though dense, are noisy and not uniformly reliable. We use Depth Anything V2 (DA-V2) as a dense monocular depth prior, align its per-image scale and shift to metric depth using sparse anchors (LiDAR and COLMAP) and apply depth supervision selectively through photometric masks generated from an RGB-only baseline model, and evaluate on Mip-NeRF-360 and Splatfacto. On KITTISeq02, masked depth supervision gives only marginal gains for Mip-NeRF-360 and does not improve geometry. In contrast, Splatfacto benefits clearly, improving PSNR from 14.903 to 15.932 and reducing RMSE from 0.542 to 0.100. Against global supervision, the proposed mask achieves 0.44-0.70,dB PSNR gains across KITTI sequences 00/02/05 at tied or better RMSE, while yielding no change on Mip-NeRF-360. This indicates the mask primarily enhances rendering fidelity rather than geometry. Matched-ratio ablations and two further KITTI fragments confirm the gains come from selecting reliable low-error regions, rather than from fewer pixels. On the Bicycle scene, depth supervision improves geometry but hurts RGB rendering quality when multi-view coverage is already strong. Using DA-V2 as a representative prior, results suggest that monocular depth priors are valuable for under-constrained sparse-view reconstruction when applied selectively with moderate weighting.

cs.CV↗

arXiv2026

SimFoundry: Modular and Automated Scene Generation for Policy Learning and Evaluation

Training and evaluating robot policies in the real world is costly and difficult to scale. We introduce SimFoundry, a modular and automated system for zero-shot real-to-sim scene construction from a video. SimFoundry generates sim-ready digital twins and supports object, scene, and task editing, enabling the automated generation of diverse digital cousins: affordance-preserving variations of reconstructed real-world scenes. Policies trained on SimFoundry data transfer zero-shot to challenging real tasks involving multi-step manipulation, articulated object interaction, and bimanual interaction, and its digital cousins (variations of the original scene, objects, and tasks) facilitate generalization to new real-world conditions. Across 7 manipulation tasks and 5 policy architectures, SimFoundry simulation evaluations strongly predict real-world performance, with mean Pearson correlation 0.911 and mean maximum ranking violation 0.018. When evaluating sim-trained policies zero-shot in the real world, policies trained with object, scene, and task cousins in simulation show average task success rate improvements of 17%, 21%, and 40%, respectively. Additional details at https://research.nvidia.com/labs/gear/simfoundry/ .

cs.RO↗

arXiv2026

Efficient Construction of Implicit Surface Models From a Single Image for Motion Generation

Implicit representations have been widely applied in robotics for obstacle avoidance and path planning. In this paper, we explore the problem of constructing an implicit distance representation from a single image. Past methods for implicit surface reconstruction, such as NeuS and its variants generally require a large set of multi-view images as input, and require long training times. In this work, we propose Fast Image-to-Neural Surface (FINS), a lightweight framework that can reconstruct high-fidelity surfaces and SDF fields based on a single or a small set of images. FINS integrates a multi-resolution hash grid encoder with lightweight geometry and color heads, making the training via an approximate second-order optimizer highly efficient and capable of converging within a few seconds. Additionally, we achieve the construction of a neural surface requiring only a single RGB image, by leveraging pre-trained foundation models to estimate the geometry inherent in the image. Our experiments demonstrate that under the same conditions, our method outperforms state-of-the-art baselines in both convergence speed and accuracy on surface reconstruction and SDF field estimation. Moreover, we demonstrate the applicability of FINS for robot surface following tasks and show its scalability to a variety of benchmark datasets. Code is publicly available at https://github.com/waynechu1109/FINS.

cs.RO↗