arXiv ScienceSearch

arXiv subjects

Cyrille Migniot

Publications and source records attributed to Cyrille Migniot.

4 recordsLinked to original sources

Refining Ground Truth Poses in Autonomous Driving Datasets via Neural Rendering

Public autonomous driving datasets underpin the training and benchmarking of perception, mapping, and localization algorithms, yet residual inaccuracies in sensor calibration and ego-poses can silently degrade both model performance and evaluation reliability. We introduce MOISST++, a Neural Radiance Field (NeRF)-based pipeline that jointly refines extrinsic sensor calibration and continuous-time ego-trajectories at dataset scale. The method optimizes shared rig parameters across multiple subsequences and corrects per-subsequence trajectories via a learned continuous-time correction, going beyond prior work that targets individual scenes. We validate pose improvements without ground truth through a complementary evaluation suite combining Structure from Motion (SfM) triangulation, novel view synthesis, and multi-modal geometric consistency metrics, verify their coherence via cross-metric agreement, and confirm their sensitivity through a controlled-perturbation study with known injected errors. Applied to four major datasets (KITTI-360, nuScenes, PandaSet, and Waymo), MOISST++ yields statistically significant improvements on most metrics on nuScenes, PandaSet and Waymo, and marginal, within-noise changes on the already well-calibrated KITTI-360. We publicly release the optimized poses and calibration parameters, together with our evaluation code, to support more reliable research and benchmarking.

cs.CV

3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration

Reliable multimodal sensor fusion algorithms require accurate spatiotemporal calibration. Recently, targetless calibration techniques based on implicit neural representations have proven to provide precise and robust results. Nevertheless, such methods are inherently slow to train given the high computational overhead caused by the large number of sampled points required for volume rendering. With the recent introduction of 3D Gaussian Splatting as a faster alternative to implicit representation methods, we propose to leverage this new rendering approach to achieve faster multi-sensor calibration. We introduce 3DGS-Calib, a new calibration method that relies on the speed and rendering accuracy of 3D Gaussian Splatting to achieve multimodal spatiotemporal calibration that is accurate, robust, and with a substantial speed-up compared to methods relying on implicit neural representations. We demonstrate the superiority of our proposal with experimental results on sequences from KITTI-360, a widely used driving dataset.

cs.CV

SOAC: Spatio-Temporal Overlap-Aware Multi-Sensor Calibration using Neural Radiance Fields

In rapidly-evolving domains such as autonomous driving, the use of multiple sensors with different modalities is crucial to ensure high operational precision and stability. To correctly exploit the provided information by each sensor in a single common frame, it is essential for these sensors to be accurately calibrated. In this paper, we leverage the ability of Neural Radiance Fields (NeRF) to represent different sensors modalities in a common volumetric representation to achieve robust and accurate spatio-temporal sensor calibration. By designing a partitioning approach based on the visible part of the scene for each sensor, we formulate the calibration problem using only the overlapping areas. This strategy results in a more robust and accurate calibration that is less prone to failure. We demonstrate that our approach works on outdoor urban scenes by validating it on multiple established driving datasets. Results show that our method is able to get better accuracy and robustness compared to existing methods.

cs.CV

MOISST: Multimodal Optimization of Implicit Scene for SpatioTemporal calibration

With the recent advances in autonomous driving and the decreasing cost of LiDARs, the use of multimodal sensor systems is on the rise. However, in order to make use of the information provided by a variety of complimentary sensors, it is necessary to accurately calibrate them. We take advantage of recent advances in computer graphics and implicit volumetric scene representation to tackle the problem of multi-sensor spatial and temporal calibration. Thanks to a new formulation of the Neural Radiance Field (NeRF) optimization, we are able to jointly optimize calibration parameters along with scene representation based on radiometric and geometric measurements. Our method enables accurate and robust calibration from data captured in uncontrolled and unstructured urban environments, making our solution more scalable than existing calibration solutions. We demonstrate the accuracy and robustness of our method in urban scenes typically encountered in autonomous driving scenarios.

cs.CV