arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2212.12218

Fast Event-based Optical Flow Estimation by Triplet Matching

Shintaro Shiba·Yoshimitsu Aoki·Guillermo Gallego
View original source ↗Read source document ↗Export metadata ↓

Abstract

Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy, while event-by-event (incremental) methods have strong assumptions and have not been tested on common benchmarks that quantify progress in the field. Towards applications on resource-constrained devices, it is important to develop optical flow algorithms that are fast, light-weight and accurate. This work leverages insights from neuroscience, and proposes a novel optical flow estimation scheme based on triplet matching. The experiments on publicly available benchmarks demonstrate its capability to handle complex scenes with comparable results as prior packet-based algorithms. In addition, the proposed method achieves the fastest execution time (> 10 kHz) on standard CPUs as it requires only three events in estimation. We hope that our research opens the door to real-time, incremental motion estimation methods and applications in real-world scenarios.

Explore related subjects

cs.CVcs.ROeess.SP

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Shintaro Shiba, Yoshimitsu Aoki, Guillermo Gallego. 2022-12-23. Fast Event-based Optical Flow Estimation by Triplet Matching. https://doi.org/10.1109/lsp.2023.3234800

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion

Estimating the 6D pose and 3D size of an object from visual data is a fundamental task in computer vision. Although single-view geometry is a deeply established domain, contemporary category-level methods frequently rely on rigid prerequisites such as precise object models, ground truth depth, or multi-modal LiDAR integration to achieve robust results. In this work, we introduce a unified generative framework that addresses both single-view category-level pose estimation and temporal sequence tracking using only RGB input. Our method leverages score-based diffusion models to generate a rich multi-hypothesis pose distribution, inherently capturing spatial and geometric uncertainties. While existing diffusion-based estimators typically rely on computationally expensive likelihood models to prune outliers, we propose an efficient alternative utilising Mean Shift to directly isolate the distribution's mode as the final pose estimate. Our approach establishes a new state-of-the-art baseline on the challenging REAL275 benchmark among two-stage, crop-based estimators. Furthermore, by decoupling object detection from pose estimation, our generative framework explicitly avoids the catastrophic domain overfitting inherent to end-to-end single-stage detectors, achieving highly robust zero-shot generalisation on the unseen Wild6D dataset. Finally, we demonstrate that the iterative nature of our score-based sampler enables a seamless transition to video sequences by preserving and propagating the multi-hypothesis distribution across time as a coherent temporal prior.

cs.CV↗
arXiv2026

A Unified Hierarchical Framework for Fine-grained Cross-view Geo-localization over Large-scale Scenarios

Cross-view geo-localization is a promising solution for large-scale localization problems, requiring the sequential execution of retrieval and metric localization tasks to achieve fine?grained predictions. However, existing methods typically focus on designing standalone models for these two tasks, resulting in inefficient collaboration and increased training overhead. In this paper, we propose UnifyGeo, a novel unified hierarchical geo-localization framework that integrates retrieval and metric localization tasks into a single network. Specifically, we first em?ploy a unified learning strategy to jointly learn multi-granularity representations, establishing task associations between retrieval and metric localization. Subsequently, we design a re-ranking mechanism guided by a dedicated loss function, which enhances geo-localization performance by improving both retrieval accuracy and metric localization references. Extensive experiments demonstrate that UnifyGeo significantly outperforms state-of-the?art methods in both task-isolated and task-associated settings. On the challenging VIGOR benchmark, UnifyGeo achieves 39.64% and 25.58% 1-meter-level localization recall under same-area and cross-area evaluations, respectively, demonstrating strong fine?grained localization capability in large-scale scenarios. Code will be available at https://github.com/chord-sz/UnifyGeo.

cs.CV↗
arXiv2026

CineScale: Tuning-Free High-Resolution Video Generation

Video diffusion models have achieved remarkable progress in recent years, yet generating high-resolution videos remain a fundamental challenge. Most video generators are trained at limited spatial resolutions due to the scarcity of high-resolution 4K video data and the prohibitive computational cost of large-scale training on such data. Most video diffusion models are trained on 720p videos and are therefore effectively limited to generating videos at similar resolutions during inference. To address this gap, we propose CineScale. CineScale, to the best of our knowledge, is the first tuning-free inference framework enabling pretrained video diffusion models to generate high-quality videos at resolutions far beyond those seen during training. Our key observation is that generation quality degrades at higher resolutions because positional encodings shift beyond their training distribution, producing blurred details and structurally incoherent videos. To address this gap, we introduce Adaptively Rectified RoPE. Our extensive experiments show that CineScale enables pretrained diffusion models, despite never being trained on high-resolution data, to generate high-fidelity 4K video without any fine-tuning, improving local detail and sharpness while preserving temporal coherence. This demonstrates that high-resolution generation capabilities can be unlocked purely at inference time.

cs.CV↗