arXiv subjects

Fudong Ge

Publications and source records attributed to Fudong Ge.

13 recordsLinked to original sources

arXiv2026

SurroundNEXO: Ego-Centric Metric Bridging for Spatially Consistent Geometry in Autonomous Driving

Modern autonomous driving depends on accurate metric 3D understanding for perception, reconstruction, and planning, which in turn requires reliable multi-camera depth prediction. However, the outward-facing nature of vehicle-mounted surround-view camera rigs inherently limits visual overlap across views, challenging the correspondence-based assumptions that underpin conventional multi-view geometry. To bridge this gap, we present SurroundNEXO, named after the Spanish word nexo for a geometric link, a low-overlap multi-camera metric depth framework that grounds cross-view reasoning in ego-centric geometry rather than dense visual correspondences. Instead of directly enforcing early global fusion, SurroundNEXO first assigns image tokens globally comparable ego-frame viewing directions through Ego-Ray Positional Encoding, then uses sparse LiDAR measurements as metric anchors to propagate absolute scale cues, and finally expands feature interaction progressively from view-local modeling to decomposed spatio-temporal reasoning and global integration. This design enables metric-scale depth prediction with improved spatial consistency across weakly overlapping cameras. Across low-overlap autonomous driving benchmarks, including NuScenes, Waymo and DDAD, SurroundNEXO reduces single-view error by 33.2%, improves cross-view consistency by 10.5%, and enhances metric reconstruction quality by 25.6% compared with SOTA methods. It further remains robust under extremely sparse depth prompts and exhibits strong zero-shot generalization to unseen camera layouts.

cs.CV↗

arXiv2026

OneDrive: Unified Multi-Paradigm Driving with Vision-Language-Action Models

Vision-Language Models(VLMs) excel at autoregressive text generation, yet end-to-end autonomous driving requires multi-task learning with structured outputs and heterogeneous decoding behaviors, such as autoregressive language generation, parallel object detection and trajectory regression. To accommodate these differences, existing systems typically introduce separate or cascaded decoders, resulting in architectural fragmentation and limited backbone reuse. In this work, we present a unified autonomous driving framework built upon a pretrained VLM, where heterogeneous decoding behaviors are reconciled within a single transformer decoder. We demonstrate that pretrained VLM attention exhibits strong transferability beyond pure language modeling. By organizing visual and structured query tokens within a single causal decoder, structured queries can naturally condition on visual context through the original attention mechanism. Textual and structured outputs share a common attention backbone, enabling stable joint optimization across heterogeneous tasks. Trajectory planning is realized within the same causal LLM decoder by introducing structured trajectory queries. This unified formulation enables planning to share the pretrained attention backbone with images and perception tokens. Extensive experiments on end-to-end autonomous driving benchmarks demonstrate state-of-the-art performance, including 0.28 L2 and 0.18 collision rate on nuScenes open-loop evaluation and competitive results (86.8 PDMS) on NAVSIM closed-loop evaluation. The full model preserves multi-modal generation capability, while an efficient inference mode achieves approximately 40% lower latency. Code and models are available at https://github.com/Z1zyw/OneDrive

cs.CV↗

arXiv2026

MI-DETR: A Strong Baseline for Moving Infrared Small Target Detection with Bio-Inspired Motion Integration

Infrared small target detection (ISTD) is challenging because tiny, low-contrast targets are easily obscured by complex and dynamic backgrounds. Conventional multi-frame approaches typically learn motion implicitly through deep neural networks, often requiring additional motion supervision or explicit alignment modules. We propose Motion Integration DETR (MI-DETR), a bio-inspired dual-pathway detector that processes one infrared frame per time step while explicitly modeling motion. First, a retina-inspired cellular automaton (RCA) converts raw frame sequences into a motion map defined on the same pixel grid as the appearance image, enabling parvocellular-like appearance and magnocellular-like motion pathways to be supervised by a single set of bounding boxes without extra motion labels or alignment operations. Second, a Parvocellular-Magnocellular Interconnection (PMI) Block facilitates bidirectional feature interaction between the two pathways, providing a biologically motivated intermediate interconnection mechanism. Finally, a RT-DETR decoder operates on features from the two pathways to produce detection results. Surprisingly, our proposed simple yet effective approach yields strong performance on three commonly used ISTD benchmarks. MI-DETR achieves 70.3% mAP@50 and 72.7% F1 on IRDST-H (+26.35 mAP@50 over the best multi-frame baseline), 98.0% mAP@50 on DAUB-R, and 88.3% mAP@50 on ITSDT-15K, demonstrating the effectiveness of biologically inspired motion-appearance integration. Code is available at https://github.com/nliu-25/MI-DETR.

cs.CV↗

arXiv2026

Integrating Diverse Assignment Strategies into DETRs

Label assignment is a critical component in object detectors, particularly within DETR-style frameworks where the one-to-one matching strategy, despite its end-to-end elegance, suffers from slow convergence due to sparse supervision. While recent works have explored one-to-many assignments to enrich supervisory signals, they often introduce complex, architecture-specific modifications and typically focus on a single auxiliary strategy, lacking a unified and scalable design. In this paper, we first systematically investigate the effects of ``one-to-many'' supervision and reveal a surprising insight that performance gains are driven not by the sheer quantity of supervision, but by the diversity of the assignment strategies employed. This finding suggests that a more elegant, parameter-efficient approach is attainable. Building on this insight, we propose LoRA-DETR, a flexible and lightweight framework that seamlessly integrates diverse assignment strategies into any DETR-style detector. Our method augments the primary network with multiple Low-Rank Adaptation (LoRA) branches during training, each instantiating a different one-to-many assignment rule. These branches act as auxiliary modules that inject rich, varied supervisory gradients into the main model and are discarded during inference, thus incurring no additional computational cost. This design promotes robust joint optimization while maintaining the architectural simplicity of the original detector. Extensive experiments on different baselines validate the effectiveness of our approach. Our work presents a new paradigm for enhancing detectors, demonstrating that diverse ``one-to-many'' supervision can be integrated to achieve state-of-the-art results without compromising model elegance.

cs.CV↗

arXiv2024

VQ-Map: Bird's-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantization

Bird's-eye-view (BEV) map layout estimation requires an accurate and full understanding of the semantics for the environmental elements around the ego car to make the results coherent and realistic. Due to the challenges posed by occlusion, unfavourable imaging conditions and low resolution, \emph{generating} the BEV semantic maps corresponding to corrupted or invalid areas in the perspective view (PV) is appealing very recently. \emph{The question is how to align the PV features with the generative models to facilitate the map estimation}. In this paper, we propose to utilize a generative model similar to the Vector Quantized-Variational AutoEncoder (VQ-VAE) to acquire prior knowledge for the high-level BEV semantics in the tokenized discrete space. Thanks to the obtained BEV tokens accompanied with a codebook embedding encapsulating the semantics for different BEV elements in the groundtruth maps, we are able to directly align the sparse backbone image features with the obtained BEV tokens from the discrete representation learning based on a specialized token decoder module, and finally generate high-quality BEV maps with the BEV codebook embedding serving as a bridge between PV and BEV. We evaluate the BEV map layout estimation performance of our model, termed VQ-Map, on both the nuScenes and Argoverse benchmarks, achieving 62.2/47.6 mean IoU for surround-view/monocular evaluation on nuScenes, as well as 73.4 IoU for monocular evaluation on Argoverse, which all set a new record for this map layout estimation task. The code and models are available on \url{https://github.com/Z1zyw/VQ-Map}.

cs.CV↗

arXiv2024

BEV$^2$PR: BEV-Enhanced Visual Place Recognition with Structural Cues

In this paper, we propose a new image-based visual place recognition (VPR) framework by exploiting the structural cues in bird's-eye view (BEV) from a single monocular camera. The motivation arises from two key observations about place recognition methods based on both appearance and structure: 1) For the methods relying on LiDAR sensors, the integration of LiDAR in robotic systems has led to increased expenses, while the alignment of data between different sensors is also a major challenge. 2) Other image-/camera-based methods, involving integrating RGB images and their derived variants (eg, pseudo depth images, pseudo 3D point clouds), exhibit several limitations, such as the failure to effectively exploit the explicit spatial relationships between different objects. To tackle the above issues, we design a new BEV-enhanced VPR framework, namely BEV$^2$PR, generating a composite descriptor with both visual cues and spatial awareness based on a single camera. The key points lie in: 1) We use BEV features as an explicit source of structural knowledge in constructing global features. 2) The lower layers of the pre-trained backbone from BEV generation are shared for visual and structural streams in VPR, facilitating the learning of fine-grained local features in the visual stream. 3) The complementary visual and structural features can jointly enhance VPR performance. Our BEV$^2$PR framework enables consistent performance improvements over several popular aggregation modules for RGB global features. The experiments on our collected VPR-NuScenes dataset demonstrate an absolute gain of 2.47% on Recall@1 for the strong Conv-AP baseline to achieve the best performance in our setting, and notably, a 18.06% gain on the hard set. The code and dataset will be available at https://github.com/FudongGe/BEV2PR.

cs.CV↗

arXiv2021

Optimal Regional Tracking Control of Time-Fractional Diffusion Systems

In this paper, we aim to explore optimal regional trajectory tracking control problems of the anomalous subdiffusion processes governed by time-fractional diffusion systems under the Neumann boundary conditions. Using eigenvalue theory of the system operator and the semigroup theory, we explore the existence and some estimates of the mild solution to the considered system. An approach on finding solution to the optimal problem that minimizes the regional trajectory tracking error and the corresponding control cost over a finite space and time domain is then explored via the Hilbert uniqueness method (HUM). The obtained results not only can be directly used to investigate the systems that are not controllable on the whole domain, but also yield an explicit expression of the control signal in terms of the desired trajectory. Most importantly, it is worth noting that our results in this paper are still novel even for the special case when the order of fractional derivative is equal to one. Finally, we provide a numerical example to illustrate our theoretical results.

math.OC↗

arXiv2019

Regional gradient controllability of ultra-slow diffusions involving the Hadamard-Caputo time fractional derivative

This paper investigates the regional gradient controllability for ultra-slow diffusion processes governed by the time fractional diffusion systems with a Hadamard-Caputo time fractional derivative. Some necessary and sufficient conditions on regional gradient exact and approximate controllability are first given and proved in detail. Secondly, we propose an approach on how to calculate the minimum number of $\omega-$strategic actuators. Moreover, the existence, uniqueness and the concrete form of the optimal controller for the system under consideration are presented by employing the Hilbert Uniqueness Method (HUM) among all the admissible ones. Finally, we illustrate our results by an interesting example.

math.OC↗

arXiv2016

On the regional gradient observability of time fractional diffusion processes

This paper for the first time addresses the concepts of regional gradient observability for the Riemann-Liouville time fractional order diffusion system in an interested subregion of the whole domain without the knowledge of the initial vector and its gradient. The Riemann-Liouville time fractional order diffusion system which replaces the first order time derivative of normal diffusion system by a Riemann-Liouville time fractional order derivative of order $\alpha\in (0,1]$ is used to well characterize those anomalous sub-diffusion processes. The characterizations of the strategic sensors when the system under consideration is regional gradient observability are explored. We then describe an approach leading to the reconstruction of the initial gradient in the considered subregion with zero residual gradient vector. At last, to illustrate the effectiveness of our results, we present several application examples where the sensors are zone, pointwise or filament ones.

math.OC↗

arXiv2016

Regional controllability analysis of fractional diffusion equations with Riemann-Liouville time fractional derivatives

This paper is concerned with the concepts of regional controllability for the Riemann-Liouville time fractional diffusion systems of order $\alpha\in(0,1)$. The characterizations of strategic actuators to achieve regional controllability are investigated when the control inputs emerge in the differential equations as distributed inputs. In the end, an approach to guarantee the regional controllability of the problems under consideration in the considered subregion with minimum energy control is described and successfully tested through two applications.

math.OC↗

arXiv2016

Regional boundary controllability of time fractional diffusion processes

In this paper, we are concerned with the regional boundary controllability of the Riemann-Liouville time fractional diffusion systems of order $\alpha\in (0,1]$. The characterizations of strategic actuators are established when the systems studied are regionally boundary controllable. The determination of control to achieve regional boundary controllability with minimum energy is explored. We also show a connection between the regional internal controllability and regional boundary controllability. Several useful results for the optimal control from an implementation point of view are presented in the end.

math.OC↗

arXiv2015

Cyber-Physical Systems as General Distributed Parameter Systems: Three Types of Fractional Order Models and Emerging Research Opportunities

Cyber-physical systems (CPSs) are man-made complex systems coupled with natural processes that, as a whole, should be described by distributed parameter systems (DPSs) in general forms. This paper presents three such general models for generalized DPSs that can be used to characterize complex CPSs. These three different types of fractional operators based DPS models are: fractional Laplacian operator, fractional power of operator or fractional derivative. This research investigation is motivated by many fractional order models describing natural, physical, and anomalous phenomena, such as sub-diffusion process or super-diffusion process. The relationships among these three different operators are explored and explained. Several potential future research opportunities are then articulated followed by some conclusions and remarks.

math.CA↗

arXiv2015

Regional controllability of anomalous diffusion generated by the time fractional diffusion equations

This paper is concerned with the investigation of the regional controllability of the time fractional diffusion equations. First, some preliminaries and definitions of regional controllability of the system under consideration are introduced, which promote the existence contributions on controllability analysis. Then we analyze the regional controllability with minimum energy of the time fractional diffusion equations on two cases: $B\in \mathbf{L}\left(\mathbf{R}^m, L^2(\Omega) \right)$ and $B\notin \mathbf{L}\left(\mathbf{R}^m, L^2(\Omega) \right)$. In the end, two applications are given to illustrate our obtained results.

math.OC↗