arXiv subjects

Xuefeng Zhu

Publications and source records attributed to Xuefeng Zhu.

At least 19 recordsLinked to original sources

arXiv2026

Weil positivity in compact windows: a finite reduction, certified two-sided bounds, and a Landau-Widom decay law

Weil's criterion states that the Riemann Hypothesis (RH) is equivalent to the non-negativity of an explicit quadratic form Q(f) on test functions. For f supported in [-L,L] we study the normalized infimum lambda_min(L) = inf Q(f)/||f||^2 from both sides. Lower bounds (unconditional): positivity on bounded support is classical for supp f in [-(log 2)/2,(log 2)/2] (Yoshida; Connes-Consani). We prove by certified computation that Q(f) >= 8.9e-18 ||f||^2 for all supp f in [-0.8,0.8], i.e. autocorrelation support 1.6, 2.3 times the classical range. The proof rests on a one-stroke reduction: a pointwise envelope for the Weil symbol, with a comb constant shown optimal by Weyl equidistribution, converts positivity on the whole window into positive semidefiniteness of a single finite matrix. The odd parity sector shows that the certified positivity holds for arbitrary complex test functions of support 1.6, and that the window ground state is simple and even, the spectral hypothesis required by the operator-theoretic program of Connes, Consani, Moscovici and van Suijlekom. Upper bounds (unconditional): variational bounds are evaluated on the geometric side in interval arithmetic, with no appeal to zeros or RH, down to 3.2e-283 at L=2. They follow the empirical law -ln lambda_min(L) ~ 2 pi^2 N(T*)/ln N(T*), T* = 2 pi e^{2L}, with N the zero-counting function; 2 pi^2 matches the Landau-Widom eigenvalue-plunge rate. Under RH, lambda_min(L) <= exp(-L e^L) for all large L. Synthesis: at L=0.8 the two halves enclose the profile, 8.9e-18 <= lambda_min(0.8) <= 2.27e-17, both certified. We show why the positivity route cannot reach RH unassisted: any one-stroke certificate must resolve frequencies up to 2 pi e^{A_L}, A_L ~ 4e^L, a doubly exponential threshold that no pointwise bound on the prime comb lowers, while the spectral margin collapses at the Landau-Widom rate.

math.NT↗

arXiv2026

NTIRE 2026 Challenge on Video Saliency Prediction: Methods and Results

This paper presents an overview of the NTIRE 2026 Challenge on Video Saliency Prediction. The goal of the challenge participants was to develop automatic saliency map prediction methods for the provided video sequences. The novel dataset of 2,000 diverse videos with an open license was prepared for this challenge. The fixations and corresponding saliency maps were collected using crowdsourced mouse tracking and contain viewing data from over 5,000 assessors. Evaluation was performed on a subset of 800 test videos using generally accepted quality metrics. The challenge attracted over 20 teams making submissions, and 7 teams passed the final phase with code review. All data used in this challenge is made publicly available - https://github.com/msu-video-group/NTIRE26_Saliency_Prediction.

cs.CV↗

arXiv2025

A Tri-Modal Dataset and a Baseline System for Tracking Unmanned Aerial Vehicles

With the proliferation of low altitude unmanned aerial vehicles (UAVs), visual multi-object tracking is becoming a critical security technology, demanding significant robustness even in complex environmental conditions. However, tracking UAVs using a single visual modality often fails in challenging scenarios, such as low illumination, cluttered backgrounds, and rapid motion. Although multi-modal multi-object UAV tracking is more resilient, the development of effective solutions has been hindered by the absence of dedicated public datasets. To bridge this gap, we release MM-UAV, the first large-scale benchmark for Multi-Modal UAV Tracking, integrating three key sensing modalities, e.g. RGB, infrared (IR), and event signals. The dataset spans over 30 challenging scenarios, with 1,321 synchronised multi-modal sequences, and more than 2.8 million annotated frames. Accompanying the dataset, we provide a novel multi-modal multi-UAV tracking framework, designed specifically for UAV tracking applications and serving as a baseline for future research. Our framework incorporates two key technical innovations, e.g. an offset-guided adaptive alignment module to resolve spatio mismatches across sensors, and an adaptive dynamic fusion module to balance complementary information conveyed by different modalities. Furthermore, to overcome the limitations of conventional appearance modelling in multi-object tracking, we introduce an event-enhanced association mechanism that leverages motion cues from the event modality for more reliable identity maintenance. Comprehensive experiments demonstrate that the proposed framework consistently outperforms state-of-the-art methods. To foster further research in multi-modal UAV tracking, both the dataset and source code will be made publicly available at https://xuefeng-zhu5.github.io/MM-UAV/.

cs.CV↗

arXiv2025

Omni Survey for Multimodality Analysis in Visual Object Tracking

The development of smart cities has led to the generation of massive amounts of multi-modal data in the context of a range of tasks that enable a comprehensive monitoring of the smart city infrastructure and services. This paper surveys one of the most critical tasks, multi-modal visual object tracking (MMVOT), from the perspective of multimodality analysis. Generally, MMVOT differs from single-modal tracking in four key aspects, data collection, modality alignment and annotation, model designing, and evaluation. Accordingly, we begin with an introduction to the relevant data modalities, laying the groundwork for their integration. This naturally leads to a discussion of challenges of multi-modal data collection, alignment, and annotation. Subsequently, existing MMVOT methods are categorised, based on different ways to deal with visible (RGB) and X modalities: programming the auxiliary X branch with replicated or non-replicated experimental configurations from the RGB branch. Here X can be thermal infrared (T), depth (D), event (E), near infrared (NIR), language (L), or sonar (S). The final part of the paper addresses evaluation and benchmarking. In summary, we undertake an omni survey of all aspects of multi-modal visual object tracking (VOT), covering six MMVOT tasks and featuring 338 references in total. In addition, we discuss the fundamental rhetorical question: Is multi-modal tracking always guaranteed to provide a superior solution to unimodal tracking with the help of information fusion, and if not, in what circumstances its application is beneficial. Furthermore, for the first time in this field, we analyse the distributions of the object categories in the existing MMVOT datasets, revealing their pronounced long-tail nature and a noticeable lack of animal categories when compared with RGB datasets.

cs.CV↗

arXiv2025

Serial Over Parallel: Learning Continual Unification for Multi-Modal Visual Object Tracking and Benchmarking

Unifying multiple multi-modal visual object tracking (MMVOT) tasks draws increasing attention due to the complementary nature of different modalities in building robust tracking systems. Existing practices mix all data sensor types in a single training procedure, structuring a parallel paradigm from the data-centric perspective and aiming for a global optimum on the joint distribution of the involved tasks. However, the absence of a unified benchmark where all types of data coexist forces evaluations on separated benchmarks, causing \textit{inconsistency} between training and testing, thus leading to performance \textit{degradation}. To address these issues, this work advances in two aspects: \ding{182} A unified benchmark, coined as UniBench300, is introduced to bridge the inconsistency by incorporating multiple task data, reducing inference passes from three to one and cutting time consumption by 27\%. \ding{183} The unification process is reformulated in a serial format, progressively integrating new tasks. In this way, the performance degradation can be specified as knowledge forgetting of previous tasks, which naturally aligns with the philosophy of continual learning (CL), motivating further exploration of injecting CL into the unification process. Extensive experiments conducted on two baselines and four benchmarks demonstrate the significance of UniBench300 and the superiority of CL in supporting a stable unification process. Moreover, while conducting dedicated analyses, the performance degradation is found to be negatively correlated with network capacity. Additionally, modality discrepancies contribute to varying degradation levels across tasks (RGBT > RGBD > RGBE in MMVOT), offering valuable insights for future multi-modal vision research. Source codes and the proposed benchmark is available at \textit{https://github.com/Zhangyong-Tang/UniBench300}.

cs.CV↗

arXiv2024

Dynamic Subframe Splitting and Spatio-Temporal Motion Entangled Sparse Attention for RGB-E Tracking

Event-based bionic camera asynchronously captures dynamic scenes with high temporal resolution and high dynamic range, offering potential for the integration of events and RGB under conditions of illumination degradation and fast motion. Existing RGB-E tracking methods model event characteristics utilising attention mechanism of Transformer before integrating both modalities. Nevertheless, these methods involve aggregating the event stream into a single event frame, lacking the utilisation of the temporal information inherent in the event stream.Moreover, the traditional attention mechanism is well-suited for dense semantic features, while the attention mechanism for sparse event features require revolution. In this paper, we propose a dynamic event subframe splitting strategy to split the event stream into more fine-grained event clusters, aiming to capture spatio-temporal features that contain motion cues. Based on this, we design an event-based sparse attention mechanism to enhance the interaction of event features in temporal and spatial dimensions. The experimental results indicate that our method outperforms existing state-of-the-art methods on the FE240 and COESOT datasets, providing an effective processing manner for the event data.

cs.CV↗

arXiv2024

Excellent and CO$_2$$_{0.85}$Nd$_{0.1}$Cu$_{0.05}$O$_{2-\delta}$-Nd$_x$Sr$_{1-x}$Fe$_{1-y}$Cu$_y$O$_{3-\delta}$ dual-phase oxygen transport membranes

Oxygen transport membranes(OTMs)have provided great opportunities in the last decades but are suffering from the trade-off effect between stability and oxygen permeability. Here, we report a group of new planar dual-phase mixed ionic-electronic conducting (MIEC) OTMs consisting of CO$_2$$_{0.85}$Nd$_{0.1}$Cu$_{0.05}$O$_2$ (CNCO) and Nd$_x$Sr$_{1-x}$Fe$_{1-y}$Cu$_y$O$_3$(NSFCO; $x = 0.4, 0.6$; $y = 0.05, 0.1$) phases, showing excellent oxygen permeability while comparable CO$_2$-resistant stability. The substitution of Cu as a bifunctional additive decreases the sintering temperature and enhances bulk diffusion and oxygen permeability with the co-doping of Nd.The oxygen permeation fluxes reached 2.62 and 1.52 mL min$^{-1}$ cm$^{-2}$ at 1000$^\circ$C through the optimal 60wt%Ce0.85Nd0.1Cu0.05O2-40wt%Nd0.4Sr0.6Fe0.9Cu0.1O3 (CNCO-NSFCO41) composition with He and CO$_2$ sweeping, respectively, higher than all reported dense dual-phase OTMs. Such excellent CO$_2$-tolerant permeability meets the needs of potential industrial applications. Analysis with Zhu's oxygen permeation model shows lower bulk diffusion resistance of CNCO-NSFCO41 than that of reported 60wt%Ce0.85Pr0.1Cu0.05O2-40wt%Pr0.4Sr0.6Fe0.9Cu0.1O3(CPCO-PSFCO41)and more limitation by the interfacial exchange at high temperature. All the prepared OTMs also show good long-term stability over 100 hours in both atmospheres. Our results confirm the excellent oxygen permeability and stability under a high-concentration CO2 atmosphere, providing a material candidate for CO2 capture in oxyfuel combustion.

cond-mat.mtrl-sci↗

arXiv2024

Revisiting RGBT Tracking Benchmarks from the Perspective of Modality Validity: A New Benchmark, Problem, and Solution

RGBT tracking draws increasing attention because its robustness in multi-modal warranting (MMW) scenarios, such as nighttime and adverse weather conditions, where relying on a single sensing modality fails to ensure stable tracking results. However, existing benchmarks predominantly contain videos collected in common scenarios where both RGB and thermal infrared (TIR) information are of sufficient quality. This weakens the representativeness of existing benchmarks in severe imaging conditions, leading to tracking failures in MMW scenarios. To bridge this gap, we present a new benchmark considering the modality validity, MV-RGBT, captured specifically from MMW scenarios where either RGB (extreme illumination) or TIR (thermal truncation) modality is invalid. Hence, it is further divided into two subsets according to the valid modality, offering a new compositional perspective for evaluation and providing valuable insights for future designs. Moreover, MV-RGBT is the most diverse benchmark of its kind, featuring 36 different object categories captured across 19 distinct scenes. Furthermore, considering severe imaging conditions in MMW scenarios, a new problem is posed in RGBT tracking, named `when to fuse', to stimulate the development of fusion strategies for such scenarios. To facilitate its discussion, we propose a new solution with a mixture of experts, named MoETrack, where each expert generates independent tracking results along with a confidence score. Extensive results demonstrate the significant potential of MV-RGBT in advancing RGBT tracking and elicit the conclusion that fusion is not always beneficial, especially in MMW scenarios. Besides, MoETrack achieves state-of-the-art results on several benchmarks, including MV-RGBT, GTOT, and LasHeR. Github: https://github.com/Zhangyong-Tang/MVRGBT.

cs.CV↗

arXiv2023

Acoustic Vortex in Waveguide with Chiral Gradient Sawtooth Metasurface

The acoustic vortex states with spiral phase dislocation that can carry orbital angular moment (OAM) have aroused many research interests in recent years. The mainstream methods of generating acoustic vortex are based on Huygens-Fresnel principle to modulate the wavefront to create spatial spiral phase dislocation. In this work, we propose an entirely new scenario to generate acoustic vortex in a waveguide with chiral gradient sawtooth metasurface. The physical mechanism of our method is to lift the degenerate dipole eigenmodes through the scattering effect of the chiral surface structure, and then the superposition of them will generate both and order vortices in place. Compared to the existing methods of acoustic vortex production, our design has many merits, such as easy to manufacture and control, the working frequency is broadband, sign of vortex order can be readily flipped. Both the full-wave simulations and experimental measurements validate the existence of the acoustic vortices. The torque effect of the acoustic vortices is also successfully performed by rotating a foam disk as a practical application. Our work opens up a new route for generating acoustic vortex and could have potential significances in microfluidics, acoustic tweezers and ultrasonic communication, etc.

physics.app-ph↗

arXiv2023

Generative-based Fusion Mechanism for Multi-Modal Tracking

Generative models (GMs) have received increasing research interest for their remarkable capacity to achieve comprehensive understanding. However, their potential application in the domain of multi-modal tracking has remained relatively unexplored. In this context, we seek to uncover the potential of harnessing generative techniques to address the critical challenge, information fusion, in multi-modal tracking. In this paper, we delve into two prominent GM techniques, namely, Conditional Generative Adversarial Networks (CGANs) and Diffusion Models (DMs). Different from the standard fusion process where the features from each modality are directly fed into the fusion block, we condition these multi-modal features with random noise in the GM framework, effectively transforming the original training samples into harder instances. This design excels at extracting discriminative clues from the features, enhancing the ultimate tracking performance. To quantitatively gauge the effectiveness of our approach, we conduct extensive experiments across two multi-modal tracking tasks, three baseline methods, and three challenging benchmarks. The experimental results demonstrate that the proposed generative-based fusion mechanism achieves state-of-the-art performance, setting new records on LasHeR and RGBD1K.

cs.CV↗

arXiv2023

The 3rd Anti-UAV Workshop & Challenge: Methods and Results

The 3rd Anti-UAV Workshop & Challenge aims to encourage research in developing novel and accurate methods for multi-scale object tracking. The Anti-UAV dataset used for the Anti-UAV Challenge has been publicly released. There are two main differences between this year's competition and the previous two. First, we have expanded the existing dataset, and for the first time, released a training set so that participants can focus on improving their models. Second, we set up two tracks for the first time, i.e., Anti-UAV Tracking and Anti-UAV Detection & Tracking. Around 76 participating teams from the globe competed in the 3rd Anti-UAV Challenge. In this paper, we provide a brief summary of the 3rd Anti-UAV Workshop & Challenge including brief introductions to the top three methods in each track. The submission leaderboard will be reopened for researchers that are interested in the Anti-UAV challenge. The benchmark dataset and other information can be found at: https://anti-uav.github.io/.

cs.CV↗

arXiv2022

Acoustic mirror Chern insulator with projective parity-time symmetry

In condensed matter physics, symmetry profoundly governs the fundamentals of topological matter. The emergence of new topological phase is typically linked to the enrichment of symmetries. Different parity-time symmetry relations distinguish between spinless and spinful physical systems. In spinless systems, creating pseudo-spins can realize fragile topological phase but not break the time-reversal symmetry. Therefore, growing attentions were recently focused on the strong topological phase in spinless systems. Here we break the framework of crystallographic symmetry groups by utilizing the projective symmetry gauge field, to realize the Mirror Chern Insulator in a bilayer twisted Hofstadter model. In experiments, the edge modes were unambiguously observed with odd-shaped boundaries, confirming the strong topological features.The clockwise and anti-clockwise edge states with opposite group velocities were completely separated via an energy drain. In addition, we demonstrate that MCI has robust topological whispering gallery modes. Our work establishes a strong foundation for investigating exotic topological effects arising from the interplays between artificial gauge fields and wave systems. The clockwise and anti-clockwise edge states with opposite group velocities were completely separated via an energy drain. In addition, we demonstrate that MCI has robust topological whispering gallery modes. Our work establishes a strong foundation for investigating exotic topological effects arising from the interplays between artificial gauge fields and wave systems.

cond-mat.mes-hall↗

arXiv2022

Exploring Fusion Strategies for Accurate RGBT Visual Object Tracking

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and decision-level fusion. Specifically, different from the existing methods, paradigm of image fusion task is heeded for fusion at pixel level. Feature-level fusion is fulfilled by attention mechanism with channels excited optionally. Besides, at decision level, a novel fusion strategy is put forward since an effortless averaging configuration has shown the superiority. The effectiveness of the proposed decision-level fusion strategy owes to a number of innovative contributions, including a dynamic weighting of the RGB and TIR contributions and a linear template update operation. A variant of which produced the winning tracker at the Visual Object Tracking Challenge 2020 (VOT-RGBT2020). The concurrent exploration of innovative pixel- and feature-level fusion strategies highlights the advantages of the proposed decision-level fusion method. Extensive experimental results on three challenging datasets, \textit{i.e.}, GTOT, VOT-RGBT2019, and VOT-RGBT2020, demonstrate the effectiveness and robustness of the proposed method, compared to the state-of-the-art approaches. Code will be shared at \textcolor{blue}{\emph{https://github.com/Zhangyong-Tang/DFAT}.

cs.CV↗

arXiv2021

Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters

Deep learning based models have dominated the current landscape of production recommender systems. Furthermore, recent years have witnessed an exponential growth of the model scale--from Google's 2016 model with 1 billion parameters to the latest Facebook's model with 12 trillion parameters. Significant quality boost has come with each jump of the model capacity, which makes us believe the era of 100 trillion parameters is around the corner. However, the training of such models is challenging even within industrial scale data centers. This difficulty is inherited from the staggering heterogeneity of the training computation--the model's embedding layer could include more than 99.99% of the total model size, which is extremely memory-intensive; while the rest neural network is increasingly computation-intensive. To support the training of such huge models, an efficient distributed training system is in urgent need. In this paper, we resolve this challenge by careful co-design of both the optimization algorithm and the distributed system architecture. Specifically, in order to ensure both the training efficiency and the training accuracy, we design a novel hybrid training algorithm, where the embedding layer and the dense neural network are handled by different synchronization mechanisms; then we build a system called Persia (short for parallel recommendation training system with hybrid acceleration) to support this hybrid training algorithm. Both theoretical demonstration and empirical study up to 100 trillion parameters have conducted to justified the system design and implementation of Persia. We make Persia publicly available (at https://github.com/PersiaML/Persia) so that anyone would be able to easily train a recommender model at the scale of 100 trillion parameters.

cs.LG↗

arXiv2021

Topological interface states induced by incident angle in the 1D elastic wave system

Topological interface states are currently attracting rapidly growing attention in classical wave systems. However, little work has been done on topological interface states in one-dimensional (1D) elastic wave systems, especially in the case of oblique incidence. This paper theoretically demonstrates the realization of topological interface states of elastic waves in a 1D composite plate structure composed of two phononic crystals (PCs) with different topological characteristics, which can be regulated by the incident angle. For the out-of-plane SH mode, multiple topological interface states can coexist in different common bandgaps. For the in-plane complex P-SV coupled mode, topological interface states can exist in both "partial-polarization" and "omni-polarization" bandgaps. All these interface states are in the wide frequency and incident angle regions. We also discuss the polarization and the mode conversion of the interface states. Our results provide an innovative method to excite and tune topologically protected interface states for elastic waves, which may have potential applications in obtaining strong local vibration for different polarized elastic wave modes.

physics.app-ph↗

arXiv2021

Experimental Observation of Efficient Nonreciprocal Mode Transitions via Spatiotemporally-Modulated Acoustic Metamaterials

In lossless acoustic systems, mode transitions are always time-reversible, consistent with Lorentz reciprocity, giving rise to symmetric sound manipulation in space-time. To overcome this fundamental limitation and break space-time symmetry, nonreciprocal sound steering is realized by designing and experimentally implementing spatiotemporally-modulated acoustic metamaterials. Relying on no slow mechanical parts, unstable and noisy airflow or complicated piezoelectric array, our mechanism uses the coupling between an ultrathin membrane and external electromagnetic field to realize programmable, dynamic control of acoustic impedance in a motionless and noiseless manner. The fast and flexible impedance modulation at the deeply subwavelength scale enabled by our compact metamaterials provides an effective unidirectional momentum in space-time to realize irreversible transition in k-{\omega} space between different diffraction modes. The nonreciprocal wave-steering functionality of the proposed metamaterial is elucidated by theoretically deriving the time-varying acoustic response and demonstrated both numerically and experimentally via two distinctive examples of unidirectional evanescent wave conversion and nonreciprocal blue-shift focusing. This work can be further extended into the paradigm of Bloch waves and impact other vibrant domains, such as non-Hermitian topological acoustics and parity-time-symmetric acoustics.

physics.app-ph↗

arXiv2020

A Quantum-Inspired Probabilistic Model for the Inverse Design of Meta-Structures

In quantum mechanics, a norm squared wave function can be interpreted as the probability density that describes the likelihood of a particle to be measured in a given position or momentum. This statistical property is at the core of the microcosmos. Meanwhile, machine learning inverse design of materials raised intensive attention, resulting in various intelligent systems for matter engineering. Here, inspired by quantum theory, we propose a probabilistic deep learning paradigm for the inverse design of functional meta-structures. Our probability-density-based neural network (PDN) can accurately capture all plausible meta-structures to meet the desired performances. Local maxima in probability density distribution correspond to the most likely candidates. We verify this approach by designing multiple meta-structures for each targeted transmission spectrum to enrich design choices.

cs.LG↗

arXiv2018

Spectrum Cascade Bloch Oscillations in Temporally Modulated Acoustics

Bloch oscillations (BOs) refer to a periodically oscillatory motion of particle in lattice systems driven by a constant force. By temporally modulating acoustic waveguides, BOs can be generalized from spatial to frequency domain, opening new possibilities for spectrum manipulations. The modulation can induce mode transitions in the waveguide band and form an artificial frequency lattice, with the mismatched wave vector during transitions acting as a constant force that drives frequency Bloch oscillations (FBOs). Furthermore, the modulation phase accompanying transitions serves as a gauge potential that controls the initial oscillation phase, providing an additional degree of freedom to tailor FBOs. We report that multiple FBOs with judiciously designed oscillation phases can be further cascaded to realize acoustic spectrum self-imaging, unidirectional transduction and bandwidth engineering. The study proposes the concept of FBOs in acoustic systems and functionalizes its cascade configurations for advanced control of sound spectrum. This paradigm may find versatile applications in underwater secure communication, voice encryption and signal processing.

physics.app-ph↗