arXiv Science⌕ Search

arXiv subjects

Ningbo Li

Publications and source records attributed to Ningbo Li.

6 recordsLinked to original sources

Reaching Is Not Finding: Map-Anchored Visual Prompting for the Last Mile of Aerial Vision-Language Navigation

Aerial vision-language navigation (VLN) asks a drone to find an object described in natural language. The description usually locates the object relative to named landmarks, such as streets and buildings. We observe that current navigators often bring the drone close to the target and then stop at the wrong place: they reach the target without finding it. This gap is shared by navigators of very different designs, from imitation learners to a fine-tuned 7B vision-language model. A simple test reveals the cause. When we replace the target object in the instruction with another one next to the same landmarks, no navigator goes to it, and most stop where they did before. Navigators learn to reach the landmarks, not to identify the described object. We therefore propose MAP-VP, a plug-and-play module for the last step. After any navigator stops, MAP-VP draws the landmarks named in the instruction onto the drone's current view, using the landmark outlines that the benchmark provides on a map. A fine-tuned 4B vision-language model then locates the target relative to these landmarks. The training data are generated automatically from the benchmark annotations. Neither drawing the landmarks nor fine-tuning helps much alone, but together they are highly effective. Without retraining any navigator, MAP-VP significantly improves all six navigators we test on CityNav. It roughly doubles the success rate of the two strongest trained navigators, raising HETT from 25.9% to 54.6% and FlightGPT from 24.2% to 48.9%, whereas CityNav's official detector-based last step adds less than two points to HETT.

cs.CV↗

AdaptInfer: Adaptive Token Pruning for Vision-Language Model Inference via Dynamical Text Guidance

Vision-language models (VLMs) have achieved impressive performance on multimodal inference tasks, but the cost remains a significant challenge due to the large number of vision tokens processed during the prefill stage. Existing token pruning methods often rely on utilizing the static attention patterns directly, failing to exploit the dynamic internal signals within VLMs. To address the issue, we propose AdaptInfer, a novel plug-and-play framework for vision token pruning. First, we introduce a dynamic text-guided pruning mechanism that construct soft priors over text-token importance on each pruning layer, allowing more informed scoring of vision tokens at each stage. Second, we observe a highly consistent distribution of cross-modal attention shifts by architecture, which inspires us to introduce a efficient data-driven schedule which determines the pruning locations automatically. Experimental results have verified the effectiveness and generalization of the proposed method. Under the same token budget, AdaptInfer surpasses existing approaches in accuracy. For instance, AdaptInfer maintains averagely 99.4% accuracy on Qwen2-VL while 70% of the prefilling vision token overhead is reduced. The source code is available on: https://github.com/weiczh02/AdaptInfer-base.

cs.CV↗

Ultrafast magneto-lattice dynamics in two-dimensional CrSBr driven by terahertz excitation

Terahertz (THz) lasers provide a new research perspective for spin electronics applications due to their sub-picosecond time resolution and non-thermal ultrafast demagnetization, but the interaction between spin, charge and lattice dynamics remains unclear. This study investigates photoinduced ultrafast demagnetization in monolayer CrSBr, a two-dimensional material with strong spin-orbit and spin-lattice coupling, and resolves its demagnetization process. Two key stages are identified: the first, occurring within 20 fs, is characterized by rapid electron-driven demagnetization, where charge transfer and THz laser are strongly coupled. In the second stage, light-induced lattice vibrations coupled to spin dynamics lead to significant spin changes, with electron-phonon coupling playing a key role. Importantly, the role of various phonon vibration modes in the electron relaxation process was clearly determined, pointing out that the electronic relaxation of the B3g1 phonon vibration mode occurs within 83 fs, which is less than the commonly believed 100 fs. Moreover, the influence of this coherent phonon on the demagnetization change is as high as 215 %. These insights into multiscale magneto-structural coupling advance the understanding of nonequilibrium spin dynamics and provide guidelines for the design of light-controlled quantum devices, particularly in layered heterostructures for spintronics and quantum information technologies.

cond-mat.mtrl-sci↗

A port-Hamiltonian framework for displacement-based and rigid formation tracking

This paper proposes a passivity-based port-Hamiltonian (pH) framework for multi-agent displacement-based and rigid formation control and velocity tracking. The control law consists of two parts, where the internal feedback is to track the velocity and the external feedback is to achieve formation stabilization by steering variables of neighboring agents that prescribe the desired geometric shape. Regarding the external feedback, a general framework is proposed for all kinds of formations by means of the advantage that the pH model is energy-based and coordinate-free. To solve the issue that the incidence matrix is not of full column rank over cyclic graphs, the matrix property is used to prove the convergence to the target sets for the displacement-based formation, while for rigid formations, the algebraic conditions of infinitesimal rigidity are investigated to achieve asymptotic local stability. Furthermore, the rigid formation with heterogeneous constraints is further investigated under this framework and the asymptotic local stability is proved under a mild assumption. Simulations are performed to illustrate the effectiveness of the framework.

eess.SY↗

Angle-based formation stabilization and maneuvers in port-Hamiltonian form with bearing and velocity measurements

This paper proposes a port-Hamiltonian framework for angle-based formation stabilization and maneuvers using bearing and velocity measurements with an underlying triangulated Laman graph. The corresponding port-Hamiltonian controller is designed using virtual couplings on the errors of angle constraints in angle space and then the angle constraints and agent actuators are mapped by the constraint Jacobian, which can be applied to other formation constraints. In addition, due to the fact that the port-Hamiltonian model allows for complex and heterogeneous agent dynamics, our framework can be extended to networks with different agent dynamics and formation constraints. To avoid unavailable distance terms in the control law, an estimator is designed based on port-Hamiltonian theory and the property that energy is coordinate-free for different sensor modalities using bearing and velocity measurements, which permits our framework to inject damping for the formation maneuvers. Furthermore, several maneuvers are analyzed under both considerations of stabilization and transient performance. Simulations are performed to illustrate the effectiveness of the approach.

eess.SY↗

Novel Chern insulators with half-metallic edge states

The central target of spintronics research is to achieve flexible control of highly efficient and spin-polarized electronic currents. Based on first-principles calculations and k-p models, we demonstrate that Cu2S/MnSe heterostructures are a novel type of Chern insulators with half-metallic chiral edge states and a very high Fermi velocity (0.87 * 10^6 m/s). The full spin-polarization of the edge states is found to be robust against the tuning of the chemical potential. Unlike the mechanisms reported previously, this heterostructure has quadratic bands with a normal band order, that is, the p/d-like band is below the s-like band. Charge transfer between the Cu2S moiety and the substrate results in variation in the occupied bands, which together with spin-orbit coupling, triggers the appearance of the topological state in the system. These results imply that numerous ordinary semiconductors with normal band order may convert into Chern insulators with half-metallic chiral edge states through this mechanism, providing a strategy to find a rich variety of materials for dissipationless, 100% spin-polarized and high-speed spintronic devices.

cond-mat.mtrl-sci↗