arXiv ScienceSearch

arXiv subjects

Ruixiao Zhang

Publications and source records attributed to Ruixiao Zhang.

18 recordsLinked to original sources

Talk2Sensors: 3D Visual Grounding in Autonomous Driving via Sensor-Adaptive Physical Cue Matching

As a key capability for embodied intelligence, 3D visual grounding (3DVG) has been predominantly studied in indoor scenes with RGB-D or point-cloud inputs, while existing outdoor extensions largely rely on monocular images alone. Both settings fall short of real-world outdoor perception, where heterogeneous sensors capture complementary yet distinct physical properties, such as visual texture, 3D geometry, and object kinematics, that are indispensable for flexible and robust query-adaptive grounding but remain under-exploited. To bridge this gap, we introduce Talk2Sensors, the first multi-sensor 3D visual grounding dataset built upon camera, LiDAR, and 4D radar. It contains 8,682 language instructions and 20,558 referred objects, with diverse prompts explicitly aligned with sensor-specific physical cues. Furthermore, we propose TSFormer, a unified Transformer-based framework for language-guided 3D visual grounding in autonomous driving. TSFormer adopts a coarse-to-fine property-aware fusion strategy: the Language-Routed Property Sampler first performs coarse text-conditioned feature retrieval by modulating sensor sampling weights with query-level linguistic cues, while the subsequent Sparse-Preserving Modality Arbiter module conducts fine-grained modality arbitration and text-guided refinement to determine the precise referred spatial location. This design enables dynamic routing of appearance, geometry, and motion cues according to the semantic requirements of each prompt, preventing dense modalities from overwhelming sparse but critical sensor signals. Extensive experiments demonstrate that TSFormer achieves state-of-the-art performance across multiple benchmarks: it improves over the strongest baseline by 8.05 mAP on Talk2Sensors, and transfers to the monocular Mono3DRefer benchmark with 53.05\% Acc@0.5.

cs.CV

From Cloud to Crowd: Democratizing LLM Service with Decentralized Edge Collaboration for RAG

The rapid advancement of large language models (LLMs) has increased demand for scalable and cost-effective deployment, especially for mobile and edge devices. Cloud-hosted LLMs are powerful but expensive and difficult to scale due to vendor lock-in and high resource needs, resulting in high expenses and unstable performance under load. Recent efforts focus on deploying small language models (SLMs), distilled or pruned from LLMs, on resource-constrained edge devices to reduce costs and improve scalability. However, edge-based SLMs face limited knowledge coverage and notable accuracy gap compared to cloud-based LLMs. To address this, we present DEFRAG, a decentralized edge collaboration system for retrieval-augmented generation (RAG) that optimizes both retrieval and generation across heterogeneous edge devices. For retrieval, DEFRAG compresses and shares knowledge graphs, using hybrid retrieval to expand knowledge coverage. For generation, DEFRAG introduces an optimizer that adaptively selects SLMs and RAG parameters per query, balancing accuracy and cost. We implement DEFRAG on a heterogeneous edge testbed and evaluate it on benchmark QA datasets. We also test it under mobile route stress, non-uniform data placement, and a domain-specific QA workload. The results show that DEFRAG maintains stable service quality and cost efficiency under these broader settings. Results show that DEFRAG narrows the SLM-LLM accuracy gap, while reducing cost by up to 98.4% and increasing peak throughput by up to 97.8% over centralized services. These findings demonstrate the potential of DEFRAG for democratized LLM services at the edge.

cs.DC

Generic ill-posedness for Schr\"odinger equation with power-type nonlinearity on $\mathbb{S}^2$

In this article, we investigate the local well-posedness of the nonlinear Schr\"odinger equation on the two-dimensional sphere $\mathbb{S}^2$: \begin{align*} i\partial_tu+\Delta_{g}u=F(u). \end{align*} The nonlinearity $F(u)$ is assumed to be gauge-invariant. More presicely, there exists a function $V\in C^\infty(\mathbb{C},\mathbb{R})$ such that $F=\frac{\partial V}{\partial \bar{z}}$. Moreover, $V(z)$ obeys \begin{equation}\label{H-11} V(e^{i\theta}z)=V(z),\,\,\theta\in\Bbb R,\,\,z\in\Bbb C, |\partial_z^{k_1}\partial_{\bar{z}}^{k_2}V(z)|\leq C_{k_1,k_2}(1+|z|)^{1+\alpha-k_1-k_2},\tag{H-1} \end{equation} for some $\alpha\geq3.$ The main contribution of this paper is the new lower bound of threshold of local well-posedness $s_c(\mathbb{S}^2,\alpha)$. Specifically, under assumption \eqref{H-11}, we prove that for $\alpha \geq 3$, the equation is ill-posed in $H^s(\mathbb{S}^2)$ with $s < 1 - \frac{2}{\alpha-1}$ in the sense that the norm inflation occurs. Combined with the well-posedness in Yang [Sci. China Math. 58 (2015), 1023-1046], the exact threshold $s_c(\mathbb{S}^2,\alpha)$ for $\alpha\geq5$ is $1-\frac{2}{\alpha-1}$, which matches the scaling-critical regularity as the Euclidean setting. Moreover, for $\alpha \in [3, \frac{11}{3})$, we show that the solution map is not uniformly continuous in the range $0 < s < \frac14$ for the power-type nonlinearity $F(u)=|u|^{\alpha-1}u$, which lies strictly above the scaling-invariant threshold. This provides a new characterization of the ill-posedness regime for all $\alpha \geq 3$, extending an earlier result of Burq-G\'erard-Tzvetkov [Math. Res. Lett. 9 (2002), 323-335]. Our result can also be regarded as a Schr\"odinger counterpart of Xia [Int. Math. Res. Not. (2021), 15533-15554].

math.AP

On the pointwise convergence of NLS flow on $ \S^2 $

In this paper, we study the almost everywhere convergence of the cubic nonlinear Schr\"odinger flow to the initial data on $\mathbb S^2$, \begin{equation*} iu_t + \Delta_g u = |u|^2u, \quad (t,x)\in\R\times \S^2. \end{equation*} Inspired by the randomization method and the ansatz introduced by Burq, Camps, Sun, and Tzvetkov [Preprint, arXiv:2404.18229], we prove almost sure pointwise convergence almost everywhere for the nonlinear solution at very low regularity. This extends Compaan-Luc\`a-Staffilani [Int. Math. Res. Not. IMRN, (1) (2021), 596--647] to the spherical setting. We also provide a new necessary condition for the associated $L^p$ maximal estimate for the linear Schr\"odinger equation on $\S^2$. More precisely, we show that the $L^p$ maximal estimate fails for $s<\frac{1}{2}-\frac{1}{2p}$ with $p\ge 2$. In the special case $p=3$, our result matches the corresponding range in the $\R^2$ case, up to the endpoint, and improves the previous result of Chen-Duong-Lee-Yan [J. Math. Pures Appl. 163 (2022), 433--449].

math.AP

QuickGrasp: Responsive Video-Language Querying Service via Accelerated Tokenization and Edge-Augmented Inference

Video-language models (VLMs) are reshaping video querying services, bringing unified solutions to complex perception and reasoning tasks. However, deploying large VLMs in real-world systems remains challenging due to their high resource demands, and remote-based deployment often results in unacceptable response delays. Although small, locally deployable VLMs offer faster responses, they unavoidably fall short in accuracy. To reconcile this trade-off, we propose QuickGrasp, a responsive, quality of service (QoS)-aware system that bridges this gap through a local-first architecture with on-demand edge augmentation. Built upon the highly modular architecture of VLMs, QuickGrasp shares the vision representation across model variants to avoid redundant computation. To maximize system-wide efficiency, QuickGrasp introduces three key designs: accelerated video tokenization, query-adaptive edge augmentation, and delay-aware, accuracy-preserving vision token density configuration. We implement a prototype of QuickGrasp and evaluate it across multiple video understanding benchmarks. The results show that QuickGrasp matches the accuracy of large VLMs while achieving up to a 12.8x reduction in response delay. QuickGrasp represents a key advancement toward building responsive video querying services for open-world understanding that fully leverage the capabilities of VLMs.

cs.CV

ViTMAlis: Towards Latency-Critical Mobile Video Analytics with Vision Transformers

Edge-assisted mobile video analytics (MVA) applications are increasingly shifting from using vision models based on convolutional neural networks (CNNs) to those built on vision transformers (ViTs) to leverage their superior global context modeling and generalization capabilities. However, deploying these advanced models in latency-critical MVA scenarios presents significant challenges. Unlike traditional CNN-based offloading paradigms where network transmission is the primary bottleneck, ViT-based systems are constrained by substantial inference delays, particularly for dense prediction tasks where the need for high-resolution inputs exacerbates the inherent quadratic computational complexity of ViTs. To address these challenges, we propose a dynamic mixed-resolution inference strategy tailored for ViT-backboned dense prediction models, enabling flexible runtime trade-offs between speed and accuracy. Building on this, we introduce ViTMAlis, a ViT-native device-to-edge offloading framework that dynamically adapts to network conditions and video content to jointly reduce transmission and inference delays. We implement a fully functional prototype of ViTMAlis on commodity mobile and edge devices. Extensive experiments demonstrate that, compared to state-of-the-art accuracy-centric, content-aware, and latency-adaptive baselines, ViTMAlis significantly reduces end-to-end offloading latency while improving user-perceived rendering accuracy, providing a practical foundation for next-generation mobile intelligence.

cs.NI

Asymptotic behavior of mass-critical Schr\"odinger equation in $ \mathbb{R}$

In this paper, we study the long-time behavior for the mass-critical nonlinear Schr\"odinger equation on the line \[ i\partial_t u + \partial_x^2 u = |u|^4 u, u(0, x) = u_0 \in L_x^2(\Bbb R). \] The global well-posedness and scattering for this equation was solved in Dodson [Amer. J. Math. (2016)]. Inspired by the pioneering work of Killip-Visan-Zhang [Amer. J. Math. (2021)], we show that solution can be approximated by a finite-dimensional Hamiltonian system. This system is the nonlinear Schr\"odinger equation on the rescaled torus $\Bbb R/(L_n\Bbb Z)$ with Fourier truncated nonlinear term. To prove this, we introduce the Fourier truncated mass-critical NLS on $\mathbb{R}$. First, we establish the uniformly global space-time bound for this truncated model on $\mathbb{R}$. Second, we show that the truncated NLS on rescaled torus can be approximated by the truncated equation on $\Bbb R$. Then, using the Gromov theorem, we can show the non-squeezing property for the truncated NLS on torus. The last step to show the non-squeezing property for original NLS is to connect the solution with truncated nonlinearity and a single equation in $\mathbb{R}$, which can be done by performing the nonlinear profile decomposition. Our second result is to study the homogenization of the mass-critical inhomogeneous NLS, where we add a $L^\infty$ function $h(nx)$ in front of the nonlinear term. Based on the method of Ntekoume [Comm. PDE, (2020)], we give the sufficient condition on $h$ such that the scattering holds for this inhomogeneous model and show that the solution to inhomogeneous converges to the homogeneous model when $n\to\infty$. As a corollary, we can transfer the non-squeezing property from homogeneous model to inhomogeneous.

math.AP

On Growth of Sobolev norms for cubic Schr\"odinger equation with harmonic potential in dimensions $d=2,3$

In this article, we study the growth of higher-order Sobolev norms for solutions to the defocusing cubic nonlinear Schr\"odinger equation with harmonic potential in dimensions $d=2,3$, \begin{align}\label{PNLS} \begin{cases}\tag{PNLS} i\partial_tu-Hu=|u|^{2}u,&(t,x)\in\mathbb{R}\times\mathbb{R}^d,\\ u(0,x)=u_0(x), \end{cases} \end{align} where $H=-\Delta+|x|^2$. Motivated by Planchon-Tzvetkov-Visciglia [Rev. Mat. Iberoam., 39 (2023), 1405-1436], we first establish the bilinear Strichartz estimates, which removes the $\varepsilon$-loss of Burq-Poiret-Thomann [Preprint, arXiv: 2304.10979]. To show the polynomial growth of Sobolev norm, our proof relies on the upside-down $I$-method associated to the harmonic oscillator. Due to the lack of Fourier transform or expansion, we need to carefully control the freqeuncy interaction of the type "high-high-low-low". To overcome this difficulty, we establish the explicit interaction for products of eigenfunctions. Our bound covers the result of Planchon-Tzvetkov-Visciglia [Rev. Mat. Iberoam., 39 (2023), 1405-1436] in dimension two and is new in dimension three.

math.AP

EcoLens: Leveraging Multi-Objective Bayesian Optimization for Energy-Efficient Video Processing on Edge Devices

Video processing for real-time analytics in resource-constrained environments presents a significant challenge in balancing energy consumption and video semantics. This paper addresses the problem of energy-efficient video processing by proposing a system that dynamically optimizes processing configurations to minimize energy usage on the edge, while preserving essential video features for deep learning inference. We first gather an extensive offline profile of various configurations consisting of device CPU frequencies, frame filtering features, difference thresholds, and video bitrates, to establish apriori knowledge of their impact on energy consumption and inference accuracy. Leveraging this insight, we introduce an online system that employs multi-objective Bayesian optimization to intelligently explore and adapt configurations in real time. Our approach continuously refines processing settings to meet a target inference accuracy with minimal edge device energy expenditure. Experimental results demonstrate the system's effectiveness in reducing video processing energy use while maintaining high analytical performance, offering a practical solution for smart devices and edge computing applications.

cs.CV

CornerPoint3D: Look at the Nearest Corner Instead of the Center

3D object detection aims to predict object centers, dimensions, and rotations from LiDAR point clouds. Despite its simplicity, LiDAR captures only the near side of objects, making center-based detectors prone to poor localization accuracy in cross-domain tasks with varying point distributions. Meanwhile, existing evaluation metrics designed for single-domain assessment also suffer from overfitting due to dataset-specific size variations. A key question arises: Do we really need models to maintain excellent performance in the entire 3D bounding boxes after being applied across domains? Actually, one of our main focuses is on preventing collisions between vehicles and other obstacles, especially in cross-domain scenarios where correctly predicting the sizes is much more difficult. To address these issues, we rethink cross-domain 3D object detection from a practical perspective. We propose two new metrics that evaluate a model's ability to detect objects' closer-surfaces to the LiDAR sensor. Additionally, we introduce EdgeHead, a refinement head that guides models to focus more on learnable closer surfaces, significantly improving cross-domain performance under both our new and traditional BEV/3D metrics. Furthermore, we argue that predicting the nearest corner rather than the object center enhances robustness. We propose a novel 3D object detector, coined as CornerPoint3D, which is built upon CenterPoint and uses heatmaps to supervise the learning and detection of the nearest corner of each object. Our proposed methods realize a balanced trade-off between the detection quality of entire bounding boxes and the locating accuracy of closer surfaces to the LiDAR sensor, outperforming the traditional center-based detector CenterPoint in multiple cross-domain tasks and providing a more practically reasonable and robust cross-domain 3D object detection solution.

cs.CV

Generative Active Adaptation for Drifting and Imbalanced Network Intrusion Detection

Machine learning has shown promise in network intrusion detection systems, yet its performance often degrades due to concept drift and imbalanced data. These challenges are compounded by the labor-intensive process of labeling network traffic, especially when dealing with evolving and rare attack types, which makes preparing the right data for adaptation difficult. To address these issues, we propose a generative active adaptation framework that minimizes labeling effort while enhancing model robustness. Our approach employs density-aware dataset prior selection to identify the most informative samples for annotation, and leverages deep generative models to conditionally synthesize diverse samples, thereby augmenting the training set and mitigating the effects of concept drift. We evaluate our end-to-end framework \NetGuard on both simulated IDS data and a real-world ISP dataset, demonstrating significant improvements in intrusion detection performance. Our method boosts the overall F1-score from 0.60 (without adaptation) to 0.86. Rare attacks such as Infiltration, Web Attack, and FTP-BruteForce, which originally achieved F1 scores of 0.001, 0.04, and 0.00, improve to 0.30, 0.50, and 0.71, respectively, with generative active adaptation in the CIC-IDS 2018 dataset. Our framework effectively enhances rare attack detection while reducing labeling costs, making it a scalable and practical solution for intrusion detection.

cs.NI

Improved global well-posedness for the cubic NLS on two-dimensional waveguide $\R\times\T$

In this article, we show that the solution to defocusing cubic nonlinear Schr\"odinger equation (NLS) posed on the two-dimensional waveguide \begin{align*} i\partial_tu+\Delta_{\R\times\T}u=|u|^2u \end{align*} is globally well-posed in $H^s(\R\times\T)$ with $s>\frac{1}{2}$. The proof is based on the $I$-method. Inspired by Colliander-Keel-Staffilani-Takaoka-Tao [Discrete Contin. Dyn. Syst. 21 (2008), 665-686], we construct the modified energy to improve the energy increment. The main difficulty lies in controlling the resonant interactions caused by the modified energy. To this end, we establish refined bilinear Strichartz estimates with angular truncation on the rescaled waveguide, thereby generalizing results previously obtained by Takaoka [J. Differ. Equa. 394 (2024), 296-319]. Furthermore, we demonstrate polynomial growth of $H^s$ with $\frac{1}{2} < s < 1$. Our result extends the recent work of Deng-Fan-Yang-Zhao-Zheng [J. Func. Anal. 287 (2024), 110595].

math.AP

Global well-posedness for the defocusing cubic nonlinear Schr\"odinger equation on $\Bbb T^3$

In this article, we investigate the global well-posedness for the defocusing, cubic nonlinear Schr\"{o}dinger equation posed on $\T^3$ with intial data lying in its critical space $H^\frac{1}{2}(\T^3)$. By establishing the linear profile decomposition, and applied this to the concentration-compactness/rigidity argument, we prove that if the solution remains bounded in the critical Sobolev space throughout the maximal lifespan, i.e. $u\in L_t^\infty{H}^\frac{1}{2}(I\times\T^3)$, then $u$ is global.

math.AP

On scattering for two-dimensional quintic Schr\"odinger equation under partial harmonic confinement

In this article, we study the scattering theory for the two dimensional defocusing quintic nonlinear Schr\"odinger equation(NLS) with partial harmonic oscillator which is given by \begin{align}\label{NLS-abstract} \begin{cases}\tag{PHNLS} i\partial_tu+(\partial_{x_1}^2+\partial_{x_2}^2)u-x_2^2u=|u|^4u,&(t,x_1,x_2)\in\mathbb{R}\times\mathbb{R}\times\mathbb{R},\\ u(0,x_1,x_2)=u_0(x_1,x_2). \end{cases} \end{align} First, we establish the linear profile decomposition for the Schr\"odinger operator $e^{it(\partial_{x_1}^2+\partial_{x_2}^2-x_2^2)}$ by utilizing the classical linear profile decomposition associated with the Schr\"odinger equation in $L^2(\mathbb{R})$. Then, applying the normal form technique, we approximate the nonlinear profiles using solutions of the new-type quintic dispersive continuous resonant (DCR) system. This allows us to employ the concentration-compactness/rigidity argument introduced by Kenig and Merle in our setting and prove scattering for equation (PHNLS) in the weighted Sobolev space. The second part of this paper is dedicated to proving the scattering theory for this mass-critical (DCR) system. Inspired by Dodson's seminal work [B. Dodson, Amer. J. Math. 138 (2016), 531-569], we develop long-time Strichartz estimates associated with the spectral projection operator $\Pi_n$, along with low-frequency localized Morawetz estimates, to address the challenges posed by the Galilean transformation and spatial translation.

math.AP

Revisiting Cross-Domain Problem for LiDAR-based 3D Object Detection

Deep learning models such as convolutional neural networks and transformers have been widely applied to solve 3D object detection problems in the domain of autonomous driving. While existing models have achieved outstanding performance on most open benchmarks, the generalization ability of these deep networks is still in doubt. To adapt models to other domains including different cities, countries, and weather, retraining with the target domain data is currently necessary, which hinders the wide application of autonomous driving. In this paper, we deeply analyze the cross-domain performance of the state-of-the-art models. We observe that most models will overfit the training domains and it is challenging to adapt them to other domains directly. Existing domain adaptation methods for 3D object detection problems are actually shifting the models' knowledge domain instead of improving their generalization ability. We then propose additional evaluation metrics -- the side-view and front-view AP -- to better analyze the core issues of the methods' heavy drops in accuracy levels. By using the proposed metrics and further evaluating the cross-domain performance in each dimension, we conclude that the overfitting problem happens more obviously on the front-view surface and the width dimension which usually faces the sensor and has more 3D points surrounding it. Meanwhile, our experiments indicate that the density of the point cloud data also significantly influences the models' cross-domain performance.

cs.CV

Detect Closer Surfaces that can be Seen: New Modeling and Evaluation in Cross-domain 3D Object Detection

The performance of domain adaptation technologies has not yet reached an ideal level in the current 3D object detection field for autonomous driving, which is mainly due to significant differences in the size of vehicles, as well as the environments they operate in when applied across domains. These factors together hinder the effective transfer and application of knowledge learned from specific datasets. Since the existing evaluation metrics are initially designed for evaluation on a single domain by calculating the 2D or 3D overlap between the prediction and ground-truth bounding boxes, they often suffer from the overfitting problem caused by the size differences among datasets. This raises a fundamental question related to the evaluation of the 3D object detection models' cross-domain performance: Do we really need models to maintain excellent performance in their original 3D bounding boxes after being applied across domains? From a practical application perspective, one of our main focuses is actually on preventing collisions between vehicles and other obstacles, especially in cross-domain scenarios where correctly predicting the size of vehicles is much more difficult. In other words, as long as a model can accurately identify the closest surfaces to the ego vehicle, it is sufficient to effectively avoid obstacles. In this paper, we propose two metrics to measure 3D object detection models' ability of detecting the closer surfaces to the sensor on the ego vehicle, which can be used to evaluate their cross-domain performance more comprehensively and reasonably. Furthermore, we propose a refinement head, named EdgeHead, to guide models to focus more on the learnable closer surfaces, which can greatly improve the cross-domain performance of existing models not only under our new metrics, but even also under the original BEV/3D metrics.

cs.CV

Talk2Radar: Bridging Natural Language with 4D mmWave Radar for 3D Referring Expression Comprehension

Embodied perception is essential for intelligent vehicles and robots in interactive environmental understanding. However, these advancements primarily focus on vision, with limited attention given to using 3D modeling sensors, restricting a comprehensive understanding of objects in response to prompts containing qualitative and quantitative queries. Recently, as a promising automotive sensor with affordable cost, 4D millimeter-wave radars provide denser point clouds than conventional radars and perceive both semantic and physical characteristics of objects, thereby enhancing the reliability of perception systems. To foster the development of natural language-driven context understanding in radar scenes for 3D visual grounding, we construct the first dataset, Talk2Radar, which bridges these two modalities for 3D Referring Expression Comprehension (REC). Talk2Radar contains 8,682 referring prompt samples with 20,558 referred objects. Moreover, we propose a novel model, T-RadarNet, for 3D REC on point clouds, achieving State-Of-The-Art (SOTA) performance on the Talk2Radar dataset compared to counterparts. Deformable-FPN and Gated Graph Fusion are meticulously designed for efficient point cloud feature modeling and cross-modal fusion between radar and text features, respectively. Comprehensive experiments provide deep insights into radar-based 3D REC. We release our project at https://github.com/GuanRunwei/Talk2Radar.

cs.RO

A Bilevel Formalism for the Peer-Reviewing Problem

Due to the large number of submissions that more and more conferences experience, finding an automatized way to well distribute the submitted papers among reviewers has become necessary. We model the peer-reviewing matching problem as a {\it bilevel programming (BP)} formulation. Our model consists of a lower-level problem describing the reviewers' perspective and an upper-level problem describing the editors'. Every reviewer is interested in minimizing their overall effort, while the editors are interested in finding an allocation that maximizes the quality of the reviews and follows the reviewers' preferences the most. To the best of our knowledge, the proposed model is the first one that formulates the peer-reviewing matching problem by considering two objective functions, one to describe the reviewers' viewpoint and the other to describe the editors' viewpoint. We demonstrate that both the upper-level and lower-level problems are feasible and that our BP model admits a solution under mild assumptions. After studying the properties of the solutions, we propose a heuristic to solve our model and compare its performance with the relevant state-of-the-art methods. Extensive numerical results show that our approach can find fairer solutions with competitive quality and less effort from the reviewers.

cs.MA