arXiv Science⌕ Search

arXiv subjects

Jie Xu

Publications and source records attributed to Jie Xu.

At least 37 records · Page 2Linked to original sources

Federated 3D Gaussian Splatting for Large-Scale Scene Reconstruction at Wireless Edge

Three-dimensional (3D) Gaussian splatting (3D-GS) has emerged as a promising technique for large-scale scene reconstruction due to its high rendering efficiency and fidelity. However, the training of large-scale 3D-GS models at wireless edge faces various technical challenges including the limited communication, computation, and graphics processing unit (GPU) memory resources at edge devices, the structural inconsistency issue across local models hindering their effective aggregation, as well as privacy leakage risks associated with raw visual content and camera parameters. To address these challenges, this paper proposes a novel resource-efficient federated learning framework for efficiently training 3D-GS models of large scenes under severe resource constraints. First, we propose an on-device model lightweighting mechanism that adaptively selects and prunes Gaussian points to balance the rendering quality and training efficiency. In this mechanism, we quantitatively evaluate the importance of different Gaussian points at each device to facilitate the pruning, and use a novel importance-to-latency ratio criterion to determine the number of pruned Gaussian points under GPU memory and computation/communication latency constraints. Furthermore, we develop a 3D-GS model recovery mechanism that restores structural consistency across local 3D-GS models without accessing private camera parameters, enabling their effective aggregation towards a global model. Finally, extensive experiments show that our approach significantly accelerates convergence, maintains high rendering quality, and reduces training latency compared to state-of-the-art federated 3D-GS baselines.

cs.CV↗

When Do Cheap Probes Predict Expensive Training? Probing 3D-CT Encoders for Text Generation

Building a 3D CT vision language model begins with a choice of which image encoder to build on. Today that choice is made by fine-tuning every candidate through the full language model and comparing downstream scores, an enormously expensive search. A cheap probe on the encoder's representation promises a way out, but whether it forecasts the expensive outcome has never been tested. We test this with CheapCT on report generation and on MeasureVQA, a new VQA dataset we build. MeasureVQA scores the outcome one capability at a time, its answers measured from segmentation masks and Hounsfield units. Report generation scores the whole report at once and reflects mostly disease. CheapCT forecasts expensive training across every capability. The forecast survives changing the probe readout and the language-model backbone. The rank agreement between CheapCT and fine-tuning stays high throughout, from rho = 0.90 to 0.97. Used to choose an encoder, CheapCT picks one nearly as good as the best while fine-tuning a single candidate, at orders of magnitude less compute. We release the code and MeasureVQA at https://github.com/renjie-liang/CheapCT.

cs.CV↗

SelfCue: Making a 3D CT Report Generator Say What It Already Knows

Progress in 3D CT report generation is usually sought in increasingly sophisticated architectures and larger pools of training data. We find instead that a 3D CT report generator already holds what its report leaves out, and loses it when the hidden state becomes tokens. Over the 18 CT-RATE abnormalities, this hidden-to-report surfacing gap is reflected by a drop in macro AUROC from 0.848 in the hidden states to 0.739 in the generated report. We propose SelfCue based on contrastive decoding. It promotes what the hidden state already supports and suppresses what it does not. It raises clinical efficacy F1 to 0.481 and the LLM-judged GREEN score to 0.510. Distilling that behaviour into the weights gives SelfCue-KD, a student that keeps most of the gain, needs nothing extra at inference, and drops into any pipeline already serving the baseline. Code is available at https://github.com/renjie-liang/SelfCue-CT.

cs.CV↗

UpDown-SC: Gravity-Canonicalized Dual-Envelope Scan Context for Indoor LiDAR Place Recognition

LiDAR place recognition is a key front end for loop closure and global relocalization, yet indoor retrieval remains difficult when attitude or sensor mounting height changes between mapping and query sessions. Scan Context stores the maximum height in each polar cell; indoors, broad ceilings can suppress the lower and mid-level geometry that distinguishes adjacent rooms and corridors. We present UpDown-SC, a training-free polar descriptor that first canonicalizes gravity and then represents two complementary surfaces: the upper envelope of lower/middle structures and the lower envelope of overhead structures. Their physical split is estimated once from a cell-balanced map height distribution and reused by every query. A mask-aware, non-uniform two-channel distance retains discriminative lower-level evidence while limiting sensitivity to its cross-session variation, without treating unobserved cells as zero-height measurements. Conventional Scan Context shortlisting and circular yaw alignment are retained, so retrieved hypotheses directly initialize geometric verification. Experiments across repeated indoor sessions, mounting-height changes, mixed outdoor-to-indoor trajectories, and an outdoor transfer sequence show more reliable first-choice retrieval on the indoor and mounting-height-varied sessions. A paired test finds a significant gain over Scan Context on the in-house sessions. UpDown-SC also gives the best or second-best F1max and AUPR under threshold-based acceptance while retaining a lightweight CPU front end. Continuous replay confirms that the retrieved hypotheses support metric prior-map localization. Code and evaluation artifacts: https://github.com/jiejie567/updown-sc.

cs.CV↗

Design of a combined polarimetric and velocimetric measurement for viscoelastic stress, and its constitutive resolving power

A polarimeter does not report stress. It reports a retardance and an azimuth, and converting those to a stress pair fixes both the calibration that is required and the covariance that the subsequent inference must carry. We set out that observation chain for planar viscoelastic flow, combine it with velocimetry, and ask what the combined measurement can resolve. The calibration constant is fixed by three separately measurable quantities (path length, stress-optic coefficient and wavelength) rather than being fitted. Propagating the polarimetric errors to first order gives a stress covariance that is anisotropic and site dependent even for independent homoscedastic inputs, and whose conditioning degrades as the retardance approaches zero, where the linearization itself stops describing the measurement. Wrapping imposes a separate design bound. Two numerical studies follow, both in ideal calibrated stress coordinates under a prescribed covariance rather than the propagated polarimetric one. Holding the total scalar count fixed and varying the split between velocimetric and optical sites, an unequal allocation favoring optical sites outperforms either pure configuration. We then ask what the measurement resolves between constitutive models compatible with the same velocity data. In self-consistent pressure-driven flow of the finitely extensible nonlinear elastic Peterlin model, at extensibility L^2=50 and 3% noise, the optical channel rejects the velocity-compatible Oldroyd-B family in 78.1% of realizations at the Deborah number De=2, the ratio of the relaxation time to the flow timescale, and in 100% at De=4, while rejecting only about 5% below De=0.3. The resolving power of a design is therefore a strong function of Deborah number and must be quoted with it.

physics.flu-dyn↗

A closed-form solution for streaming and Lagrangian transport in a deforming circular cavity

Streaming from a deforming cavity wall serves micromixing, pumping and particle handling. We solve it in closed form in a two-dimensional circular cavity, for any azimuthal wall mode $m$, as $\mathrm{Wo}^2 \to 0$. A biharmonic inversion against the Reynolds stress, corrected by the second-order slip a moving wall imposes, gives the Lagrangian mean a tracer follows for a deforming no-slip wall, $ψ_L = -[m(5m+4)a_m^2/(128(m+2)(2m+1))]\,r^{2m}(r^2-1)^2\sin 2mθ$, with a companion form for a shear-free interface. For a single mode the factor $(5m+4)/(m+2)$ relating it to the auxiliary solution $ψ_2$ is the same for every member of the co-phased prescribed-velocity family; at $m=2$ the physical Eulerian mean peaks an order of magnitude above $ψ_2$, with opposite sign. The no-slip cell centers lie at $r^2 = m/(m+2)$, and at large $m$ the peak streamfunction falls as $m^{-2}$, the peak speed as $m^{-1}$. At fixed radial wall-velocity amplitude the ranking over $m$ follows the wall kinematics: an externally driven wall peaks at $m=1$, a wall with zero first-order surface strain at $m=3$. Mode superpositions invert without degenerating, each harmonic carrying its own correction. At finite $\mathrm{Wo}$ the first-order field stays closed form in Bessel functions and the mean flow reduces to quadrature; the construction approaches the $m=2$ Rayleigh limit on a separate tangentially driven boundary problem. An independent finite-element solver, with the closed form withheld, reproduces $ψ_2$ with quadratic mesh convergence.

physics.flu-dyn↗

Generalizable Robotic Insertion with World Models

Robotic assembly in high-mixture settings requires adaptable systems that can handle diverse parts, yet current approaches typically rely on policies specialized to each insertion task. Although this can reach high success rates, it makes the process of deploying systems for new problems tedious and time consuming. We present a framework for generalizable insertion using world models that combine robot proprioceptive information with raw visual observations captured by a wrist-mounted camera. Our model-based approach trains a single world model on up to 90 insertion tasks with geometrically diverse parts, achieving 56% zero-shot success on unseen objects with unknown geometry compared to just 7% with a model-free baseline. Importantly, performance improves as more objects are included in the training dataset, demonstrating strong scalability. Lastly, finetuning the generalist model on held-out objects significantly enhances data-efficiency compared to training from scratch and, in some cases, achieves better asymptotic performance. To our knowledge, this is the first system capable of assembling unseen objects in an entirely data-driven manner, and thus represents a significant step toward scalable, generalizable robotic assembly systems.

cs.RO↗

Does Online Gravity Estimation Matter? Revisiting a Silent Design Split in LiDAR-Inertial Odometry

LiDAR-inertial odometry (LIO) systems differ in whether they continue estimating gravity after initialization. We compare four gravity-bias state configurations in each of FAST-LIO2 and LIO-SAM, then separately test a gravity-direction factor. Across 12 dataset sequences evaluated with FAST-LIO2, fixing gravity under continuous LiDAR correction produces mean paired changes in vertical and 3D position errors with 90% confidence intervals within $\pm 2\%$. Tests on 4 sequences with LIO-SAM likewise show no consistent benefit from online gravity. Multi-second LiDAR outages, unlike reduced range or field of view, reveal trajectory-dependent costs of fixing gravity. A history-matched 23D-to-21D switch places the repeatable 3D error increase after LiDAR updates resume. Under 5-s outages, a direction factor from the same IMU used for preintegration improves accuracy on Hall05 but worsens both errors with online gravity on TUHH. Dynamic-start tests also show fixed-bias failures at particular starting phases. We recommend keeping gravity and accelerometer bias online for robustness; use a direction factor only after verifying vertical and 3D accuracy gains under the intended operating conditions.

cs.RO↗

Structural identifiability and stress reconstruction from incomplete optical maps with velocimetry

Reconstructing the stress field of a planar viscoelastic flow from optical measurements loses its direct evidence wherever optical coverage is interrupted, and no improvement in optical precision restores an observation that was never made. We characterize what a second, velocity channel adds, and what neither channel can supply. Two calibrated optical components determine the local deviatoric stress pointwise, while velocity constrains spatial stress variation through momentum balance, so the two channels are complementary rather than redundant. The isotropic part of the stress is unobservable to both: the divergence of an isotropic field is a pure gradient, which the Leray projection annihilates, so every representable isotropic mode lies in the joint null space. That accounts for the null space exactly when the optical field is complete, and bounds it from below otherwise, since finite incomplete sampling and aperture zeros can remove further directions. We verify the count directly on three discretizations. In paired synthetic tests with finite measurement apertures, spatially correlated noise and optical stripe dropout, adding velocity reduces the mean whole-domain deviatoric error from 50.40% to 27.82% at 3% reference noise, and the improvement survives shared gaps, inverse-grid refinement at fixed physical sampling, and a constitutively generated stress field. The improvement does not rest on how the regularization parameter is chosen: it holds under both the expected-norm discrepancy rule and generalized cross-validation, and we report each selection with its position in the search interval, which is where the two rules differ.

physics.flu-dyn↗

Meta-LinEXP3: Online-within-Online Learning for Adversarial Linear Contextual Bandits

Meta-learning has emerged as an effective paradigm for transferring knowledge across sequential bandit tasks. While substantial progress has been made for stochastic bandits and non-contextual adversarial bandits, meta-learning for adversarial linear contextual bandits (ALCBs) with random action sets remains largely unexplored. To address this problem, we propose Meta-LinEXP3, an online-within-online algorithm that constructs a predictable task-level prior from completed tasks to guide the inner LinEXP3 learner. For known context distributions, we develop a policy-centered estimator that achieves an intrinsic-dimension $\mathcal{O}(\sqrt{n})$ per-task regret bound. For unknown distributions, we introduce a past-only regularized moment estimator with an $\mathcal{O}(n^{2/3})$ leading regret term and explicit finite-sample error. We further establish a direct connection between prior accuracy and transfer regret, showing that increasingly accurate priors yield sublinear transfer-dependent regret across tasks. Experiments demonstrate the effectiveness of Meta-LinEXP3, including its application to structured hyperspectral tensor sampling.

cs.LG↗

Spectral-Residual Continuous Greedy for Tensor Sampling

Sampling a multidomain tensor from limited measurements is fundamental in structured linear inverse problems. Kronecker-structured sampling avoids the full high-dimensional sensing matrix, but design remains difficult: sequential discrete methods can commit the cross-mode budget too early, whereas standard continuous greedy avoids such early commitment at the cost of repeated state-dependent gradient evaluations. We propose spectral-residual continuous greedy (\alg) for frame-potential (FP) tensor sampling. \alg maintains a state-dependent fractional allocation before rounding. Mode-wise Gram matrices provide safe gradient intervals for direction certification, while Shapley values prioritize unresolved gradient queries. SR-CG then applies deterministic rounding followed by path-guided exchange (PGX), which reuses the final fractional state to restrict candidate swaps and accepts only exact FP-decreasing exchanges. We establish a finite-step approximation guarantee that approaches the classical $1-1/e$ factor as direction certification becomes exact and finite-step residual error vanishes. Experiments show fewer exact gradient evaluations and better FP designs, with clearer gains on instances where the cross-mode budget allocation is difficult to determine. \alg also achieves lower average normalized mean-squared error (NMSE) than Greedy-FP at all tested noise levels, although the reconstruction gain is smaller than the FP gain.

math.OC↗

JEPA Policy: Diffusion-Free Imitation Learning via Paired Action and Future Representation Prediction

Standard behavior cloning supervises actions without explicitly constraining the future representation paired with each demonstrated action chunk. We introduce JEPA Policy, a diffusion-free framework that uses the action chunk and its observed future representation as paired training targets. Action and future-representation tokens interact in a shared Transformer and are refined through two forward passes. Future prediction can therefore shape the representation used to generate actions. Dual-branch and gradient-routing controls attribute the gain to this shared topology rather than to an auxiliary prediction head alone. Across nine simulated tasks, JEPA Policy improves mean success over the action-only MIP baseline and outperforms Diffusion Policy under the evaluated configurations, while adding 0.29 ms to MIP's model latency. A five-task, 630-episode physical-robot study produces the same pooled ranking. Further audits find no complete representation collapse under action supervision and identify a task-conditioned failure-ranking signal in future-prediction error. These results support paired future-representation supervision as a practical approach to low-latency visuomotor imitation without iterative generative sampling.

cs.RO↗

Exploiting LLM Agents for Trustworthy AutoResearch in Wireless Communications

Large language model (LLM) agent-enabled AutoResearch is attracting growing interest across scientific disciplines, in which LLMs are leveraged for knowledge synthesis, multistep planning, code generation, tool invocation, and iterative refinement, thus automating the research lifecycle, from hypothesis generation and experimentation to analysis and manuscript preparation. Wireless communications is particularly suitable to this paradigm. This is due to the fact that advances in this field often rely on fundamental-limit analysis, system optimization, and protocol design, all supported by mature mathematical, simulation, and optimization toolchains, as well as standards, measurement, and digital-twin platforms. However, integrating autonomous agents into rigorous wireless research workflows requires traceable processes and verifiable evidence. This article presents a general trustworthy wireless AutoResearch framework. This framework employs typed research contracts, version-controlled artifacts, independent validators, and bounded agent authority to connect hypothesis generation with system modeling, mathematical formu lation, algorithm design, code generation, simulation, reproducible claims, and manuscript preparation. We conduct a case study on integrated sensing and communication (ISAC) for unmanned aerial vehicles (UAVs). It is shown that the proposed framework can generate innovative research ideas and, with appropriate expert intervention, produce a manuscript whose evaluation score is comparable to or higher than those of related IEEE conference and letter papers. These findings demonstrate the effectiveness of LLM agents in orchestrating authoritative scientific tools and versioned research artifacts, while underscoring the importance of human-AI collaboration.

eess.SP↗

Poetic Heritage for Culturally Grounded Emotional Support: An Interaction Design Framework and Its Multimodal Agentic Instantiation

Digital systems increasingly mediate emotional support, yet their interactions often remain culturally generic. Accordingly, we examine how a poetic tradition can be operationalized as a culturally grounded interactive medium and how generative AI can support such engagement. The resulting interaction design framework translates staged literature-based support and tradition-specific poetic aesthetics into guidance for digital system design. Poemithy instantiates the framework as a multimodal, LLM-enabled multi-agent system for guided reflection through classical Chinese poetry. A controlled between-subjects study with 50 participants compared text-only and multimodal versions. Both conditions showed medium-to-large within-session improvements in affect, anxiety, and emotion regulation, while between-condition tests detected no differences in these changes. Among secondary post-session user-experience measures, the clearest observed differences favored multimodality in perceived attunement, perceived task success, and engagement; usability and hedonic quality were descriptively higher, while workload did not differ detectably. Post-only cultural ratings were descriptively favorable in both conditions for cultural identification, poetry-engagement and dissemination intentions, and perceived cultural enrichment. Together, the findings suggest that culturally grounded content and structured guidance should anchor system design, while multimodal presentation may strengthen resonance and engagement. More broadly, the work shows how generative AI can mediate engagement with poetic heritage in culturally grounded emotional-support interactions.

cs.HC↗

Breaking the Structural Identity: Personalized Federated LoRA Fine-tuning under Rank Heterogeneity

Large Language Models (LLMs) have achieved remarkable success across diverse domains, but their adaptation to privacy-sensitive, distributed datasets remains a challenge. While Federated Learning (FL) combined with Low-Rank Adaptation (LoRA) provides a resource-efficient paradigm for collaborative fine-tuning, practical deployments are hindered by the dual challenges of resource heterogeneity and data heterogeneity. Existing rank-heterogeneous methods primarily focus on bridging dimension mismatches for aggregation but typically provide a unified global model for all clients sharing the same rank, failing to capture client-specific features in non-IID scenarios. In this paper, we propose FedRoRA (Federated Rank-wise Personalized LoRA), a novel framework that enables fine-grained personalization within rank-heterogeneous federations. FedRoRA decouples adaptation into shared global directions and personalized rank-wise magnitudes governed by learnable diagonal scales. On the server side, it extracts a global subspace via singular value decomposition (SVD) and redistributes client-specific initializations through a personalized projection and top-$k$ selection mechanism. Extensive experiments on NLU and NLG benchmarks demonstrate that FedRoRA consistently outperforms state-of-the-art methods.

cs.LG↗

Edmunds-Evans essential spectra of the generalized Constantin-Lax-Majda linearization

For $0<a<1$, we study the linearization $L_a$ about a smooth odd self-similar collapse profile $(Ω,c_l)$ of the generalized Constantin-Lax-Majda equation, where $c_l$ is the focusing exponent. On the origin-$H^2$ realization $X=\{φ\in L^2(0,\infty):φ(0)=0,φ''\in L^2(0,\infty)\}$, under explicit transport, regularity, weighted-derivative, and far-field hypotheses, the first three Edmunds-Evans essential spectra are exactly the union of two possibly coincident vertical lines: $\operatorname{Re}λ=F=-1+c_l/2$ at infinity and $\operatorname{Re}λ=O=-\tilde c/2$ at the origin, where $\tilde c=c_l+a(HΩ)(0)$ and $H$ is the Hilbert transform. Off these lines, $L_a-λ$ is Fredholm, with index zero on the exterior components, $+1$ in the open strip when $F<O$, and $-1$ when $O<F$. The fourth and fifth Edmunds-Evans spectra and the Browder essential spectrum equal the closed strip. Every point of the open strip with index $+1$ is an eigenvalue. Every fixed point of the Huang-Qin-Wang-Wei positive-advection construction with $0<a<400/(848-9π^2)$, after normalization, satisfies the full hypothesis package. For all sufficiently small positive $a$, every such fixed point has $F<O$. Thus actual collapse profiles realize a nonempty Browder band. An additional kernel-nondegeneracy condition (ND) yields exact individual kernel and cokernel dimensions. We prove it outside an explicit vertical energy slab and, at sufficiently high frequency, on every closed vertical substrip of the open band separated from the far-field line. Failures in the open band are locally finite and can accumulate at high frequency only toward that line.

math.AP↗

CARD: Calibration via Agreement in Reverse Diffusion for Out-of-Domain MRI Segmentation

Probability calibration aligns model confidence with predictive accuracy, enabling clinicians to identify unreliable segmentation regions. This alignment breaks down under domain shift, where artifacts and unseen protocols produce confident errors. Existing post-hoc methods adapt the correction at test time, conditioning on predictive entropy, the logit pattern, or augmentation response, but each proxy is read from the terminal prediction, the very quantity that shift corrupts. This motivates reliability evidence beyond the terminal prediction, which categorical diffusion provides in two ways. First, a generative shape prior keeps a capacity-limited reference intact when appearance is corrupted, so its disagreement with the primary segmentor highlights primary-model errors. Second, every reverse step yields a class distribution, separating persistent disagreement from transient discrepancy. Aggregated over the trajectory, this disagreement correlates with Dice at 0.788, against 0.521 for a matched discriminative control. We therefore propose CARD (Calibration via Agreement in Reverse Diffusion), which maps the temporal aggregate of this disagreement to a temperature field applied per pixel across all classes, so that confidence changes while the segmentation does not. Across cardiac, prostate and brain MRI shifts, CARD lowers calibration error in 45 of 49 comparisons against the strongest baseline in each setting.

cs.CV↗

Stream3Dv2: Geometric-Semantic Fusion Enhanced Streaming Zero-Shot 3D Scene Understanding

Recently, open-vocabulary zero-shot 3D scene understanding using vision foundation models has emerged as a promising alternative to data-intensive supervised methods. However, deploying these models in real-world scenarios is severely hindered by their inability to efficiently handle streaming RGB-D inputs and their inherent vulnerability to noise 2D segmentation masks. To address these critical limitations, we propose Stream3Dv2, a novel training-free framework designed for robust streaming 3D perception. Stream3Dv2 processes sequential data through an original nested local-to-historical architecture, capturing multi-view consistency while circumventing the high computational overhead so as to support timely responses. At its core, we introduce a comprehensive geometric-semantic fusion mechanism that resolves geometric noise and semantic ambiguity by explicitly utilizing semantic guidance and formulating 3D segmentation as solving point-and-set merging and partitioning problems. Furthermore, we present an innovative manifold-distance-based point cloud refinement strategy. This approach leverages local manifold graphs for point-to-manifold optimization that mitigates the boundary delineation failures caused by Euclidean-distance metrics, and employs geometric bounding boxes to dynamically activate and update historical instances for achieving rapid manifold-to-manifold refinement. Extensive experiments on public datasets demonstrate that Stream3Dv2 consistently outperforms existing baselines in foundational open-vocabulary streaming 3D segmentation and detection. Finally, we show that integrating our framework with an LLM-based agent enables advanced language-driven 3D scene understanding, underscoring its potential for open-world embodied intelligence. Code will be updated at https://github.com/SubmissionsIn/Stream3D.

cs.CV↗