arXiv subjects

Xu Cao

Publications and source records attributed to Xu Cao.

At least 37 records · Page 2Linked to original sources

arXiv2026

Gaze Target Estimation Anywhere with Concepts

Estimating human gaze targets from images in-the-wild is an important and formidable task. Existing approaches primarily employ brittle, multi-stage pipelines that require explicit inputs, like head bounding boxes and human pose, in order to identify the subject of gaze analysis. As a result, detection errors can cascade and lead to failure. Moreover, these prior works lack the flexibility of specifying the gaze analysis task via natural language prompting, an approach which has been shown to have significant benefits in convenience and scalability for other image analysis tasks. To overcome these limitations, we introduce the Promptable Gaze Target Estimation (PGE) task, a new end-to-end, concept-driven paradigm for gaze analysis. PGE conditions gaze prediction on flexible user text or visual prompts (e.g., "the boy in the red shirt" or "person in point [0.52, 0.48]") to identify a specific subject for gaze analysis. This approach integrates subject localization with gaze estimation, and eliminates the rigid dependency on intermediate analysis stages. We develop a scalable data engine to generate Gaze-Co (Gaze Estimation with Concepts), a dataset and benchmark of 120K high-quality, prompt-annotated image pairs. We also propose GazeAnywhere, the first model designed for PGE. GazeAnywhere uses a transformer-based detector to fuse features from frozen encoders and simultaneously solves subject localization, in/out-of-frame presence, and gaze target heatmap estimation. GazeAnywhere achieves state-of-the-art performance on multiple PGE benchmarks, setting a strong baseline for this new problem even on a difficult out-of-domain, real-world clinical dataset. GazeAnywhere is open-sourced in github.com/IrohXu/GazeAnywhere.

cs.CV↗

arXiv2026

ZIPBrain: Can EEG Foundation Models Be Faster, Locally Deployable, but Accurate?

This work investigates whether Electroencephalograph (EEG) foundation models (EFMs) can be made faster and locally deployable without sacrificing accuracy. EEG foundation models are a major trend, offering strong general-purpose representations. However, their computational burden grows quadratically with input length, hindering deployment on resource-constrained scenario, particularly for real-time clinical monitoring. EEG's low SNR further suggests many of these tokens are redundant and compressible with little accuracy cost. We propose ZIPBrain, a novel redundancy-aware EEG token pooling module that leverages this low-SNR characteristic to reduce token count. Given a token sequence, ZIPBrain partitions tokens into redundant and unique groups, then merges each redundant token with its most similar counterpart in the unique group. Furthermore, ZIPBrain serves as a training-free, plug-and-play module that seamlessly integrates into standard Transformer encoders with negligible computational overhead. Extensive experiments across multiple EEG foundation models show ZIPBrain's strong versatility, achieving 1.3%-10.5% average improvement over baselines, while reducing wall-clock inference time by 32.7% (up to 41.8% with CUDA Graph) compared to the original EEG foundation models.

cs.AI↗

arXiv2026

ChronoVision: Temporal Reasoning via Latent State Reconstruction

Multimodal large language models excel at passive perception but struggle with complex visual cognitive tasks requiring multi-step temporal reasoning. This degradation largely stems from the inherent ambiguity of language-based reasoning, which often fails to accurately articulate continuous visual transformations. To address this, we propose ChronoVision, a multimodal framework designed to align visual logic with latent imagery. During supervised fine-tuning, a Reconstructive Visual Head predicts the latent representation of the final transformed state, while an ROI Attention Locating module focuses the model on key visual evidence via semantic span queries. In post-training, we apply reinforcement learning with an implicit process grounding mechanism, guided by a composite reward function that evaluates outcome correctness, latent process alignment, and unsupervised visual focus. Furthermore, we introduce Vbvr-VQA, a novel dataset that evaluates temporal tracking by reformulating video reasoning into a strict image-ordering task. Experiments demonstrate that ChronoVision achieves state-of-the-art performance on Vbvr-VQA with 74.8% in-domain and 71.6% out-of-domain accuracy, alongside a strong 55.0% accuracy on IntPhys2, a highly challenging cross-domain benchmark.

cs.CV↗

arXiv2026

The 1st AI Children Challenge

The First AI Children Challenge aims to advance real-world applications of computer vision and AI in child healthcare, child education, and pediatrics. The 2026 CV4CHL edition featured the first track in this domain: Children Gait Visual Analysis. The main goal of Children Gait Visual Analysis is the fine-grained analysis of children's gait behaviors from keypoint sequences. This is still a big challenge for human action recognition. Experienced medical doctors can distinguish these subtle nuances, but none of the people test AI models in this domain. To bridge this gap, we introduce thousands of 2D children keypoint sequences walking around videos across various age groups of children (3-16 years old). There is a significant opportunity for batch analysis of these videos to provide clinically relevant insights into medical diagnosis. The Challenge will be launched with two problem tracks: Edinburgh Visual Gait Score (EVGS) Scoring and Classification of Gait Patterns in Bilateral Spastic Cerebral Palsy. Each track is chosen in consultation with board-certified pediatricians based on the value of potential solutions. With the first available dataset for such tasks and ground truth for each track, the challenge enabled participants to evaluate their solutions. Final rankings will be revealed after the competition concludes, fostering reproducibility and mitigating overfitting.

cs.CV↗

arXiv2026

Decoding Children's Gait Behavior

We introduce a new problem domain for human action recognition: the fine-grained analysis of children's gait behaviors from standard RGB video. We specifically target the ambulatory patterns of children aged 3-17 years. Such behaviors arise naturally in the diagnosis and treatment of several critical developmental and neuromuscular disorders, such as cerebral palsy and hemiplegia. Despite their clinical value, current 3D sensor-based gait analysis systems are expensive, intrusive, and often impractical for young subjects. To address this, we introduce a new dataset comprising over 1,100 high-frame-rate (60 FPS) video sequences from 110 subjects, accompanied by synchronized, anonymized pose sequences. In each session, the child performs a 5-second "walk-around" task, capturing the gait cycle from multiple viewpoints. Crucially, we demonstrate that current state-of-the-art approaches, including gait foundation models and Multimodal Large Language Models (MLLMs), fail to effectively resolve these clinical nuances. We identify the key technical challenges in analyzing these erratic and subtle motor patterns and describe a unified end-to-end framework for decoding fundamental components of pediatric gait. Through comprehensive experimental results, we demonstrate the potential of this dataset to drive novel research questions and establish a rigorous baseline for automated child gait assessment.

cs.CV↗

arXiv2026

Three-dimensional imaging of hadrons with hard exclusive reactions: advances in experiment, theory, phenomenology, and lattice QCD

Generalized Parton Distributions (GPDs) have emerged as a powerful framework for exploring the internal structure of hadrons in terms of their partonic constituents. Over the past three decades, the field has witnessed significant theoretical and experimental advancements. The interpretation of GPDs in impact parameter space offers a vivid three-dimensional visualization of hadron structure, correlating longitudinal momentum and transverse spatial distributions, thereby enabling tomographic imaging of hadrons. Furthermore, the link between GPDs and the matrix elements of the QCD energy-momentum tensor provides access to fundamental properties of hadrons, including spin decomposition and internal pressure distributions. Notably, recent analyses of Deeply Virtual Compton Scattering (DVCS) data have enabled the empirical extraction of the quark pressure profile inside the proton. Motivated by the rapidly evolving experimental landscape, this white paper provides a timely and focused overview of recent developments in GPD theory, phenomenology, and lattice QCD studies. Its scope is shaped by the needs and opportunities of forthcoming experimental programs, and it highlights advances that are particularly relevant for the next generation of dedicated measurements, including the extended Jefferson Lab 12 GeV program and its potential 22 GeV upgrade, J-PARC, COMPASS/AMBER, LHC ultra-peripheral collisions, and the future electron-ion colliders EIC and EicC.

hep-ph↗

arXiv2026

Review of oxygen measurement and relevance to the mechanisms of FLASH radiotherapy

FLASH radiotherapy (FLASH-RT) is the phenomenon of relative sparing of normal tissue when ultra-high dose rates (UHDR) are used compared with conventional dose rates (CDR) as clinically used. Despite extensive investigation, the underlying mechanisms remain unexplained. Among the proposed hypotheses, tissue oxygen has consistently been a central theme because oxygen is the most dominant factor known to modulate radiation-induced damage. The factors implicated in FLASH sparing include the baseline partial pressure of oxygen (pO2), transient radiolytic oxygen consumption (ROC), and oxygen-dependent changes in the chemistry of reactive oxygen species (ROS) that vary with dose rate. This review synthesizes current evidence on in vivo oxygen measurement techniques, highlighting their capabilities and limitations in capturing the spatial and temporal heterogeneity of tissue oxygenation. Key experimental studies in skin are summarized and interpreted by modulating oxygen levels via changes in inspired oxygen gas and vascular clamping interventions, demonstrating that the FLASH effect occurs only at intermediate baseline pO2 (normoxic or slightly hypoxic) values, but not at hypoxia or hyperoxia. Direct measurement of oxygen consumption during UHDR irradiation is possible, providing one of the first in situ measurements of radiation chemistry in patients. In parallel, recent advances in fast in vitro radiation chemistry assays indicate that UHDR irradiation alters radical yields, favoring increased production of solvated electrons and reduced hydroxyl radical mediated damage. Taken together, the available data suggest that the FLASH sparing effect arises from an interplay among the delivered dose and dose rate, local oxygen availability, and radiation chemistry, with tissue-specific variation in scavenging, leading to altered biological responses across the CDR-to-UHDR shift.

physics.med-ph↗

arXiv2026

CogniRoute: Learning to Route Social Evidence in Omni-Modal Models

Omni-modal models can ingest video, audio, and text, but unified access to multiple modalities does not guarantee that a model uses the right evidence. This gap is especially pronounced in social video question answering, where the answer may hinge on a gesture, vocal tone, temporal cue, or mismatch between what is said and what is visually expressed. We introduce CogniRoute, a schema-guided Mixture-of-Experts framework for social omni reasoning. CogniRoute uses a training-only cognitive schema that factorizes each example by cross-modal relation, reasoning demand, and temporal scope, and aligns global routing signatures with this structure during supervised fine-tuning. We further introduce route-aware reinforcement learning, which jointly optimizes token generation and expert allocation using rewards for answer correctness, modality-consistent reasoning, and cognitive temporal grounding. To support training and evaluation, we construct OmniSocialBench, a diagnostic social video QA resource with 118K structured training examples, grounded reasoning traces, schema labels, temporal evidence spans, and a manually verified evaluation split. CogniRoute achieves 59.38\% average accuracy on OmniSocialBench, improving over the strongest proprietary baseline by 15.33 percentage points and the strongest open-source omni baseline by 26.77 points, with the largest gains on questions requiring audio-visual coordination, conflict resolution, and temporally grounded social inference.

cs.CV↗

arXiv2026

Constraining DVCS Compton Form Factors Using Lattice QCD informed Neural Network

The lattice QCD calculation of generalized form factors are exploited to determine the subtraction constants through all order dispersion relations of Deeply Virtual Compton Scattering (DVCS). The leading order relation is found to constrain significantly the real part of the Compton Form Factors (CFFs), and the higher order one reduces considerably both the real and imaginary part of CFFs in a global analysis of proton data. This is realized by a synthesis of the DVCS data and LQCD calculations within a neural network framework, whose architecture is specifically designed for a reliable extrapolation to unmeasured kinematic regime. By leveraging dispersion relations beyond leading order, our framework allows for adding higher moments of generalized parton distributions (GPDs) from LQCD into the extraction of CFFs from DVCS data.

hep-ph↗

arXiv2026

HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Maps

Visual localization on standard-definition (SD) maps has emerged as a promising low-cost and scalable solution for autonomous driving. However, existing regression-based approaches often overlook inherent geometric priors, resulting in suboptimal training efficiency and limited localization accuracy. In this paper, we propose a novel homography-guided pose estimator network for fine-grained visual localization between multi-view images and standard-definition (SD) maps. We construct input pairs that satisfy a homography constraint by projecting ground-view features into the BEV domain and enforcing semantic alignment with map features. Then we leverage homography relationships to guide feature fusion and restrict the pose outputs to a valid feasible region, which significantly improves training efficiency and localization accuracy compared to prior methods relying on attention-based fusion and direct 3-DoF pose regression. To the best of our knowledge, this is the first work to unify BEV semantic reasoning with homography learning for image-to-map localization. Furthermore, by explicitly modeling homography transformations, the proposed framework naturally supports cross-resolution inputs, enhancing model flexibility. Extensive experiments on the nuScenes dataset demonstrate that our approach significantly outperforms existing state-of-the-art visual localization methods. Code and pretrained models will be publicly released to foster future research.

cs.CV↗

arXiv2026

Hyperon-Nucleon Spectrometer

Chirality lies at the heart of low-energy QCD, governing the symmetry structure that shapes hadron masses and strong interaction dynamics. Among the most compelling open questions tied to chiral dynamics and spontaneous chiral symmetry breaking is the longstanding $Λ$ polarization puzzle, in which $Λ$ hyperons produced in unpolarized hadronic collisions exhibit a surprisingly large transverse polarization that remains theoretically unexplained. This whitepaper presents the proposal for the Hyperon-Nucleon Spectrometer (H-NS) at the High-Intensity heavy-ion Accelerator Facility (HIAF). Leveraging the high energy and high intensity of HIAF's proton and heavy-ion beams, the H-NS experiment will perform systematic studies of hyperon polarization phenomena and their underlying mechanisms in proton-proton ($pp$), proton-nucleus ($pA$), and nucleus-nucleus ($AA$) collisions in the fixed target mode. A wide-range beam energy scan, including proton beams from 3 GeV up to 9.3 GeV (HIAF) and up to 32 GeV (upgraded HIAF), will be conducted to examine the dependence of polarization on collision energy. The spectrometer is designed with specialized detectors capable of high-precision reconstruction of final-state baryon polarizations. Among its many interesting and important measurements, H-NS will simultaneously measure hyperon and proton spin observables to explore the polarization mechanism in hadronic interactions and the spin structure of baryons. Furthermore, the use of $pA$ and $AA$ collisions will enable detailed investigations of cold and hot nuclear matter effects on spin polarization. Its physics program and detector development will significantly benefit the future Electron-ion Collider in China.

physics.ins-det↗

arXiv2026

SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scaling

Recent advances in recommendation scaling laws have led to foundation models of unprecedented complexity. While these models offer superior performance, their computational demands make real-time serving impractical, often forcing practitioners to rely on knowledge distillation-compromising serving quality for efficiency. To address this challenge, we present SOLARIS (Speculative Offloading of Latent-bAsed Representation for Inference Scaling), a novel framework inspired by speculative decoding. SOLARIS proactively precomputes user-item interaction embeddings by predicting which user-item pairs are likely to appear in future requests, and asynchronously generating their foundation model representations ahead of time. This approach decouples the costly foundation model inference from the latency-critical serving path, enabling real-time knowledge transfer from models previously considered too expensive for online use. Deployed across Meta's advertising system serving billions of daily requests, SOLARIS achieves 0.67% revenue-driving top-line metrics gain, demonstrating its effectiveness at scale.

cs.LG↗

arXiv2026

Assessing the impact of the electron ion collider in China on Deeply Virtual Compton Scattering

We assess the impact of future measurements of deeply virtual Compton scattering (DVCS) off protons using the planned detector at the Electron-Ion Collider in China (EicC), proposed as an upgrade to the High Intensity heavy-ion Accelerator Facility (HIAF). We develop a neural-network architecture to flexibly parameterize the Compton Form Factors (CFFs), extrapolate reliably into unmeasured kinematic regions, and provide robust uncertainty estimates through the replica method. The framework is fitted to the available worldwide DVCS data using the Gepard software. We find a significant reduction in the uncertainties of all CFFs after incorporating pseudo-data from single and double polarization asymmetries at the EicC, with particularly strong improvements in the sea-quark region.

hep-ph↗

arXiv2026

Entanglement redistribution of hyperon-antihyperon pair via sequential decay

Hyperon-antihyperon pairs produced in high energy electron-positron annihilation constitute a naturally spin-entangled system in the high energy regime. Recently, a probabilistic amplification of entanglement, termed autodistillation, has been found in the daughter baryon-antibaryon pairs from hyperon decay and is constrained by an upper boundary. This work demonstrates that the quantum entanglement in this process may be accompanied by a decrease, constrained by a lower boundary, but will not be completely lost. Thus, the entanglement of these systems undergoes redistribution within the phase space during the sequential decays of hyperons, highlighting an important role of hyperon polarization. By using the explicit spin density matrix of baryon pairs, it is also found that quantumness of the system characterized by quantum discord always have the possibility to increase during decay processes, even when entanglement evaluated by concurrence and negativity does not increase.

hep-ph↗

arXiv2026

Manipulating Bell nonlocality and entanglement in polarized electron-positron annihilation

The hyperon-antihyperon pairs produced in electron-positron annihilation as a massive two-qubit quantum system can be used to study the quantum correlations at high energies. This paper is theoretically dedicated to how polarization of lepton beams manipulate the Bell nonlocality and entanglement of hyperon pairs system. The response of CHSH parameter, concurrence, and negativity to the polarization degree of beam is numerically calculated by exploiting the joint spin density matrix of hyperon-antihyperon pairs. Different influences of longitudinal and transverse polarization of beams on entanglement are found and compared. The results provide alternative perspectives for the decay of charmonium to hyperon pairs.

hep-ph↗

arXiv2026

Evaluating Cognitive Age Alignment in Interactive AI Agents

While agentic AI and its core multimodal large language models (MLLMs) have demonstrated remarkable promise in language and visual reasoning across domains ranging from daily life to advanced scientific research, a profound gap remains between artificial and human intelligence. Despite the integration of powerful tools and advanced MLLMs, state-of-the-art AI agents frequently fail at foundational, seemingly simple tasks that a child can resolve with ease. Inspired by the Wechsler Intelligence Scale for Children (WISC), we introduce ChildAgentEval, the first psychometrically grounded interactive benchmark for evaluating cognitive age alignment in MLLM-based agents. ChildAgentEval systematically compares the reasoning performance of various MLLM-based interactive agents against age-specific human developmental stages, exposing where current agentic AI systems can and cannot simulate age-specific cognitive behavior.

cs.AI↗

arXiv2026

GRASP: Learning to Ground Social Reasoning in Multi-Person Non-Verbal Interactions

Understanding social interactions requires reasoning over subtle non-verbal cues, yet current multimodal large language models (MLLMs) often fail to identify who interacts with whom in multi-person videos. We introduce GRASP, a large-scale social reasoning dataset that connects high-level social QA with fine-grained gaze and deictic gesture events. GRASP contains 290K question--answer pairs over 46K videos totaling 749 hours, organized by a 16-category taxonomy spanning gaze, gesture, and joint gaze--gesture reasoning, together with GRASP-Bench for evaluation. Unlike prior resources that focus on either isolated cues or high-level social QA, GRASP builds questions from identity-consistent gaze trajectories, deictic gestures, and their joint compositions into social events. Moreover, we propose Social Grounding Reward (SGR), a learning signal that uses these social events to encourage models to reason about the participants involved in each interaction. Experiments show that SGR improves performance on GRASP-Bench while maintaining zero-shot performance on related social video QA benchmarks.

cs.CV↗

arXiv2026

PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulation

Recent advancements in vision-language-action (VLA) models have shown promise in robotic manipulation, yet they continue to struggle with long-horizon, multi-step tasks. Existing methods lack internal reasoning mechanisms that can identify task-relevant interaction cues or track progress within a subtask, leading to critical execution errors such as repeated actions, missed steps, and premature termination. To address these challenges, we introduce PALM, a VLA framework that structures policy learning around interaction-centric affordance reasoning and subtask progress cues. PALM distills complementary affordance representations that capture object relevance, contact geometry, spatial placements, and motion dynamics, and serve as task-relevant anchors for visuomotor control. To further stabilize long-horizon execution, PALM predicts continuous within-subtask progress, enabling seamless subtask transitions. Across extensive simulation and real-world experiments, PALM consistently outperforms baselines, achieving a 91.8% success rate on LIBERO-LONG, a 12.5% improvement in average length on CALVIN ABC->D, and a 2x improvement over real-world baselines across three long-horizon generalization settings.

cs.RO↗