arXiv Science⌕ Search

arXiv subjects

Tao Han

Publications and source records attributed to Tao Han.

At least 19 recordsLinked to original sources
arXiv2026

Vision-Language Agents Can Learn in Their Own Latent Worlds

Learning from experience is essential for building the next generation of agents that continually expand their capabilities. Pretrained vision-language models (VLMs) already internalize rich world knowledge, yet this knowledge is rarely leveraged to drive policy improvement through online interaction. Realizing this potential efficiently remains challenging, as policy updates shift the agent's interaction distribution, requiring the world model to adapt accordingly, while continually updating large pretrained models is computationally expensive. To address this challenge, we introduce Dwell, a model-based reinforcement learning (RL) framework that reframes a VLM as a recurrent latent transition operator, endowing it with the ability to predict, adjust, and act in latent space. Leveraging the VLM's own representations and its dual role as both world model and policy, the agent continually learns from real interactions to anticipate and evaluate action outcomes, and from latent imagination to improve its behavior. Across five interactive visual environments, Dwell achieves the strongest overall performance among trainable methods while substantially reducing the compute required for imagination, showing that effective world models for VLM agents need not reconstruct the future; they need to predict futures that are useful for action. Our code is publicly available at https://github.com/Tom111-lhx/Dwell

cs.AI↗
arXiv2026

A High-Energy Neutrino Collider within a Muon Collider

A multi-TeV muon collider is simultaneously a collider for high-energy neutrinos. The radiation of soft $W^\pm$ gauge bosons from the muon beams gives rise to collisions of $μ^+ν$, $μ^-\barν$ and $ν\barν$ at center-of-mass energies close to that of the $μ^+μ^-$ collisions in a controlled and theoretically predictable setting. We focus on the leading partonic processes $μ^+μ^- \to \ell^+\ell'^-$, $ν_μμ^+\to ν_\ell \ell'^+$, $\barν_μμ^- \to \barν_{\ell} \ell'^-$ and $ν_μ\bar ν_μ\to \ell^+\ell'^-$ ($\ell, \ell'=e, μ, τ$). These are related to one another at high energies by the electroweak $SU(2)$ gauge symmetry, and therefore probe different components of the same underlying electroweak dynamics. These processes open qualitatively new windows to neutrino interactions at unprecedented energies, and open new windows on physics beyond the Standard Model. We demonstrate the combined sensitivity and the complementarity of the different purely-leptonic collisions using both effective field theory and simplified models of $W'^\pm$ and $Z'$ vector bosons. The radiative return mechanism leads to resonant production of the $W^{\prime\pm}$ and $Z'$ vector bosons when their masses are kinematically accessible, while their off-shell effects are captured by the corresponding effective operators. In particular, we show that supplementing the dominant charged-lepton collisions with neutrino-initiated collisions significantly improves the ability to resolve degeneracies among different effective operators, even for operators to which the neutrino-initiated processes are not directly sensitive. Including these channels is therefore essential for properly characterizing the structure of new physics.

hep-ph↗
arXiv2026

Probing Heavy Neutral Leptons through New Gauge Interactions at the Forward Physics Facilities

We investigate the prospects for improving the heavy neutral lepton (HNL) searches at the far-forward LHC experiments FASER and FASER$ν$, as well as their proposed HL-LHC successors, FASER2 and FASER$ν$2, using new HNL production mechanisms. We consider scenarios in which HNLs couple directly to a new $U(1)$ gauge boson and decay into visible Standard Model final states through mixing with active neutrinos. Focusing on the $U(1)_{B-L}$, $U(1)_{B-3L_τ}$, and $U(1)_B$ gauge extensions as benchmark models, we study HNL production through proton bremsstrahlung and Drell--Yan processes, which probe complementary mediator-mass regimes. We analyze several visible decay channels, including charged leptons, neutral mesons, and other hadrons, and evaluate the projected sensitivities for different neutrino-flavor mixing patterns. We find that these new production mechanisms that differ qualitatively from the conventional picture in which both production and decay are controlled by active-sterile mixing enable the far-forward LHC program to probe previously unexplored regions of HNL parameter space, with the first-ever demonstration of FASER$ν$ having sensitivity to HNLs and FASER2 and FASER$ν$2 offering substantially enhanced sensitivity during the HL-LHC era, even reaching the canonical seesaw prediction for all three lepton flavors. Our results demonstrate that new gauge interactions can substantially enhance HNL production independently of the active-sterile mixing that governs their visible decays, opening complementary opportunities to explore HNLs at the forward physics facilities.

hep-ph↗
arXiv2026

Blueprint for an AI-Enabled Particle Theory Community

Rapid advances in the capabilities and reach of artificial intelligence (AI) are changing research in particle physics. In this new era, AI is an innovative tool for theoretical physicists, while the interaction of AI and particle theory is itself a developing field. We argue that particle theory requires a community-scale effort to realize its full potential. We show how particle theory occupies a unique position in the AI for physics landscape, and describe the complementarity of AI and theory developments. We conclude with a series of recommendations on how to build an AI-enabled theory community for the Genesis Mission.

hep-ph↗
arXiv2026

Resilient Decentralized Preconditioned Stochastic Proximal Optimization with Gradient Sketching over Time-Varying Networks

Variance reduction is indispensable in Byzantine-resilient decentralized stochastic optimization over multi-agent systems (MASs), as it effectively mitigates gradient noise to facilitate the resilient aggregation process. However, most existing Byzantine-resilient decentralized variance-reduced (VR) stochastic gradient algorithms rely on random data sampling, which proves inefficient in data-scarce yet high-dimensional tasks, for instance, image deblurring. This paper aims to pursue an alternative approach that achieves variance reduction via gradient sketching. We first formulate a class of structural risk minimization (SRM) problems over time-varying networks, where the local objectives are not necessarily decomposable and their gradients may be inaccessible. To solve the SRM problems in a decentralized manner, we incorporate a localized gradient-sketching technique into a preconditioned stochastic proximal gradient framework, proposing a novel gossip-based decentralized algorithm with variance reduction, dubbed Gossip-SEGA. To further enhance its resilience, we substitute the weighted-average aggregation in Gossip-SEGA with a norm-penalized approximation, thereby developing a Byzantine-resilient decentralized algorithm, namely RED-SEGA. Theoretically, we derive sufficient conditions for both consensus among reliable agents and (sub)linear convergence rate of RED-SEGA over time-varying networks in the presence of Byzantine agents with unknown identities. This is challenging, as the convergence and consensus errors must be bounded within a transformed variable-metric geometry, where the inherent complexities are further compounded by adversarial Byzantine agents and time-varying networks. The effectiveness and resilience of RED-SEGA are validated by solving a constrained least-squares problem and an image deblurring task under various Byzantine attacks.

math.OC↗
arXiv2026

MetaCtrl: Your Large Language Models Can Reason Better and More Concisely with a Metacognitive Controller

Large reasoning models improve performance on challenging problems by allocating additional computation before answering, but longer reasoning does not always lead to better results and can introduce substantial redundant reasoning on simple problems. Conversely, aggressively shortening reasoning can degrade performance on difficult ones. Effective reasoning therefore requires dynamically deciding when additional computation is useful based on the reasoner's capabilities and evolving solution state. Existing approaches often rely on predefined budgets or intervention rules, retrain the target reasoner, or require additional supervision. We introduce MetaCtrl, a lightweight controller that adaptively regulates a frozen reasoner without predefined token budgets or reasoner retraining. We formulate reasoning regulation as a sequential metacognitive control problem: MetaCtrl observes the evolving reasoning trace and decides whether to continue, simplify, skip redundant steps, or conclude reasoning. It is trained directly with reinforcement learning using a reward that prioritizes correctness while favoring shorter trajectories among correct solutions, requiring neither supervised intervention trajectories nor problem-specific budgets. Across seven benchmarks spanning mathematics, science, and code, MetaCtrl consistently improves the accuracy of LRMs while reducing their reasoning length. On DeepSeek-R1-Distill-Qwen-7B, it improves average accuracy by 4.7 points while reducing generation length by 53.3%. Without further training, the same controller transfers to an unseen reasoner (e.g., Qwen3-14B), improving average accuracy by 2.9 points and reducing generation length by 50.3%. These results establish MetaCtrl as a plug-and-play controller for improving reasoning accuracy while substantially reducing inference-time generation. The code is available at https://github.com/binbin2xs/MetaCtrl.

cs.AI↗
arXiv2026

MLLMs Know When Before Speaking: Revealing and Recovering Temporal Grounding via Attention Cues

Video temporal grounding (VTG), which localizes the start and end times of a queried event in an untrimmed video, is a key test of whether multimodal large language models (MLLMs) understand not only what happens but also when it happens. Although modern MLLMs describe video content fluently, their timestamp predictions remain unreliable, while existing remedies either require costly post-training on temporal annotations or rely on coarse training-free heuristics. In this work, we probe the cross-modal attention of MLLMs and uncover a perception-generation gap. Our key finding is that MLLMs often know the target interval during prefill, but lose this signal when generating the final answer. In the prefill stage, a sparse set of attention heads, which we call Temporal Grounding Heads (TG-Heads), concentrates query-to-video attention on the ground-truth interval. During autoregressive decoding, however, the answer tokens shift attention away from this interval toward visually salient but query-irrelevant segments. This observation motivates an inference-time read-then-regenerate framework. We first convert TG-Head prefill attention into a debiased frame-level relevance signal and extract the high-attention interval it highlights. We then re-invoke the MLLM with visual context restricted to this interval using video cropping. Without parameter updates or architectural changes, our framework consistently improves MiMo-VL, Qwen3-VL, and Molmo2 on three benchmarks, with gains of up to +3.5 mIoU. The project website can be found at https://ddz16.github.io/mllmsknowwhen.github.io/.

cs.CV↗
arXiv2026

Learning Spatiotemporal Sensitivity in Video LLMs via Counterfactual Reinforcement Learning

Video large language models (Video LLMs) can achieve strong video-QA accuracy without reliably tracking spatiotemporal dynamics. A model may answer a motion question from static cues, for example, and give the same prediction even after the underlying motion is reversed. Correctness-based reinforcement learning does not directly address this problem because it rewards the final answer without requiring the policy to respond to task-relevant video dynamics. We propose Counterfactual Relational Policy Optimization (CRPO), which explicitly trains Video LLMs to respond to controlled changes in the visual input. For each training example, CRPO constructs a counterfactual video, such as a horizontally flipped or temporally reversed version of the original, and jointly optimizes rollouts from both videos under a shared policy. Factual supervision anchors what the model should answer, while counterfactual supervision constrains when that answer should change: predictions should change when an intervention alters task-relevant dynamics and remain stable when the queried property is preserved. This coupling provides a direct behavioral learning signal without requiring ground-truth labels for transformed videos or annotated spatiotemporal reasoning traces, while discouraging indiscriminate answer changes. To evaluate this property, we introduce DyBench, a paired counterfactual benchmark with 3{,}014 videos and a strict pair-accuracy metric. Across paired spatiotemporal evaluations and standard video benchmarks, CRPO improves sensitivity to motion and temporal changes while improving performance on general video understanding. The gains also extend to segment reordering, a transformation never used during training, suggesting that CRPO learns sensitivity to video dynamics beyond the training interventions. The project website can be found at https://ddz16.github.io/crpo.github.io/ .

cs.CV↗
arXiv2026

Video Individual Counting and Tracking from Moving Drones: A Benchmark and Methods

Counting and tracking dense crowds in large-scale scenes is valuable yet challenging, while existing methods and datasets are largely limited to fixed cameras with small scene coverage. We introduce MovingDroneCrowd++, a large-scale video-level dataset dedicated to dense crowd counting and tracking from moving drones, captured under diverse flight altitudes, camera angles, and illumination conditions. Existing methods, however, still fail to achieve satisfactory Video Individual Counting (VIC) or Multi-Object Tracking (MOT) performance under these challenging aerial conditions. To this end, we propose GD3A (Global Density Map Decomposition via Group-wise Density Assignment) for VIC and GIA-Track (Group-wise Identity Association Tracker) for MOT. Both methods are unified under a framework that aggregates cross-frame pixel-level matches among multiple descriptors per pedestrian through group-wise density assignment (GDA) and group-wise identity association (GIA), respectively. This group-wise aggregation tolerates intra-group spatial mismatches and limits the propagation of inter-group errors. To establish reliable pixel-level descriptor correspondences across frames, we design a frame-pair-conditioned dustbin score inferred from the pedestrian descriptors of each frame pair, enabling Optimal Transport to better distinguish identity differences. Based on these matches, GD3A decomposes global density maps into shared, inflow, and outflow components, while GIA-Track establishes robust pedestrian trajectories. Experiments show that our methods achieve substantial gains in both VIC and MOT on moving-drone videos with dense crowds and complex motions, reducing counting error by 47.4% and improving tracking accuracy by 64.6%. Code, dataset, and pretrained models are available at https://github.com/fyw1999/MovingDroneCrowd.

cs.CV↗
arXiv2026

Parallel Reference-Centric Continuous-Time Relative Localization with Augmented Clamped Non-Uniform B-Splines

Accurate relative localization is critical for multi-robot cooperation. In robot groups, measurements from different robots arrive asynchronously and with clock time-offsets. Although Continuous-Time (CT) formulations have proved effective for handling asynchronous measurements in single-robot SLAM and calibration, extending CT methods to multi-robot settings faces great challenges in achieving high-accuracy, low-latency, and high-frequency performance. In particular, existing CT methods suffer from the inherent query-time delay of unclamped B-splines and high optimization latency. This paper proposes CT-RIO, a novel Continuous-Time Relative-Inertial Odometry framework. We adopt Clamped Non-Uniform B-splines (C-NUBS) to represent states, eliminating the query-time delay. We further augment C-NUBS with closed-form extension and shrinkage operations that preserve the spline shape, making it suitable for online estimation and enabling flexible knot management. This flexibility leads to the concept of a knot-keyknot strategy, which supports spline extension at high frequency while retaining sparse keyknots for adaptive relative motion modeling. We then formulate a reference-centric sliding-window relative localization problem that operates purely on relative kinematics and inter-robot constraints. To enable low-latency and high-frequency estimation, we decompose the tightly coupled optimization into robot-wise subproblems and solve them in parallel using asynchronous block coordinate descent. Extensive experiments show that CT-RIO converges from time-offsets as large as 264 ms to sub-millisecond within 3 s, and achieves RMSEs of 0.046 m and 1.8 degree. It consistently outperforms evaluated published methods, with improvements of up to 60% under high-speed motion.

cs.RO↗
arXiv2026

UniGIO: Unified Generative Global In-situ Weather Modeling from Spatiotemporal Incomplete Observations

Global In-situ Observation (GIO) provides fine-scale, direct records of the global weather system from sparse point stations, making it an indispensable source for capturing localized and transient dynamics beyond the reach of satellite gridded data, and playing a critical role in key fields such as numerical weather prediction, disaster prevention, and agriculture. However, GIO exhibits strong spatiotemporal incompleteness, severely impairing accurate and real-time in-situ weather modeling. Unlike existing methods waiting for completed AI-ready data with extra introduced errors, in this work, we explore UniGIO, a novel generative framework for directly modeling global in-situ weather dynamics from native incomplete GIO. By generating missing data from observed ones annotated by masks, it unifies the coexisting forecasting, imputation, and generation under arbitrary missing ratios. Between the missing and observed, UniGIO captures station and region level complementarity through the Observation Mixer and Event Aligner, which diffuse discrete observations into continuous spaces where weather processes naturally span multiple stations. We further establish temporal dependencies with pattern shifts using the Adaptive Temporal Mixer, and track extreme events in chaotic local weather systems through a Mixture-ofExperts structure. Steady and extreme events are adapted in decoder by a Local Refiner. Extensive experiments on the up-todate largest global station weather dataset Weather-5K validate its SOTA performance with 11%, 12%, and 5% advantages on accuracy, fidelity, and extreme event capture, delivering a novel holistic solution for weather modeling in GIO networks.

cs.LG↗
arXiv2026

Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation

Understanding camera motion is fundamental to video perception, with applications in spatial intelligence and controllable video generation. Multimodal large language models (MLLMs) provide a natural interface for this task, but existing work typically assigns one or more labels to an entire clip. Such clip-level recognition overlooks two defining properties of real camera motion: it can change within a shot, and multiple movements can occur simultaneously. We therefore formulate camera-motion understanding as temporally grounded, compositional recognition, which requires a model to localize motion-consistent intervals and identify every movement active within each interval. We introduce CamChoreo, a benchmark of 4,229 real single-shot clips with expert-annotated temporal segments. Its annotations use a compact vocabulary of 20 direction-aware labels, and nearly half of the segments contain compound camera motion, with multiple movement primitives active simultaneously. Recognizing such fine-grained, compositional motion is hard for current MLLMs, whose visual encoders emphasize semantic content rather than the geometric evidence on which camera motion depends. Directly injecting features from a frozen 3D foundation model addresses this gap, but requires running the expensive geometry model on every input; we refer to this baseline as CamInject. We instead propose CamDistill, which distills the same geometric knowledge into lightweight camera tokens during training and removes the 3D model at inference. CamDistill matches the accuracy of direct feature injection without running the 3D teacher at inference. Together, CamChoreo and CamDistill advance camera-motion understanding from clip-level labeling to temporally grounded, compositional recognition. Project page: https://ddz16.github.io/cammotion.github.io/.

cs.CV↗
arXiv2026

Archimedean Seesaw: Small Neutrino Masses and Large Lepton-number Violation

Contrary to the common lore that observable lepton-number violation (LNV) is inevitably suppressed by tiny neutrino masses, we identify a class of seesaw models in which arbitrarily large LNV can naturally coexist with sub-eV neutrino masses. We construct a symmetry-protected texture-zero structure in the neutrino Yukawa couplings and heavy Majorana mass matrix that gives rise to the required accidental symmetry, thereby protecting the light neutrinos from acquiring mass even in the presence of arbitrarily large LNV in the heavy sector. Small neutrino masses arise naturally from lifting the texture-zero structure while preserving the underlying symmetry. The resulting framework offers a rich and experimentally accessible phenomenology, predicting Heavy Neutral Leptons with sizeable active-sterile mixing over a broad range of experimentally accessible masses, giving rise to observable LNV signatures at collider and intensity-frontier experiments.

hep-ph↗
arXiv2026

Neutrino Fluxes at a Muon Collider

While muon colliders are primarily considered precision machines for new physics searches at the energy frontier, they are also intense sources of high-energy neutrinos. Large fluxes of electron and muon neutrinos are produced in the decay of beam muons, especially along the straight sections around the experiments. In this work, we re-evaluate these neutrino fluxes using the latest design of a \SI{10}{TeV} muon collider and find that fluxes around the interaction region are almost two orders of magnitude higher than earlier estimates. We also compute the fluxes of neutrinos produced in $μ^+μ^-$ collisions, electromagnetic showers induced by electrons from muon decay, and interactions of neutrinos close to the collider ring. We find that these additional neutrino sources are non-negligible and would lead to a sizable number of neutrino interactions of all flavors, including several tau neutrino events, in a ton-scale detector placed in the forward direction. We discuss the physics opportunities offered by muon collider neutrinos in the context of QCD and nuclear physics, electroweak precision measurements, and searches for new physics.

hep-ph↗
arXiv2026

polyDAG: Polynomial Acyclicity Constraints for Efficient Continuous Causal Discovery in Visual Semantic Graphs

Modern image-analysis pipelines often convert images into structured semantic variables, such as facial attributes, object concepts, and scene descriptors. Learning directed dependencies among these variables can produce interpretable visual semantic graphs, but continuous directed acyclic graph learning is limited by the cost of enforcing acyclicity. We present polyDAG, a polynomial acyclicity framework for efficient continuous causal discovery in visual semantic graphs. polyDAG replaces the matrix-exponential acyclicity constraint with a finite polynomial trace constraint and proves that the new constraint is zero exactly for acyclic graphs. We further derive a geometric-series implementation that avoids the explicit summation loop while preserving the same acyclicity condition. Experiments on synthetic Erdos-Renyi graphs and CelebA facial visual attributes show that polyDAG improves efficiency and structure recovery. Averaged over the revised synthetic protocol with d in {100, 200, 500}, polyDAG reduces mean structural Hamming distance from 318.4 to 285.4 and improves mean F1 score from 0.725 to 0.756. At 100 nodes, the geometric variant runs in 3.44 seconds compared with 5.16 seconds for the exponential baseline, corresponding to a 33.4 percent speedup. Code and data are publicly available at https://github.com/wenhaoz-fengcai/polyDAG.

cs.CV↗
arXiv2026

Information-Theoretic Adaptive Cooling for Deterministic MPPI via Entropy Feedback

This paper investigates deterministic optimal control using Model Predictive Path Integral (MPPI) control, a sampling-based and derivative-free framework well suited for systems with complex dynamics and nonsmooth objectives. In deterministic MPPI, the temperature must be driven to zero to recover the true optimum, yet the design of an effective cooling schedule remains a fundamental challenge. Existing methods typically rely on predefined open-loop schedules, which limit the efficiency and robustness of the algorithm. To overcome this limitation, we propose an Information-Theoretic Adaptive Cooling (ITAC) framework that uses the Shannon entropy of the importance weights as an online feedback signal to regulate the temperature. The proposed mechanism adapts the cooling rate to the current sampling state, enabling fast progress when the weights are diffuse and cautious cooling when they become concentrated. We prove asymptotic convergence of the resulting scheme to the deterministic optimum, and further derive a critical entropy threshold that leads to a smooth barrier against premature weight collapse. Experiments on nonsmooth signal temporal logic motion-planning tasks show that ITAC improves sampling efficiency and achieves substantially faster convergence than state-of-the-art baselines without sacrificing the derivative-free nature of MPPI.

eess.SY↗
arXiv2026

TSSM: Triaxial State Space Model for Global Station Weather Forecasting with Temporal-Variable-Historical Modeling

Global Station Weather Forecasting (GSWF) is pivotal for localized and extreme weather prediction over key regions. Despite efforts to exploit look-back windows, existing methods show limited accuracy gains and struggle with extreme events and error accumulation. These limitations stem from overreliance on short-term patterns, which are insufficient to capture chaotic weather dynamics, especially under partial observations. To address this problem, we propose a novel Triaxial State Space Model (TSSM) with a history-enhanced Temporal-VariableHistorical paradigm, which incorporates period-aligned historical weather data to compensate for long-term, large-scale periodic, and full-window weather patterns beyond the temporal lookback window. Specifically, TSSM stacks historical samples into period-aligned batches, where forecasting is causally supported by historical and current observations. Temporal, variable, and historical scanning are designed to capture axial temporal dependencies, variable correlations, and historical evolution. This structure is hierarchically shared to model seasonal to extreme events while alleviating misalignment across historical patterns. TSSM achieves SOTA performance on Weather-5K, the largest station weather dataset to date, with 10% and 61% gains in accuracy and extreme event metrics, and obtains 95% best or second-best results on human-involved datasets. Its advantages are more pronounced in long-horizon and iterative forecasting, reaching a 37.5% gain at 240h and up to 103.5% under a 48h times 5 iterative setting. Moreover, TSSM retains > 90% performance under up to 80% missing observations, compared with < 43% for baselines, demonstrating robustness and practical potential for reliable GSWF in global in-situ observation networks.

cs.LG↗
arXiv2026

Decoherence and More Coherence in the Radiative Decay of the $Z$ Boson

Final state radiation in collider processes can be interpreted as interactions with unobserved degrees of freedom and is often discussed within the context of decoherence of an entangled state. We consider the radiative decay of the $Z$ boson as a representative example and perform a detailed analytical study of the $τ^-τ^+γ$ spin state, as determined by the chiral interactions of the Standard Model, over the complete three-body phase space. We explore various quantum information observables to quantify how the $τ^-τ^+$ spin state changes with the photon radiation. We find some striking features, for example that the emitted photon could either lead to decoherence or monotonic enhancement of entanglement for the fermion pair.

hep-ph↗