arXiv Science⌕ Search

arXiv subjects

Shijie Wang

Publications and source records attributed to Shijie Wang.

At least 19 recordsLinked to original sources

Interactive World Simulation with Cosmos for Physical AI

We present a shared framework that adapts Cosmos world foundation models for real-time interactive world simulation in Physical AI. By streaming visual observations in response to actions and scene controls, the framework enables users and embodied agents to interact with evolving virtual environments. It supports both predicting the visual consequences of actions and generating observations from physical state maintained by an external simulator. We demonstrate this approach across camera navigation and robot manipulation, controllable video transfer, and multi-view autonomous vehicle (AV) simulation. These examples provide a shared foundation for developing interactive virtual environments for Physical AI training and evaluation. Our code and model checkpoints are available at https://github.com/nvidia/cosmos and https://huggingface.co/collections/nvidia/cosmos3-examples. The project website is available at https://research.nvidia.com/labs/cosmos-lab/cosmos-simulation.

cs.AI↗

Coefficient Recombination and Error Estimates for the L2 Method for Subdiffusion on Nonuniform Meshes

The L2 discretization of the Caputo derivative is attractive for its high-order accuracy, but its analysis on nonuniform temporal meshes is complicated due to the lack of a monotone structure in the discrete coefficients. This difficulty is particularly significant for deriving sharp $L^2$ error estimates in the presence of the typical weak singularity of subdiffusion solutions near the initial time. In this work, we develop a coefficient-recombination framework for the L2 method on nonuniform meshes. Under the adjacent step-ratio condition $0.86\le ρ_k\le 1.16$, $k\ge2$, we prove that the recombined L2 coefficients are positive and monotone. A key ingredient is a cross-row recombination technique: with the recombination parameter associated with a fixed time level, all coefficient rows retain positivity and monotonicity, which allows us to close an induction for the $L^2$ error analysis. For solutions exhibiting the standard initial weak singularity, we derive an $L^2$ error estimate on nonuniform meshes satisfying the step-ratio condition. On a modified graded mesh with grading parameter $r>1$, the estimate yields the convergence rate $\mathcal{O}\!\left(N^{-\min\{rα,\,3-α\}}\right)$, and hence recovers the optimal order $\mathcal{O}(N^{-(3-α)})$ whenever $r\ge(3-α)/α$. Numerical experiments on random nonmonotone meshes and modified graded meshes confirm the theoretical estimates.

math.NA↗

Probing generalized equation of state for dark energy with latest cosmological probes

Baryon acoustic oscillation (BAO) measurements from DESI DR2 have strengthened indications of a time-evolving dark energy. In this paper, we investigate observational constraints on the generalized equation of state (GEoS) for dark energy, $w(a) = w_0 - w_β(a^β- 1)/β$, with latest data from UV and X-ray observations of high-redshift quasars, DESI DR2 BAO, Cosmic Microwave Background (CMB) data (including lensing) from Planck and the Atacama Cosmology Telescope (ACT), and Pantheon+ Type Ia Supernovae (SNe Ia). The full Quasar+BAO+CMB+SNe Ia data combination yields stringent constraints on the EoS parameters of $w_0=-0.840^{+0.057}_{-0.084}$, $w_β=-0.90^{+0.88}_{-0.23}$, and $β=2.2^{+2.4}_{-5.2}$. Specially, the $β$ parameter, which describe a broad range of dark energy evolution, is in perfect agreement with the Chevallier--Polarski--Linder model ($β=1$) -- the most widely used two-parameter parametrizations of dynamical dark energy. We also compare GEoS with other dynamical dark-energy parametrizations including CPL, Barboza--Alcaniz (BA) and Jassal--Bagla--Padmanabhan (JBP), and report three key findings. Firstly, we find compelling evidence for dynamical dark energy: all four EoS parametrizations yield lower information criterion (IC) values than $Λ$CDM for the full data combination, indicating a preference for EoS parametrizations under the Akaike information criterion (AIC) and the variance-based deviance information criterion (DIC). Secondly, although the unified phenomenological framework GEoS performs better than JBP, the current data do not strongly discriminate among different EoS parametrizations. Thirdly, the EoS trajectories of GEoS, CPL, and BA exhibit qualitatively similar transitions from the phantom regime at higher redshifts to the quintessence regime at late times, while the JBP parametrization exhibits a nonmonotonic evolution.

physics.gen-ph↗

Rethinking Tool Design for Agentic RCA: A Controlled Empirical Study

Large language model (LLM) agents are increasingly explored for root cause analysis (RCA) in microservice systems, yet empirical guidance on how to design and combine their tools remains limited. We conduct a controlled empirical study of tool abstraction and composition across models and microservice environments. We implement 24 structured tools for metric access (L1), evidence analysis (L2), and diagnosis (L3), alongside a Python-based reference setting (L0). Using 375 failure cases from three microservice systems, we evaluate eight configurations with Qwen3.7-Plus and compare four Qwen models on a shared subset of four configurations. Our results show that tool configurations affect root cause localization and failure type identification differently. With Qwen3.7-Plus, L3 achieves 82.8% top-1 localization accuracy compared with 85.4% for L0, while requiring less than half the time per case. Adding tool levels can improve type identification while reducing localization accuracy. Trajectory analysis reveals cases in which agents override correct diagnostic recommendations after consulting additional evidence. Model choice also changes tool benefits: adding L3 to L1+L2 improves diagnosis for three models but hurts Qwen3-8B, which rarely invokes L3. Tool configuration rankings further change across microservice systems. These findings provide an empirical foundation for designing and using RCA tools, guiding tool selection and composition according to the model, diagnostic objective, and target system.

cs.SE↗

PSM: Dataset Distillation Based on Precise Statistical Matching by Difficulty

Dataset distillation (DD) condenses a large original dataset into a small distilled dataset with high training utility. Decoupled statistical matching methods substantially reduce distillation time and memory overhead while achieving strong performance. However, they typically supervise all distilled samples using running statistics estimated from the entire original dataset. These statistics mainly capture the average feature distribution while overlooking differences in sample difficulty, limiting their ability to characterize the difficulty structure of the original data. To address this issue, we propose Precise Statistical Matching (PSM) by difficulty. After pretraining, PSM uses the Global Precision Score (GPS) to estimate image difficulty, ranks the samples within each class, and partitions each class into IPC (images per class) difficulty groups. During distillation, Statistics Updated Again (SUA) updates the teacher's batch normalization (BN) running statistics through forward passes on original samples from each group, providing difficulty-specific supervision for the corresponding distilled batch. Meanwhile, Initial Sample Screening (ISS) initializes distilled samples using original images from the corresponding difficulty group, providing an effective starting point for precise matching. Experiments across multiple datasets and model architectures demonstrate that PSM broadens the difficulty range of distilled samples and improves downstream performance in most evaluated settings. Code will be released.

cs.CV↗

Autonomous Chemical Mechanistic Discovery through Agentic Reasoning and Validation

Unraveling reaction mechanisms is central to modern chemistry, yet automating these investigations remains challenging because computational workflows still rely heavily on expert intervention. Here we introduce ARCHE, an autonomous agentic system that integrates a general-purpose reasoning model, a domain-specialized computational chemistry model, and a structured tool registry to transform mechanistic inquiry into a scalable, self-validating process. ARCHE interprets scientific questions, generates and prioritizes mechanistic hypotheses, orchestrates computational workflows, and iteratively refines conclusions based on computed evidence within a closed loop. We validate its capabilities across three increasingly demanding scenarios: reconstructing stereocontrolling transition states and validating the corresponding reaction mechanism in a previously reported asymmetric catalytic reaction; proposing and validating a plausible radical pathway through iterative hypothesis refinement for a recently discovered but unpublished $α$-iodoboronate C-I cleavage reaction; and identifying a chemically interpretable descriptor that governs selectivity in nickel-catalysed migratory cross-coupling reactions. By coupling agentic reasoning with rigorous computational validation, ARCHE advances autonomous mechanistic discovery and establishes a foundation for broader machine-assisted chemical research. The code for ARCHE is publicly available at https://github.com/JetAstra/Arche-Harness.

cs.AI↗

A Monotone Single-Index Modal Regression Powered by Deep Neural Networks for Non-Gaussian Periodontal Data

Pocket depth (PD) is a widely used biomarker for diagnosing risk of periodontal disease (PrD). However, PD typically exhibits skewness and heavy-tailedness, and its relationship with clinical risk factors is often nonlinear. Motivated by PrD studies, this paper develops a robust single-index modal regression framework for analyzing skewed and heavy-tailed data. Our method has the following novel features: (a) a flexible two-piece scale Student-$t$ error distribution that generalizes both normal and two-piece scale normal distributions; (b) a neural network with guaranteed monotonicity constraints to estimate the unknown single-index function; and (c) theoretical \revone{support}, including model identifiability and a universal approximation theorem. Our single-index model combines the flexibility of neural networks and the two-piece scaled Student-$t$ distribution, delivering robust mode-based estimation that is resistant to outliers, while retaining clinical interpretability through parametric index coefficients. We demonstrate the performance of our method through simulation studies, and an application to PrD electronic health records obtained from the HealthPartners Institute of Minnesota. The proposed methodology is implemented in the \texttt{R} package \href{https://doi.org/10.32614/CRAN.package.DNNSIM}{\texttt{DNNSIM}}.

stat.ME↗

DeCO: Discriminative Evidence Composition for Fine-Grained Dataset Distillation

Dataset distillation compresses a large training set into a compact synthetic set while preserving its downstream utility. However, existing methods primarily preserve global image statistics and may overlook the localized evidence essential for fine-grained visual classification (FGVC), such as object parts, subtle textures, and region-specific structures. We formulate fine-grained dataset distillation as budgeted discriminative-evidence preservation and propose Discriminative Evidence Composition (DeCO). DeCO uses attention rollout from a pretrained TransFG teacher to identify informative patches, applies spatial diversification to reduce redundant coverage, and organizes the resulting regions into class-wise evidence banks. Multiple same-class regions are then packed into compact grid-composed images. The teacher is used only for dataset construction, whereas downstream students are trained with standard hard-label supervision without teacher logits. Experiments on CUB-200-2011, FGVC-Aircraft, and Stanford Cars show that DeCO consistently outperforms representative coreset and dataset-distillation baselines under different IPC budgets.

cs.CV↗

FashionKG-RAG: Knowledge Graph-Enhanced Retrieval-Augmented Generation for Fashion Question Answering

Fashion is a knowledge-intensive domain in which effective decision-making depends on integrating multiple types of knowledge. Although Large Language Models (LLMs) have transformed many areas, their application in fashion remains limited by hallucinations and weak domain specialization. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) offers a promising way to add structured knowledge to LLMs. However, existing fashion KGs are typically restricted to product-level attributes or item relations, and fail to capture the broader fashion ecosystem. To bridge these gaps, we propose \textbf{FashionEcoKG}, a comprehensive, domain-wide knowledge graph built with expert-level precision and professionalism. It is constructed through a three-stage agentic pipeline that extracts high-fidelity knowledge cores from authoritative textbooks and strengthens structural connectivity through cross-domain augmentation and generative expansion. To leverage this resource, we further develop \textbf{PG-RAG} (Pruning-Grounding RAG), a training-free framework designed to handle the conceptual density and linguistic noise of fashion queries. Specifically, we introduce a Dual-Granularity Path Re-Ranking (DGPR) module of two stages. The Pruning-based Semantic Ranking (PSR) module distills each query into a skeleton form to improve retrieval recall, while the Grounding-based Agentic Ranking (GAR) performs point-wise scrutiny of candidate paths against the original full query to ensure global relevance. Experiments on a curated fashion QA dataset show that PG-RAG effectively leverages FashionEcoKG to improve retrieval and answer accuracy, outperforming both non-RAG and existing KG-RAG baselines.

cs.IR↗

Auditable agentic AI for evidence-grounded thyroid ultrasound diagnosis and reporting

Thyroid ultrasound diagnosis requires coordinated lesion localization, measurement, risk stratification and reporting, yet most AI systems address these tasks in isolation and provide limited support for clinical review. We present ThyroidXAgent, a clinician-interactive agentic AI system that coordinates specialized diagnostic tools and stores their outputs as an auditable case-level evidence record. The system was developed using OpenThyroidDB, a multicentre, multitask resource integrating approximately 0.3 million ultrasound images and 24,000 paired reports, and was evaluated on 28,458 non-overlapping test cases, including 8,721 cases from 35 centres in the private NHC-MISD-TUS cohort. Across heterogeneous datasets, ThyroidXAgent achieved a mean Dice score of 87.21 percent for nodule segmentation and a mean AUROC of 0.9466 for benign-malignant classification. The same workflow supported lymph-node metastasis prediction and follicular versus papillary thyroid carcinoma classification, with AUROCs of 0.864 and 0.805, respectively. For report generation, evidence-grounded assembly outperformed multimodal language-model baselines across three cohorts. ThyClinScore, a lesion-level clinical semantic metric introduced here, showed the strongest correlation with a location-aware language-model judge. ThyroidXAgent improved physician classification accuracy, increased report diagnostic consistency from 70.3 percent to 86.2 percent, and reduced segmentation and reporting time by 35.9 percent and 27.4 percent, respectively. These findings support auditable, clinician-correctable agentic AI for thyroid ultrasound diagnosis and reporting.

cs.AI↗

PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory

Long-context reasoning remains a critical bottleneck for large language models, as recent recurrent-memory approaches face two inherent challenges: sequential chunk-wise updates can overwrite early critical evidence with later irrelevant content, and serial inter-chunk dependencies limit parallelism and cause latency to increase with context length. To address these issues, we propose PI-Mem (Parallel-Iterative Memory), a mechanism that processes all chunks in parallel and iteratively refines a shared memory over a bounded number of turns. In each turn, PI-Mem reads all chunks in parallel conditioned on the current memory, selects new or complementary evidence from each chunk, and merges the selected evidence into a compact shared memory for the next turn. To discourage redundant turns, we optimize the workflow through reinforcement learning with an auxiliary turn-efficiency reward, enabling the model to adaptively exit once sufficient evidence has been accumulated. We evaluate PI-Mem with Qwen3.5-35B-A3B and Qwen2.5-7B on the HotpotQA benchmark across context lengths up to 3.6 million tokens and find that it outperforms the recurrent-memory baseline by +6.25 and +7.81 absolute points while achieving 6.1$\times$ and 2.1$\times$ inference speedups, respectively. These results demonstrate that PI-Mem breaks the accuracy--efficiency trade-off in long-context reasoning and provides a scalable approach to complex multi-hop question answering over extremely long documents.

cs.CL↗

ReLoop-UME: Recurrent Depth with Learnable Retrieval Registers for Universal Multimodal Embedding

Universal multimodal embedding (UME) maps heterogeneous multimodal inputs into a shared embedding space. Existing UME models either form embeddings through single forward encoding or add computation through explicit rationale tokens and latent autoregressive states. Although token expansion can improve complex matching, serial generation increases retrieval latency and makes the final embedding depend on generated intermediate states. This raises a different question: can useful computation be expanded along model depth while keeping the token workspace fixed? We analyze positive-negative similarity separation at every layer of independently trained UME models and observe a shared progression: early layers contextualize multimodal inputs, a contiguous middle-to-late stage forms retrieval-discriminative features, and the final layers map them into the embedding space. Based on this finding, we propose ReLoop-UME, which executes the early layers once, recurrently reuses a parameter-shared retrieval-forming block, and applies the final mapping layers after the last loop. Learnable Retrieval Registers provide persistent retrieval-specific states that accumulate and exchange evidence across loops, with the final register serving as the embedding readout. On MMEB-V2 and MRMR, ReLoop-UME consistently improves retrieval across different backbones while running 44.9x faster than UME-R1 and 1.5x faster than PLUME.

cs.CV↗

The conditional higher moment risk measure: second-order asymptotics with FGM contagion

This paper investigates second-order asymptotic expansions for the conditional higher moment (CoHM) coherent risk measure under a Farlie-Gumbel-Morgenstern (FGM) dependence structure, capturing a weak contagion between a primary loss risk and a reference risk. Assuming that the primary risk belongs to the Fréchet, Weibull, or Gumbel maximum domain of attraction, we systematically derive second-order asymptotic expansions using extreme value theory and second-order regular variation theory. Compared with existing first-order results, our refined approximations capture higher-order tail behavior and dependence effects more accurately. Numerical simulations confirm that the second-order asymptotics substantially reduce approximation errors, especially at extreme confidence levels. Empirical applications to insurance claim data further illustrate the practical superiority of the second-order approach.

q-fin.RM↗

Evidence-Backed Video Question Answering

Current Video Large Language Models (Video LLMs) excel in question answering (QA) but largely operate as black boxes, providing textual answers without verifiable visual grounding. Existing explainability efforts rely on textual rationales or sparse bounding boxes, which struggle to capture complex video dynamics such as occlusions and non-rigid deformations. We propose Evidence-Backed Video Question Answering (E-VQA), a novel task requiring models to jointly output a semantic answer and precise spatio-temporal evidence: temporal segments and dense, tracked object segmentation masklets. To support this, we introduce ST-Evidence, the first human-verified benchmark for both discriminative and generative pixel-level grounding. Evaluations of state-of-the-art models reveal a critical decoupling between QA accuracy and true visual perception that scaling alone fails to bridge. To address this, we develop scalable, automated generation pipelines to create ST-Evidence-Instruct, a 160k-scale dataset bridging high-level reasoning with fine-grained grounding. Fine-tuning grounded Video LLMs on this data yields substantial gains over the corresponding size-matched UniPixel baselines (e.g., +27.2 t-mean and +13.8 J&F on a 7B model), establishing a robust baseline for explainable, evidence-backed video understanding. Code and data are available at https://github.com/SalesforceAIResearch/EVQA.

cs.CV↗

Second-order Asymptotic Analysis of Tail Probabilities of Bidimensional Randomly Weighted Sums

Motivated by a bidimensional discrete-time risk model in insurance, we study second-order asymptotics for two kinds of tail probabilities of the stochastic discounted value of aggregate net losses including two business lines. These are essentially modeled as randomly weighted sums $S_n^ξ=\sum_{i=1}^nξ_iX_i$ and $T_m^η=\sum_{j=1}^mη_{j}Y_{j}$ for any fixed $n,m\in\N$, in which it is assumed that the primary random variables $\left\{\(X,Y\),\(X_i,Y_i\):i\in \N\right\}$ form a sequence of real-valued, independent and identically distributed random pairs following a common bivariate Farlie-Gumbel-Morgenstern distribution and the random weights $\left\{ξ_i,η_i:i\in \N\right\}$ are bounded, nonnegative and arbitrarily dependent, but independent of the primary random variables. Under the assumption that two marginal distributions of the primary random variables are second-order subexponential, we first obtain the second-order asymptotic formulas for the joint and sum tail probabilities, which generalize and strengthen some known ones in the literature. Furthermore, by directly applying the obtained results to the above bidimensional risk model, we establish second-order asymptotic formulas for the corresponding tail probabilities. Compared with the first-order ones, our numerical simulation shows that the second-order asymptotics are much more precise.

math.PR↗

LASER: A Corrective Lens for LVLMs via Visual Attention Preservation and Sink Suppression

Large vision-language models (LVLMs) exhibit strong reasoning ability but suffer from visual forgetting during long-horizon decoding, where attention progressively drifts away from visual evidence. Existing methods largely treat this issue as a late-stage attention decay problem or attempt to mitigate it through heuristic reminders or post-hoc attention lifting. Through systematic empirical analysis, we find that performance degradation under visual forgetting is largely driven by two overlooked factors: early-stage attention decay disrupts evidence acquisition, and attention concentration on a subset of task-irrelevant visual sink tokens. Motivated by these insights, we propose LASER, a post-training framework that regulates both the visual attention trajectory and intra-visual token attention distribution during reasoning. Technically, LASER introduces two complementary rewards: a Visual Grounding Reward, which encourages the model to maintain attention on semantically salient visual tokens throughout decoding, and a Sink Suppression Reward, which penalizes excessive attention concentration on visual sink tokens. Together, these rewards preserve early-stage grounding while preventing attention collapse onto uninformative regions. Extensive experiments on eight benchmark datasets demonstrate that LASER consistently outperforms strong baselines, validating attention-aware training as an effective remedy for visual forgetting.

cs.CV↗

Geometry-Guided Self-Supervision for Ultra-Fine-Grained Recognition with Limited Data

This paper investigates the intrinsic geometrical features of highly similar objects and introduces a general self-supervised framework called the Geometric Attribute Exploration Network (GAEor), which is designed to address the ultra-fine-grained visual categorization (Ultra-FGVC) task in data-limited scenarios. Unlike prior work that often captures subtle yet critical distinctions, GAEor generates geometric attributes as novel alternative recognition cues. These attributes are determined by various details within the object, aligned with its geometric patterns, such as the intricate vein structures in soybean leaves. Crucially, each category exhibits distinct geometric descriptors that serve as powerful cues, even among objects with minimal visual variation -- a factor largely overlooked in recent research. GAEor discovers these geometric attributes by first amplifying geometry-relevant details via visual feedback from a backbone network, then embedding the relative polar coordinates of these details into the final representation. Extensive experiments demonstrate that GAEor significantly sets new state-of-the-art records in five widely-used Ultra-FGVC benchmarks.

cs.CV↗

FD$^2$: A Dedicated Framework for Fine-Grained Dataset Distillation

Dataset distillation (DD) compresses a large training set into a small synthetic set, reducing storage and training cost, and has shown strong results on general benchmarks. Decoupled DD further improves efficiency by splitting the pipeline into pretraining, sample distillation, and soft-label generation. However, existing decoupled methods largely rely on coarse class-label supervision and optimize samples within each class in a nearly identical manner. On fine-grained datasets, this often yields distilled samples that (i) retain large intra-class variation with subtle inter-class differences and (ii) become overly similar within the same class, limiting localized discriminative cues and hurting recognition. To solve the above-mentioned problems, we propose FD$^{2}$, a dedicated framework for Fine-grained Dataset Distillation. FD$^{2}$ localizes discriminative regions and constructs fine-grained representations for distillation. During pretraining, counterfactual attention learning aggregates discriminative representations to update class prototypes. During distillation, a fine-grained characteristic constraint aligns each sample with its class prototype while repelling others, and a similarity constraint diversifies attention across same-class samples. Experiments on multiple fine-grained and general datasets show that FD$^{2}$ integrates seamlessly with decoupled DD and improves performance in most settings, indicating strong transferability. Code is available at https://github.com/Guang000/FD2.

cs.CV↗