arXiv subjects

Wenbo Cao

Publications and source records attributed to Wenbo Cao.

At least 19 recordsLinked to original sources

arXiv2026

FINCOSMOS: An Open-World Evaluation Paradigm for Agents in Finance

Language agents increasingly work for users on the open Web, and finance is where trusting them is hardest. The data must come from the Web, the strategy lives in the user's head, and correctness depends on time, so an agent can fail silently: a strategy the user never asked for, unverified data, or a backtest that uses the future yields a report as convincing as a correct one. Existing benchmarks close the world somewhere, fixing the task, the data, or the timeline, and thereby remove these failures instead of measuring them. We introduce FINCOSMOS, an open-world evaluation paradigm for agents doing financial work. A simulated user holds a hidden strategy sampled from a compositional grammar and reveals it only when asked. The agent receives no data, so it must acquire data from the Web, build its own backtest under a data cutoff, and deliver verifiable results. Grading needs no reference answer. Programs verify point-in-time correctness and recompute every reported metric, the delivered strategy is checked against the hidden specification, and a run is accepted only when the user is satisfied and none of 15 veto checks fails. Across four coding agents and a model without tools in 150 sessions, no session is accepted: every session that the simulated user signed off fails a program check, and agents raise only 54--64\% of the details they were not told. Human experts attribute 88.33\% of failures to the agents. With FINCOSMOS feedback, an agent with persistent memory learned all ten tasks.

cs.AI↗

arXiv2026

LLMs Don't Know What They Know: Benchmarking Temporal Self-Knowledge for Financial Backtesting

Financial backtests of large language models (LLMs) are meaningful only if the model did not already know the outcomes it is asked to predict. Practitioners guard against this by trusting a vendor's stated knowledge cutoff, by asking the model what it knows, or by instructing it to answer as of a past date. To verify whether any of these safeguards can be trusted, we introduce FinDendro, a benchmark of 2,226 dated U.S. facts from 1999 to 2026, covering monthly macroeconomic series, month-end stock prices and Federal Reserve decisions. Each fact yields four prompts: a value question, Recall and Predict questions that pair each candidate value with a claim of knowing or guessing without a declared date, and a Predict question with a historical declared date. Controls for persistence and dominant outcomes keep chance accuracy near 0.27. Results show that for most frontier models, self-reports understate knowledge. GPT-5 answers 76% of controlled facts correctly but claims to know 38%, and answers 61% of the facts it says it does not know. Knowledge claims can persist beyond the measured knowledge boundary, by up to seven quarters, and a declared date removes most of the claims of prior knowledge while leaving accuracy unchanged. Backtests inside a model's training window therefore cannot be certified leak-free by self-report, instruction or stated cutoff. These findings motivate behavioral measurement of temporal knowledge boundaries, and FinDendro provides a benchmark and procedure for selecting backtest periods based on demonstrated factual knowledge.

cs.CL↗

arXiv2026

Physics-informed neural networks for shock capturing in inviscid flows around an airfoil

Physics-informed neural networks (PINNs) have shown promise in solving partial differential equations (PDEs). However, shock capturing remains challenging for PINNs, particularly in steady flows around an airfoil, where shocks may not even be captured. In this study, we point out that the steady Euler equations used to construct the loss function impose weak constraints, which make it difficult to correct the continuous function approximation preference of neural networks, causing gradient descent to converge to a smooth local optimum. Based on this insight, we propose to strengthen the physical constraints by reconstructing steady shock capturing as a temporal evolution process governed by the unsteady Euler equations. The temporal evolution law of the flow field guides gradient descent, thereby alleviating its tendency to converge to smooth local optima and ensuring shock formation. We introduce a PDE loss function incorporating a pseudo-time stepping mechanism to obtain the steady state solution without solving the unsteady Euler equations over a long time interval. In addition, we develop a simplified formulation of the Euler equations to reduce the complexity of the PDE loss function, thereby improving shock capturing accuracy. By solving four forward problems involving different flow conditions and geometries, we verify that the proposed method achieves high accuracy in shock capturing while reducing the wall time to one-seventh of that required by existing advanced methods. Moreover, the proposed method demonstrates its capability to solve a parametric problem involving the angle of attack and Mach number without relying on any labeled data.

physics.flu-dyn↗

arXiv2026

Herculean: An Agentic Benchmark for Financial Intelligence

As AI agents advance, the central question is no longer whether they can solve isolated financial tasks, but whether their capabilities generalize across complete professional workflows. Existing benchmarks cannot answer this question because they evaluate either static competencies or agents within a single interaction structure. We introduce Herculean, a benchmark of end-to-end agentic financial intelligence that crosses agent architecture, backbone model, and four structurally distinct workflows: Trading, Hedging, Market Insights, and Auditing. Each workflow is implemented as an MCP skill that preserves its native state, actions, constraints, and outcome criteria, allowing intact agent systems to be evaluated under matched external conditions. Across 30 architecture--backbone configurations, we find that agent capability is not globally ordered. Workflow rankings are weakly aligned, changing the architecture frequently reverses performance under the same backbone, and each architecture concentrates failure in different forms of workflow control. These results establish that agent performance is an interaction between architecture and workflow demand, rather than an intrinsic property of the underlying model. Consequently, success on a single financial workflow provides little evidence of dependable, general financial intelligence.

cs.AI↗

arXiv2026

Online reduced-order modeling from primal solver trajectories for PDE-constrained optimization

Repeated high-fidelity state and gradient evaluations make large-scale PDE-constrained optimization computationally expensive. Reduced-order modeling provides a natural way to reduce the cost of these repeated high-dimensional computations. However, existing reduced-order modeling approaches often rely on converged high-fidelity states for model construction or updating, while their reduced spaces may lose accuracy as the design moves beyond the region represented by the available data. To address these limitations, we present Reduced-order Trajectory-based Optimization (RETO), an online framework that constructs local reduced-order models (ROMs) directly from unconverged primal solver trajectories. Each local ROM is built from snapshots collected during a finite number of high-fidelity primal iterations, without requiring full-order convergence, and supports multiple low-cost state evaluations, adjoint-based gradient evaluations, and design updates. New solver trajectories are generated at updated design points to reconstruct the local ROM and continue the optimization. Across three distinct PDE-constrained optimization problems, RETO achieves solution quality comparable to that of full-order optimization, with speedups of approximately 8 to 22 times in cases without discontinuities in the state fields. Even in the transonic inverse-design case involving moving shocks, RETO retains an approximately threefold speedup. The transonic results further show that the online local ROM progressively captures evolving shock-related flow features as new primal solver trajectories are incorporated. These results demonstrate the value of unconverged primal solver trajectories as an online information source for reduced-order optimization, allowing the reduced basis to evolve with the design rather than requiring a basis that covers the entire design space in advance.

physics.comp-ph↗

arXiv2026

A Physics-Driven Framework for Parametric Periodic-Flow Modeling and Finite-Amplitude Aeroelastic Response Analysis

Periodic unsteady flows are common in forced-motion and fluid-structure interaction problems. Their parametric analysis typically requires repeated high-fidelity simulations, whereas existing reduced-order and surrogate models generally rely on pre-generated flow-field or aerodynamic data. This study proposes a purely physics-driven framework for solving parametric periodic flows and finite-amplitude aeroelastic responses. First, a Periodic Physics-Informed Neural Network (P-PINN) is developed to directly solve periodic flows by imposing temporal periodicity over a single motion cycle, thereby avoiding the need to resolve the long transient evolution preceding the establishment of the periodic state. The flow conditions and motion parameters are further incorporated as network inputs to construct continuous parametric representations of the periodic flow field and aerodynamic forces. On this basis, the parametric aerodynamic model is coupled with the structural dynamic equation through first-order harmonic balance to solve the response amplitude and frequency of a single-degree-of-freedom aeroelastic system. This framework is validated using forced-motion cases of a circular cylinder and an airfoil, demonstrating accurate reproduction of periodic aerodynamic forces, surface load distributions, and instantaneous flow fields under different flow and motion parameters compared with time-marching results. Furthermore, aeroelastic analysis is conducted for an elastically mounted circular cylinder at subcritical Reynolds numbers, and the resulting aeroelastic response agrees well with fully coupled CFD/CSD results. Once trained offline, the parametric model can be repeatedly evaluated for different structural parameter states, enabling the complete aeroelastic response curve to be obtained online within seconds, without repeated long-time fluid-structure interaction time marching.

physics.comp-ph↗

arXiv2026

Single-condition neural solvers encode transferable response spaces for parametric differential equations

Operator learning for parametric partial differential equations (PDEs) typically builds global models over prescribed domains, requiring cross-condition data or costly physics-constrained training. Here we show that the output Jacobian of a neural solution model trained at one condition defines a reusable response space for cross-condition solution variations. We introduce Linearized Subspace Transfer (LST) to exploit this space and recover target solutions by minimizing the target PDE-system residual over response-space coordinates. Because any single response space has finite coverage, Active Transfer Modeling (ATM) uses post-transfer residuals as coverage indicators to selectively acquire response spaces from additional single-condition models. Across six systems, single-condition response spaces supported cross-condition transfer, with enrichment improving accuracy when added spaces expanded representation capacity. Relative to evaluated physics-informed operator baselines, ATM reduced error and offline construction cost, with orders-of-magnitude accuracy gains in representative cases and millisecond-to-second target adaptation. These results establish neural solvers as reusable local parametric models.

cs.LG↗

arXiv2026

Linearized subspace refinement framework to expose hidden accuracy in trained neural networks

Neural networks trained by gradient-based methods often exhibit optimization-induced accuracy plateaus in scientific machine learning tasks. We present Linearized Subspace Refinement (LSR), an architecture-agnostic post-training framework that exploits the local linearized model at a fixed trained state. By solving a reduced direct least-squares problem in a Jacobian-defined low-dimensional space, LSR computes a subspace-optimal linearized correction and yields a refined predictor with markedly improved accuracy. Across function approximation, data-driven operator learning, physics-informed operator fine-tuning, and noisy inverse problems, LSR shows that standard nonlinear training can remain far above this subspace-attainable error level. Similar accuracy plateaus persist even for the convex quadratic problem from local linearization when solved with standard iterative optimizers, identifying numerical ill-conditioning as a primary bottleneck. LSR frequently delivers order-of-magnitude error reductions, while the subspace rank provides an explicit capacity-control mechanism that balances correction strength, numerical stability, and noise sensitivity. Together, LSR exposes conditioning-limited attainable accuracy in trained-state linearized models and provides direct access to it.

cs.LG↗

arXiv2026

FinTrace: Holistic Trajectory-Level Evaluation of LLM Tool Calling for Long-Horizon Financial Tasks

Recent studies demonstrate that tool-calling capability enables large language models (LLMs) to interact with external environments for long-horizon financial tasks. While existing benchmarks have begun evaluating financial tool calling, they focus on limited scenarios and rely on call-level metrics that fail to capture trajectory-level reasoning quality. To address this gap, we introduce FinTrace, a benchmark comprising 800 expert-annotated trajectories spanning 34 real-world financial task categories across multiple difficulty levels. FinTrace employs a rubric-based evaluation protocol with nine metrics organized along four axes -- action correctness, execution efficiency, process quality, and output quality -- enabling fine-grained assessment of LLM tool-calling behavior. Our evaluation of 13 LLMs reveals that while frontier models achieve strong tool selection, all models struggle with information utilization and final answer quality, exposing a critical gap between invoking the right tools and reasoning effectively over their outputs. To move beyond diagnosis, we construct FinTrace-Training, the first trajectory-level preference dataset for financial tool-calling, containing 8,196 curated trajectories with tool-augmented contexts and preference pairs. We fine-tune Qwen-3-8B/32B using supervised fine-tuning followed by direct preference optimization (DPO) and show that training on FinTrace-Training consistently improves intermediate reasoning metrics, with DPO more effectively suppressing failure modes. However, end-to-end answer quality remains a bottleneck, indicating that trajectory-level improvements do not yet fully propagate to final output quality.

cs.AI↗

arXiv2026

Verified residual-specific explicit derivative kernels for physics-informed learning and discretized PDE adjoints

Derivative computation is central to scientific computing, from space-time derivatives in physics-informed neural networks (PINNs) to residual Jacobian actions and discrete-adjoint operators in computational fluid dynamics (CFD). General-purpose automatic differentiation (AD) reduces implementation effort, but can incur substantial runtime and memory overhead for high-order residuals and complex discretized operators. Explicit derivative kernels can exploit problem-specific structure and provide efficient, controllable evaluations, but their use has been limited by derivation and implementation costs. This work revisits explicit differentiation (ED) as a residual-specific and verifiable route enabled by agent-assisted implementation and stringent numerical verification. For PINNs, we propose residual-specific partial-jet propagation, which makes the derivative-state closure of the target PDE residual explicit and realizes it through specialized layerwise kernels, rather than relying only on nested AD or a generic Taylor-mode transform. Relative to nested AD, the resulting ED kernels achieve floating-point-level agreement in residual and parameter-gradient evaluations and accelerate complete PINN training, often reaching 2-4x speedups while reducing peak GPU memory in most cases. For discretized PDE adjoints, we apply the same verification-driven strategy to a finite-volume CFD residual. The generated tangent-action and transpose-action kernels pass Taylor-remainder, inner-product, and reduced-gradient consistency checks, and are embedded into a GPU-resident discrete-adjoint workflow for freestream Mach-number and angle-of-attack inversion. These results suggest that verified explicit derivative kernels, supported by agent-assisted implementation, can serve as a practical, structure-aware complement to general-purpose AD for derivative-intensive scientific computing.

physics.comp-ph↗

arXiv2026

Optimization-Based Discovery of A Non-Attracting Flow State in An Oscillating-Cylinder Wake

In the flow past a stationary circular cylinder, the classical Karman vortex street arises from a Hopf bifurcation of the steady flow at the critical Reynolds number. Although this solution becomes dynamically unstable beyond this point, it remains an exact solution of the governing equations. Motivated by this observation, we investigates whether similar non-attracting flow solutions exist in the flow past a forced oscillating cylinder at supercritical Re. In the present study, while employing PINNs to investigate the flow past a forced oscillating cylinder, we identify a class of flow solutions that are inaccessible through direct time-stepping simulations. The obtained solution remains phase-locked with the cylinder oscillation frequency, despite the corresponding parameters lying outside the lock-in regime. To verify this solution, the obtained PINNs solution is used as the initial guess for an optimization based on the optimizing a discrete loss (ODIL) framework. The results show that the solution can be consistently maintained during the optimization process. This indicates that the solution is self-consistent in the optimization sense, although it does not an attracting state of the original dynamical system. To understand the reason, we compare the numerical evolution mechanisms of each solvers. The results indicate that, flow states that satisfy the governing equations but are dynamically non-attracting can be identified and maintained as minima of the optimization problem. For the flow past a forced oscillating cylinder, non-attracting periodic solutions that satisfy the governing equations exist in addition to the attracting states obtained by conventional time-stepping simulations. Optimization-based solvers can therefore reveal such flow states that are difficult to obtain through direct time integration, providing a new perspective for understanding complex wake dynamics.

physics.flu-dyn↗

arXiv2026

Solving compressible Navier-Stokes equations using the feature-enhanced neural network

Physics-informed neural networks (PINNs) have shown remarkable prospects in solving partial differential equations (PDEs) involving fluid mechanics. However, the method has so far succeeded only in inviscid flows and incompressible viscous flows, while the solution of compressible viscous flows still faces significant challenges. In previous work, we proposed a feature-enhanced neural network (FENN), which enhances the ability of PINNs to approximate flows by introducing beneficial features into the network inputs, thereby improving the performance in solving PDEs. In this study, we extend FENN to compressible viscous flows, which are governed by the compressible Navier-Stokes equations including the continuity, momentum, and energy equations. By solving four forward problems under different flow conditions and geometries together with a parametric problem involving angle of attack, we validate the effectiveness of FENN. In contrast, existing advanced methods that are well established for inviscid flows and incompressible viscous flows fail in this scenario. To the best of our knowledge, this is the first time that a PINN-like method has successfully solved forward and parametric problems involving compressible viscous flows.

physics.flu-dyn↗

arXiv2025

Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows

Despite advances in scientific AI, a coherent framework for Scientific General Intelligence (SGI)-the ability to autonomously conceive, investigate, and reason across scientific domains-remains lacking. We present an operational SGI definition grounded in the Practical Inquiry Model (PIM: Deliberation, Conception, Action, Perception) and operationalize it via four scientist-aligned tasks: deep research, idea generation, dry/wet experiments, and experimental reasoning. SGI-Bench comprises over 1,000 expert-curated, cross-disciplinary samples inspired by Science's 125 Big Questions, enabling systematic evaluation of state-of-the-art LLMs. Results reveal gaps: low exact match (10--20%) in deep research despite step-level alignment; ideas lacking feasibility and detail; high code executability but low execution result accuracy in dry experiments; low sequence fidelity in wet protocols; and persistent multimodal comparative-reasoning challenges. We further introduce Test-Time Reinforcement Learning (TTRL), which optimizes retrieval-augmented novelty rewards at inference, enhancing hypothesis novelty without reference answer. Together, our PIM-grounded definition, workflow-centric benchmark, and empirical insights establish a foundation for AI systems that genuinely participate in scientific discovery.

cs.AI↗

arXiv2025

A matrix preconditioning framework for physics-informed neural networks based on adjoint method

Physics-informed neural networks (PINNs) have recently emerged as a popular approach for solving forward and inverse problems involving partial differential equations (PDEs). Compared to fully connected neural networks, PINNs based on convolutional neural networks offer advantages in the hard enforcement of boundary conditions and in reducing the computational cost of partial derivatives. However, the latter still struggles with slow convergence and even failure in some scenarios. In this study, we propose a matrix preconditioning method to improve the convergence of the latter. Specifically, we combine automatic differentiation with matrix coloring to compute the Jacobian matrix of the PDE system, which is used to construct the preconditioner via incomplete LU factorization. We subsequently use the preconditioner to scale the PDE residual in the loss function in order to reduce the condition number of the Jacobian matrix, which is key to improving the convergence of PINNs. To overcome the incompatibility between automatic differentiation and triangular solves in the preconditioning, we also design a framework based on the adjoint method to compute the gradients of the loss function with respect to the network parameters. By numerical experiments, we validate that the proposed method successfully and efficiently solves the multi-scale problem and the high Reynolds number problem, in both of which PINNs fail to obtain satisfactory results.

math.NA↗

arXiv2025

Overcoming the Loss Conditioning Bottleneck in Optimization-Based PDE Solvers: A Novel Well-Conditioned Loss Function

Optimization-based PDE solvers that minimize scalar loss functions have gained increasing attention in recent years. These methods either define the loss directly over discrete variables, as in Optimizing a Discrete Loss (ODIL), or indirectly through a neural network surrogate, as in Physics-Informed Neural Networks (PINNs). However, despite their promise, such methods often converge much more slowly than classical iterative solvers and are commonly regarded as inefficient. This work provides a theoretical insight, attributing the inefficiency to the use of the mean squared error (MSE) loss, which implicitly forms the normal equations, squares the condition number, and severely impairs optimization. To address this, we propose a novel Stabilized Gradient Residual (SGR) loss. By tuning a weight parameter, it flexibly modulates the condition number between the original system and its normal equations, while reducing to the MSE loss in the limiting case. We systematically benchmark the convergence behavior and optimization stability of the SGR loss within both the ODIL framework and PINNs-employing either numerical or automatic differentiation-and compare its performance against classical iterative solvers. Numerical experiments on a range of benchmark problems demonstrate that, within the ODIL framework, the proposed SGR loss achieves orders-of-magnitude faster convergence than the MSE loss. Further validation within the PINNs framework shows that, despite the high nonlinearity of neural networks, SGR consistently outperforms the MSE loss. These theoretical and empirical findings help bridge the performance gap between classical iterative solvers and optimization-based solvers, highlighting the central role of loss conditioning, and provide key insights for the design of more efficient PDE solvers.

cs.CE↗

arXiv2025

FENN: Feature-enhanced neural network for solving partial differential equations involving fluid mechanics

Physics-informed neural networks (PINNs) have shown remarkable prospects in solving forward and inverse problems involving partial differential equations (PDEs). However, PINNs still face the challenge of high computational cost in solving strongly nonlinear PDEs involving fluid dynamics. In this study, inspired by the input design in surrogate modeling, we propose a feature-enhanced neural network. By introducing geometric features including distance and angle or physical features including the solution of the potential flow equation in the inputs of PINNs, FENN can more easily learn the flow, resulting in better performance in terms of both accuracy and efficiency. We establish the feature networks in advance to avoid the invalid PDE loss in FENN caused by neglecting the partial derivatives of the features with respect to space-time coordinates. Through five numerical experiments involving forward, inverse, and parametric problems, we verify that FENN generally reduces the computational cost of PINNs by approximately four times. In addition, the numerical experiments also demonstrate that the proposed method can reduce the number of observed data for inverse problem and successfully solve the parametric problem where PINNs fail.

physics.flu-dyn↗

arXiv2025

Solving all laminar flows around airfoils all-at-once using a parametric neural network solver

Recent years have witnessed increasing research interests of physics-informed neural networks (PINNs) in solving forward, inverse, and parametric problems governed by partial differential equations (PDEs). Despite their promise, PINNs still face significant challenges in many scenarios due to ill-conditioning. Time-stepping-oriented neural network (TSONN) addresses this by reformulating the ill-conditioned optimization problem into a series of well-conditioned sub-problems, greatly improving its ability to handle complex scenarios. This paper presents a new solver for laminar flow around airfoils based on TSONN and mesh transformation, validated across various test cases. Specifically, the solver achieves mean relative errors of approximately 3.6% for lift coefficients and 1.4% for drag coefficients. Furthermore, this paper extends the solver to parametric problems involving flow conditions and airfoil shapes, covering nearly all laminar flow scenarios in engineering. The shape parameter space is defined as the union of 30% perturbations applied to each airfoil in the UIUC airfoil database, with Reynolds numbers ranging from 100 to 5000 and angles of attack spanning from -5° to 15°. The parametric solver solves all laminar flows within the parameter space in just 4.6 day, at approximately 40 times the computational cost of solving a single flow. The model training involves hundreds of millions of flow conditions and airfoil shapes, ultimately yielding a surrogate model with strong generalization capability that does not require labeled data. Specifically, the surrogate model achieves average errors of 4.6% for lift coefficients and 1.1% for drag coefficients, demonstrating its potential for high generalizability, cost-effectiveness, and efficiency in addressing high-dimensional parametric problems and surrogate modeling.

physics.flu-dyn↗

arXiv2024

Physics Informed Neural Networks (PINNs) as intelligent computing technique for solving partial differential equations: Limitation and Future prospects

In recent years, Physics-Informed Neural Networks (PINNs) have become a representative method for solving partial differential equations (PDEs) with neural networks. PINNs provide a novel approach to solving PDEs through optimization algorithms, offering a unified framework for solving both forward and inverse problems. However, some limitations in terms of solution accuracy and generality have also been revealed. This paper systematically summarizes the limitations of PINNs and identifies three root causes for their failure in solving PDEs: (1) Poor multiscale approximation ability and ill-conditioning caused by PDE losses; (2) Insufficient exploration of convergence and error analysis, resulting in weak mathematical rigor; (3) Inadequate integration of physical information, causing mismatch between residuals and iteration errors. By focusing on addressing these limitations in PINNs, we outline the future directions and prospects for the intelligent computing of PDEs: (1) Analysis of ill-conditioning in PINNs and mitigation strategies; (2) Improvements to PINNs by enforcing temporal causality; (3) Empowering PINNs with classical numerical methods.

physics.comp-ph↗