arXiv subjects

Peiwen Li

Publications and source records attributed to Peiwen Li.

11 recordsLinked to original sources

arXiv2026

MoRSE: Task-Oriented Multi-Agent System with Mixture of Role-Subtask Experts

Large language model-based multi-agent systems have recently shown strong potential for complex, long-horizon tasks. However, existing methods mainly rely on coarse prompt-level differentiation without parameter adaptation for diverse subtasks, resulting in insufficient inter-agent heterogeneity and limited specialized capability that bottleneck performance on tasks with complex requirements. To address this, we introduce a Task-Oriented Multi-Agent System with Mixture of Role-Subtask Experts (MoRSE) that distinguishes agents with (role, subtask)-conditional specialization at both the task structure and parameter levels. To make agents' responsibility explicit at the task structure level, we formulate a task-oriented multi-agent system that decomposes each task into a dependency-aware Directed Acyclic Graph of subtasks and assigns each agent a specific (role, subtask), introducing task-level specialization across collaborating agents. Additionally, to address the diverse role and subtask parameter adaptation demands, we propose a dynamic Mixture of (role, subtask) LoRA Experts module with a prototype-based semantic router for subtasks, augmenting agents with parameter-level specialization on a shared LLM substrate cost-effectively. Then, to co-optimize experts and router stably under sparse task rewards, we further propose a hierarchical group-relative policy optimization with two-layer credit assignment that isolates expert updates from the cross-route variance introduced by routing decisions, disentangling expert quality from routing quality. Experiments on code-generation benchmarks across three backbones demonstrate the effectiveness of our approach, with improvements in both whole-task and step-wise performance, and the gains from trained specialization generalize across held-out task categories and domains.

cs.MA↗

arXiv2026

DA-UCT: Self-Supervised Domain-Adaptive Ultrasound Computed Tomography for Rapid Musculoskeletal Sound Speed Reconstruction

Ultrasound computed tomography (UCT) via full waveform inversion (FWI) enables high-resolution quantitative imaging for tissue characterization and disease diagnosis. However, UCT suffers from large computational burden and severe convergence issues due to highly nonlinear optimization. Deep learning can accelerate UCT reconstruction, but supervised training requires large-scale labeled datasets difficult to obtain in vivo. To address these limitations, we propose SDA-UCT, a two-stage self-supervised domain-adaptive framework for rapid and accurate UCT imaging of musculoskeletal tissues. SDA-UCT employs an attention-enhanced network (AttUCT) pre-trained on simulation datasets and transfers to in-vivo data via physics-informed self-supervised learning, effectively bridging the simulation-to-real domain gap. A Low-Rank Adaptation (LoRA) mechanism is integrated to enable efficient adaptation across diverse clinical scenarios. Results showed that AttUCT achieved high-quality SOS reconstruction for simulated human forearm with a PSNR of 29.23 dB and SSIM of 0.928, outperforming conventional FWI and existing deep learning methods. Validated on in-vivo data, SDA-UCT successfully reconstructed SOS images revealing complex anatomical structures (skin, fat, muscle, tendon, bone and bone marrow) for human forearm, in high concordance with MRI references. The LoRA mechanism adjusting only 3% of parameters achieved comparable performance to full fine-tuning. The rapid reconstruction (5 ms per frame) enables real-time 3D visualization, achieving five-orders-of-magnitude improvement over traditional FWI. This work represents the first self-supervised domain-adaptive deep learning for rapid, high-resolution in-vivo UCT imaging, showing potential for musculoskeletal disease diagnosis.

cs.CV↗

arXiv2026

Fin-RATE: A Real-world Financial Analytics and Tracking Evaluation Benchmark for LLMs on SEC Filings

With the increasing deployment of Large Language Models (LLMs) in the finance domain, LLMs are increasingly expected to parse complex regulatory disclosures. However, existing benchmarks often focus on isolated details, failing to reflect the complexity of professional analysis that requires synthesizing information across multiple documents, reporting periods, and corporate entities. Furthermore, these benchmarks do not disentangle whether errors arise from retrieval failures, generation inaccuracies, domain-specific reasoning mistakes, or misinterpretation of the query or context, making it difficult to precisely diagnose performance bottlenecks. To bridge these gaps, we introduce Fin-RATE, a benchmark built on U.S. Securities and Exchange Commission (SEC) filings and mirroring financial analyst workflows through three pathways: detail-oriented reasoning within individual disclosures, cross-entity comparison under shared topics, and longitudinal tracking of the same firm across reporting periods. We benchmark 17 leading LLMs, spanning open-source, closed-source, and finance-specialized models, under both ground-truth context and retrieval-augmented settings. Results show substantial performance degradation, with accuracy dropping by 18.60% and 14.35% as tasks shift from single-document reasoning to longitudinal and cross-entity analysis. This degradation is associated with increased comparison hallucinations, temporal and entity mismatches, and is further reflected in declines in reasoning quality and factual consistency--limitations that existing benchmarks have yet to formally categorize or quantify.

cs.CE↗

arXiv2025

BlueLM-2.5-3B Technical Report

We present BlueLM-2.5-3B, a compact and unified dense Multimodal Large Language Model (MLLM) designed for efficient edge-device deployment, offering strong general-purpose and reasoning capabilities. To the best of our knowledge, this is the first 3B-scale MLLM to support both thinking and non-thinking modes, while also enabling explicit control over thinking token budget. BlueLM-2.5-3B is developed through diversified data curation, key data resampling, hybrid heterogeneous reinforcement learning, and a high-performance training infrastructure. Our model achieves superior multimodal capacity while preserving competitive pure-text performance with only 2.9 billion parameters. We conduct comprehensive evaluations across a broad range of multimodal and text-only benchmarks. In thinking mode, BlueLM-2.5-3B achieves comparable performance to Qwen3-4B on text-only benchmarks, and trails the larger Kimi-VL-A3B-16B by only about 5% on average across multimodal evaluations. In non-thinking mode, it outperforms Qwen2.5-VL-3B on the majority of multimodal benchmarks. Additionally, BlueLM-2.5-3B exhibits exceptional data efficiency. All of the aforementioned performance is achieved with substantially less total training data than Qwen2.5-VL-3B and Qwen3-4B. We hope our work contributes to the advancement of high-performance, on-device MLLMs and provides meaningful insights to the research community.

cs.AI↗

arXiv2024

Learning to refine domain knowledge for biological network inference

Perturbation experiments allow biologists to discover causal relationships between variables of interest, but the sparsity and high dimensionality of these data pose significant challenges for causal structure learning algorithms. Biological knowledge graphs can bootstrap the inference of causal structures in these situations, but since they compile vastly diverse information, they can bias predictions towards well-studied systems. Alternatively, amortized causal structure learning algorithms encode inductive biases through data simulation and train supervised models to recapitulate these synthetic graphs. However, realistically simulating biology is arguably even harder than understanding a specific system. In this work, we take inspiration from both strategies and propose an amortized algorithm for refining domain knowledge, based on data observations. On real and synthetic datasets, we show that our approach outperforms baselines in recovering ground truth causal graphs and identifying errors in the prior knowledge with limited interventional data.

q-bio.QM↗

arXiv2024

Causal-aware Graph Neural Architecture Search under Distribution Shifts

Graph NAS has emerged as a promising approach for autonomously designing GNN architectures by leveraging the correlations between graphs and architectures. Existing methods fail to generalize under distribution shifts that are ubiquitous in real-world graph scenarios, mainly because the graph-architecture correlations they exploit might be spurious and varying across distributions. We propose to handle the distribution shifts in the graph architecture search process by discovering and exploiting the causal relationship between graphs and architectures to search for the optimal architectures that can generalize under distribution shifts. The problem remains unexplored with following challenges: how to discover the causal graph-architecture relationship that has stable predictive abilities across distributions, and how to handle distribution shifts with the discovered causal graph-architecture relationship to search the generalized graph architectures. To address these challenges, we propose Causal-aware Graph Neural Architecture Search (CARNAS), which is able to capture the causal graph-architecture relationship during the architecture search process and discover the generalized graph architecture under distribution shifts. Specifically, we propose Disentangled Causal Subgraph Identification to capture the causal subgraphs that have stable prediction abilities across distributions. Then, we propose Graph Embedding Intervention to intervene on causal subgraphs within the latent space, ensuring that these subgraphs encapsulate essential features for prediction while excluding non-causal elements. Additionally, we propose Invariant Architecture Customization to reinforce the causal invariant nature of the causal subgraphs, which are utilized to tailor generalized graph architectures. Extensive experiments demonstrate that CARNAS achieves advanced out-of-distribution generalization ability.

cs.LG↗

arXiv2024

RealTCD: Temporal Causal Discovery from Interventional Data with Large Language Model

In the field of Artificial Intelligence for Information Technology Operations, causal discovery is pivotal for operation and maintenance of graph construction, facilitating downstream industrial tasks such as root cause analysis. Temporal causal discovery, as an emerging method, aims to identify temporal causal relationships between variables directly from observations by utilizing interventional data. However, existing methods mainly focus on synthetic datasets with heavy reliance on intervention targets and ignore the textual information hidden in real-world systems, failing to conduct causal discovery for real industrial scenarios. To tackle this problem, in this paper we propose to investigate temporal causal discovery in industrial scenarios, which faces two critical challenges: 1) how to discover causal relationships without the interventional targets that are costly to obtain in practice, and 2) how to discover causal relations via leveraging the textual information in systems which can be complex yet abundant in industrial contexts. To address these challenges, we propose the RealTCD framework, which is able to leverage domain knowledge to discover temporal causal relationships without interventional targets. Specifically, we first develop a score-based temporal causal discovery method capable of discovering causal relations for root cause analysis without relying on interventional targets through strategic masking and regularization. Furthermore, by employing Large Language Models (LLMs) to handle texts and integrate domain knowledge, we introduce LLM-guided meta-initialization to extract the meta-knowledge from textual information hidden in systems to boost the quality of discovery. We conduct extensive experiments on simulation and real-world datasets to show the superiority of our proposed RealTCD framework over existing baselines in discovering temporal causal structures.

cs.AI↗

arXiv2023

In-situ Thermophysical Measurement of Flowing Molten Chloride Salt Using Modulated Photothermal Radiometry

Molten salts are a leading candidate for high-temperature heat transfer fluids (HTFs) for thermal energy storage and conversion systems in concentrated solar power (CSP) and nuclear energy power plants. The ability to probe molten salt thermal transport properties in both stationary and flowing status is important for the evaluation of their heat transfer performance under realistic operational conditions, including the temperature range and potential degradation due to corrosion and contamination. However, accurate thermal transport properties are usually challenging to obtain even for stagnant molten salts due to different sources of errors from convection, radiation, and corrosion, let alone flowing ones. To the best of authors' knowledge, there is no available in-situ technique for measuring flowing molten salt thermal conductivity. Here, we report the first in-situ flowing molten salt thermal conductivity measurement using modulated photothermal radiometry (MPR). We could successfully perform the first in-situ thermal conductivity measurement of flowing molten $NaCl-KCl-MgCl_2$ in the typical operating temperature (520 and 580 $^oC$) with flow velocities ranging from around 0.3 to 1.0 $m$$s^-1$. The relative change of the molten salt thermal conductivity was measured. Gnielinski's correlation was also used to estimate the heat transfer coefficient h of the flowing $NaCl-KCl-MgCl_2$ in the given experimental condition. The work showed the potential of the MPR technique serving as an in-situ diagnostics tool to evaluate the heat transfer performance of flowing molten salts and other high-temperature HTFs.

cond-mat.mtrl-sci↗

arXiv2023

Thermal Conductivity Measurement Using Modulated Photothermal Radiometry for Nitrate and Chloride Molten Salts

Molten salts are being used or explored for thermal energy storage and conversion systems in concentrating solar power and nuclear power plants. Thermal conductivity of molten salts is an important thermophysical property dictating the performance and cost of these systems, but its accurate measurement has been challenging, as evidenced by wide scattering of existing data in literature. The corrosive and conducting nature of these fluids also leads to time consuming sample preparation processes of many contact-based measurements. Here, we report the measurement of thermal conductivity of molten salts using a modulated photothermal radiometry (MPR) technique, which is a laser-based, non-contact, frequency-domain method adopted for molten salts for the first time. By unitizing the advantages of front side sensing of frequency-domain measurements and the vertical holder orientation, the technique can minimize the natural convection and salt creeping effects, thus yielding accurate molten salt thermal conductivity. The MPR technique is first calibrated using standard molten materials including paraffin wax and sulfur. It is then applied on measuring pure nitrate salts ($NaNO_3$ and $KNO_3$), solar salt ($NaNO_3-KNO_3$ mixture), and chloride salt ($NaCl-KCl-MgCl_2$). The measurement results are compared with data from literature, especially those obtained from laser flash analysis (LFA). Our results demonstrate that the MPR is a convenient and reliable technique of measuring thermal conductivity of molten salts. Accurate thermal conductivity data of molten salts will be valuable in developing the next-generation high-temperature thermal energy storage and conversion systems.

physics.chem-ph↗

arXiv2020

Measurement of High-temperature Thermophysical Properties of Bulk and Coatings Using Modulated Photothermal Radiometry

This paper presents the development of instrumentation for the measurement of high-temperature thermal conductivity of bulk and coatings using a modulated photothermal radiometry (MPR) method, where a sample is heated by an intensity-modulated laser to probe into different layers of the sample. While MPR has been previously established, most of the previous studies only focus on the measurement at room temperature. The MPR has not been well studied for measurements of bulk and coating materials at high temperatures, which are increasingly important for a multitude of applications, such as materials used in the concentrating solar power (CSP) plants and the nuclear reactors. MPR is a non-contact technique that utilizes the intrinsic thermal emission from the specimens for thermometry, which is favorable for measurements at high temperatures in harsh environment. The authors designed and utilized a sample holder suitable for high temperature measurement up to 973 K with good temperature uniformity within the sample. The high-temperature MPR setup was validated by measuring bulk materials with known thermal conductivity. The setup and technique were then extended to the measurement of black solar-absorbing coatings of 10 to 50 {\mu}m thick on various substrates by modulating the frequency of the laser heating beam and the thermal penetration depth. The studies showed that thermal conductivities of typical solar-absorbing coatings are 0.4 ~ 0.8 W m-1 K-1, indicating a possibly large temperature drop within the coating under high solar irradiation flux, such as over 1000-sun for central solar towers in CSP plants.

cond-mat.mtrl-sci↗

arXiv2017

Distance Descending Ordering Method: an $O(n)$ Algorithm for Inverting the Mass Matrix in Simulation of Macromolecules with Long Branches

Fixman's work in 1974 and the follow-up studies have developed a method that can factorize the inverse of mass matrix into an arithmetic combination of three sparse matrices---one of them is positive definite and need to be further factorized by using the Cholesky decomposition or similar methods. When the molecule subjected to study is of serial chain structure, this method can achieve $O(n)$ computational complexity. However, for molecules with long branches, Cholesky decomposition about the corresponding positive definite matrix will introduce massive fill-in due to its nonzero structure, which makes the calculation in scaling of $O(n^3)$. Although several methods have been used in factorizing the positive definite sparse matrices, no one could strictly guarantee for no fill-in for all molecules according to our test, and thus $O(n)$ efficiency cannot be obtained by using these traditional methods. In this paper we present a new method that can guarantee for no fill-in in doing the Cholesky decomposition, and as a result, the inverting of mass matrix will remain the $O(n)$ scaling, no matter the molecule structure has long branches or not.

physics.comp-ph↗