arXiv subjects

Xiaojie Wang

Publications and source records attributed to Xiaojie Wang.

At least 55 records · Page 3Linked to original sources

arXiv2025

Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation

Nearly all human work is collaborative; thus, the evaluation of real-world NLP applications often requires multiple dimensions that align with diverse human perspectives. As real human evaluator resources are often scarce and costly, the emerging "LLM-as-a-judge" paradigm sheds light on a promising approach to leverage LLM agents to believably simulate human evaluators. Yet, to date, existing LLM-as-a-judge approaches face two limitations: persona descriptions of agents are often arbitrarily designed, and the frameworks are not generalizable to other tasks. To address these challenges, we propose MAJ-EVAL, a Multi-Agent-as-Judge evaluation framework that can automatically construct multiple evaluator personas with distinct dimensions from relevant text documents (e.g., research papers), instantiate LLM agents with the personas, and engage in-group debates with multi-agents to Generate multi-dimensional feedback. Our evaluation experiments in both the educational and medical domains demonstrate that MAJ-EVAL can generate evaluation results that better align with human experts' ratings compared with conventional automated evaluation metrics and existing LLM-as-a-judge methods.

cs.CL↗

arXiv2025

Uniform-in-time weak error estimates of explicit full-discretization schemes for SPDEs with non-globally Lipschitz coefficients

This article is devoted to long-time weak approximations of stochastic partial differential equations (SPDEs) evolving in a bounded domain $\mathcal{D} \subset \mathbb{R}^d$, $d \leq 3$, with non-globally Lipschitz and possibly non-contractive coefficients. Both the space-time white noise ($d=1$) and the trace-class noise in multiple dimensions $d=2,3$ are examined for the considered SPDEs. Based on a spectral Galerkin spatial semi-discretization, we propose a class of novel full-discretization schemes of exponential type, which are explicit, easily implementable and preserve the ergodicity of the original dissipative SPDEs with possibly non-contractive coefficients. The uniform-in-time weak approximation errors are carefully analyzed in a low regularity and non-contractive setting, with uniform-in-time weak convergence rates obtained. A key ingredient is to establish the uniform-in-time moment bounds (in $L^{4q-2}$-norm, $q \geq 1$) for the proposed fully discrete schemes in a super-linear setting. This is highly non-trivial for the explicit full-discretization schemes and new arguments are elaborated by fully exploiting a contractive property of the semi-group in $L^{4q-2}$, the dissipativity of the nonlinearity and the particular benefit of the taming strategy. Numerical experiments are finally reported to verify the theoretical findings.

math.NA↗

arXiv2025

SMAR: Soft Modality-Aware Routing Strategy for MoE-based Multimodal Large Language Models Preserving Language Capabilities

Mixture of Experts (MoE) architectures have become a key approach for scaling large language models, with growing interest in extending them to multimodal tasks. Existing methods to build multimodal MoE models either incur high training costs or suffer from degraded language capabilities when adapting pretrained models. To address this, we propose Soft ModalityAware Routing (SMAR), a novel regularization technique that uses Kullback Leibler divergence to control routing probability distributions across modalities, encouraging expert specialization without modifying model architecture or heavily relying on textual data. Experiments on visual instruction tuning show that SMAR preserves language ability at 86.6% retention with only 2.5% pure text, outperforming baselines while maintaining strong multimodal performance. Our approach offers a practical and efficient solution to balance modality differentiation and language capabilities in multimodal MoE models.

cs.CL↗

arXiv2025

Evaluating MLLMs with Multimodal Multi-image Reasoning Benchmark

With enhanced capabilities and widespread applications, Multimodal Large Language Models (MLLMs) are increasingly required to process and reason over multiple images simultaneously. However, existing MLLM benchmarks focus either on single-image visual reasoning or on multi-image understanding tasks with only final-answer evaluation, leaving the reasoning capabilities of MLLMs over multi-image inputs largely underexplored. To address this gap, we introduce the $\textbf{Multimodal Multi-image Reasoning Benchmark (MMRB)}$, the first benchmark designed to evaluate structured visual reasoning across multiple images. MMRB comprises $\textbf{92 sub-tasks}$ covering spatial, temporal, and semantic reasoning, with multi-solution, CoT-style annotations generated by GPT-4o and refined by human experts. A derivative subset is designed to evaluate multimodal reward models in multi-image scenarios. To support fast and scalable evaluation, we propose a sentence-level matching framework using open-source LLMs. Extensive baseline experiments on $\textbf{40 MLLMs}$, including 9 reasoning-specific models and 8 reward models, demonstrate that open-source MLLMs still lag significantly behind commercial MLLMs in multi-image reasoning tasks. Furthermore, current multimodal reward models are nearly incapable of handling multi-image reward ranking tasks.

cs.CV↗

arXiv2025

Enhancing Complex Instruction Following for Large Language Models with Mixture-of-Contexts Fine-tuning

Large language models (LLMs) exhibit remarkable capabilities in handling natural language tasks; however, they may struggle to consistently follow complex instructions including those involve multiple constraints. Post-training LLMs using supervised fine-tuning (SFT) is a standard approach to improve their ability to follow instructions. In addressing complex instruction following, existing efforts primarily focus on data-driven methods that synthesize complex instruction-output pairs for SFT. However, insufficient attention allocated to crucial sub-contexts may reduce the effectiveness of SFT. In this work, we propose transforming sequentially structured input instruction into multiple parallel instructions containing subcontexts. To support processing this multi-input, we propose MISO (Multi-Input Single-Output), an extension to currently dominant decoder-only transformer-based LLMs. MISO introduces a mixture-of-contexts paradigm that jointly considers the overall instruction-output alignment and the influence of individual sub-contexts to enhance SFT effectiveness. We apply MISO fine-tuning to complex instructionfollowing datasets and evaluate it with standard LLM inference. Empirical results demonstrate the superiority of MISO as a fine-tuning method for LLMs, both in terms of effectiveness in complex instruction-following scenarios and its potential for training efficiency.

cs.CL↗

arXiv2025

Perturbation estimates for order-one strong approximations of SDEs without globally monotone coefficients

To obtain strong convergence rates of numerical schemes, an overwhelming majority of existing works impose a global monotonicity condition on coefficients of SDEs. Nevertheless, there are still many SDEs from applications that do not have globally monotone coefficients. As a recent breakthrough, the authors of [Hutzenthaler, Jentzen, Ann. Probab., 2020] originally presented a perturbation theory for stochastic differential equations (SDEs), which is crucial to recovering strong convergence rates of numerical schemes in a non-globally monotone setting. However, only a convergence rate of order 1/2 was obtained there for time-stepping schemes such as a stopped increment-tamed Euler-Maruyama (SITEM) method. An interesting question arises, also raised by the aforementioned work, as to whether a higher convergence rate than 1/2 can be obtained when higher order schemes are used. The present work attempts to give a positive answer to this question. To this end, we develop some new perturbation estimates that are able to reveal the order-one strong convergence of numerical methods. As the first application of the newly developed estimates, we identify the expected order-one pathwise uniformly strong convergence of the SITEM method for additive noise driven SDEs and multiplicative noise driven second order SDEs with non-globally monotone coefficients. As the other application, we propose and analyze a positivity preserving explicit Milstein-type method for Lotka-Volterra competition model driven by multi-dimensional noise, with a pathwise uniformly strong convergence rate of order one recovered under mild assumptions. These obtained results are completely new and significantly improve the existing theory. Numerical experiments are also provided to confirm the theoretical findings.

math.NA↗

arXiv2025

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models

Large language models (LLMs) exhibit remarkable capabilities in natural language processing but face catastrophic forgetting when learning new tasks, where adaptation to a new domain leads to a substantial decline in performance on previous tasks. In this paper, we propose Controlled LoRA (CLoRA), a sub-space regularization method on LoRA structure. Aiming to reduce the scale of output change while introduce minimal constraint on model capacity, CLoRA imposes constraint on the direction of updating matrix's null space. Experimental results on one-stage LLM finetuning tasks and continual learning settings highlight the superority of CLoRA as a effective parameter efficient finetuning method with catastrophic forgetting mitigating.Further investigation for model parameters indicates that CLoRA effectively balances the trade-off between model capacity and degree of forgetting.

cs.CL↗

arXiv2025

A Two-Stage Imaging Framework Combining CNN and Physics-Informed Neural Networks for Full-Inverse Tomography: A Case Study in Electrical Impedance Tomography (EIT)

Electrical Impedance Tomography (EIT) is a highly ill-posed inverse problem, with the challenge of reconstructing internal conductivities using only boundary voltage measurements. Although Physics-Informed Neural Networks (PINNs) have shown potential in solving inverse problems, existing approaches are limited in their applicability to EIT, as they often rely on impractical prior knowledge and assumptions that cannot be satisfied in real-world scenarios. To address these limitations, we propose a two-stage hybrid learning framework that combines Convolutional Neural Networks (CNNs) and PINNs. This framework integrates data-driven and model-driven paradigms, blending supervised and unsupervised learning to reconstruct conductivity distributions while ensuring adherence to the underlying physical laws, thereby overcoming the constraints of existing methods.

cs.LG↗

arXiv2025

On modified Euler methods for McKean-Vlasov stochastic differential equations with super-linear coefficients

We introduce a new class of numerical methods for solving McKean-Vlasov stochastic differential equations, which are relevant in the context of distribution-dependent or mean-field models, under super-linear growth conditions for both the drift and diffusion coefficients. Under certain non-globally Lipschitz conditions, the proposed numerical approaches have half-order convergence in the strong sense to the corresponding system of interacting particles associated with McKean-Vlasov SDEs. By leveraging a result on the propagation of chaos, we establish the full convergence rate of the modified Euler approximations to the solution of the McKean-Vlasov SDEs. Numerical experiments are included to validate the theoretical results.

math.NA↗

arXiv2025

Projected Langevin Monte Carlo algorithms in non-convex and super-linear setting

It is of significant interest in many applications to sample from a high-dimensional target distribution $π$ with the density $π(\text{d} x) \propto e^{-U(x)} (\text{d} x) $, based on the temporal discretization of the Langevin stochastic differential equations (SDEs). In this paper, we propose an explicit projected Langevin Monte Carlo (PLMC) algorithm with non-convex potential $U$ and super-linear gradient of $U$ and investigate the non-asymptotic analysis of its sampling error in total variation distance. Equipped with time-independent regularity estimates for the associated Kolmogorov equation, we derive the non-asymptotic bounds on the total variation distance between the target distribution of the Langevin SDEs and the law induced by the PLMC scheme with order $\mathcal{O}(d^{\max\{3γ/2 , 2γ-1 \}} h |\ln h|)$, where $d$ is the dimension of the target distribution and $γ\geq 1$ characterizes the growth of the gradient of $U$. In addition, if the gradient of $U$ is globally Lipschitz continuous, an improved convergence order of $\mathcal{O}(d^{3/2} h)$ for the classical Langevin Monte Carlo (LMC) scheme is derived with a refinement of the proof based on Malliavin calculus techniques. To achieve a given precision $ε$, the smallest number of iterations of the PLMC algorithm is proved to be of order ${\mathcal{O}}\big(\tfrac{d^{\max\{3γ/2 , 2γ-1 \}}}ε \ \cdot \ln (\tfrac{d}ε) \cdot \ln (\tfrac{1}ε) \big)$. In particular, the classical Langevin Monte Carlo (LMC) scheme with the non-convex potential $U$ and the globally Lipschitz gradient of $U$ can be guaranteed by order ${\mathcal{O}}\big(\tfrac{d^{3/2}}ε \cdot \ln (\tfrac{1}ε) \big)$. Numerical experiments are provided to confirm the theoretical findings.

math.NA↗

arXiv2025

6G Communication New Paradigm: The Integration of Unmanned Aerial Vehicles and Intelligent Reflecting Surfaces

With the continuous development of Intelligent Reflecting Surfaces (IRSs) and Unmanned Aerial Vehicles (UAVs), their combination has become foundational technologies to complement the terrestrial network by providing communication enhancement services for large-scale users. This article provides a comprehensive overview of IRS-assisted UAV communications for 6th-Generation (6G) networks. First, the applications supported by IRS-assisted UAV communications for 6G networks are introduced, and key issues originated from applications supported by IRSs and UAVs for 6G networks are summarized and analyzed. Then, prototypes and main technologies related to the integration of IRSs and UAVs are introduced. Driven by applications and technologies of IRS-assisted UAV communications, existing solutions in the realms of energy-constrained communications, secure communications, and enhanced communications are summarized, and corresponding empirical lessons are provided. Finally, we discuss some research challenges and open issues in IRS-assisted UAV communications, offering directions for the future development.

cs.NI↗

arXiv2025

Order-one explicit approximations of random periodic solutions of semi-linear SDEs with multiplicative noise

This paper is devoted to order-one explicit approximations of random periodic solutions to multiplicative noise driven stochastic differential equations (SDEs) with non-globally Lipschitz coefficients. The existence of the random periodic solution is demonstrated as the limit of the pull-back of the discretized SDE. A novel approach is introduced to analyze mean-square error bounds of the proposed scheme that does not depend on a prior high-order moment bounds of the numerical approximations. Under mild assumptions, the proposed scheme is proved to achieve an expected order-one mean square convergence in the infinite time horizon. Numerical examples are finally provided to verify the theoretical results.

math.PR↗

arXiv2024

Strong convergence rates for a full discretization of stochastic wave equation with nonlinear damping

The paper establishes the strong convergence rates of a spatio-temporal full discretization of the stochastic wave equation with nonlinear damping in dimension one and two. We discretize the SPDE by applying a spectral Galerkin method in space and a modified implicit exponential Euler scheme in time. The presence of the super-linearly growing damping in the underlying model brings challenges into the error analysis. To address these difficulties, we first achieve upper mean-square error bounds, and then obtain mean-square convergence rates of the considered numerical solution. This is done without requiring the moment bounds of the full approximations. The main result shows that, in dimension one, the scheme admits a convergence rate of order $\tfrac12$ in space and order $1$ in time. In dimension two, the error analysis is more subtle and can be done at the expense of an order reduction due to an infinitesimal factor. Numerical experiments are performed and confirm our theoretical findings.

math.NA↗

arXiv2024

Detection of extended X-ray emission around the PeVatron microquasar V4641 Sgr with XRISM

A recent report on the detection of very-high-energy gamma rays from V4641 Sagittarii (V4641 Sgr) up to ~0.8 peta-electronvolt has made it the second confirmed "PeVatron" microquasar. Here we report on the observation of V4641 Sgr with X-Ray Imaging and Spectroscopy Mission (XRISM) in September 2024. Thanks to the large field of view and low background, the CCD imager Xtend successfully detected for the first time X-ray extended emission around V4641 Sgr with a significance of > 4.5 sigma and > 10 sigma based on our imaging and spectral analysis, respectively. The spatial extent is estimated to have a radius of $7 \pm 3$ arcmin ($13 \pm 5$ pc at a distance of 6.2 kpc) assuming a Gaussian-like radial distribution, which suggests that the particle acceleration site is within ~10 pc of the microquasar. If the X-ray morphology traces the diffusion of accelerated electrons, this spatial extent can be explained by either an enhanced magnetic field (~80 uG) or a suppressed diffusion coefficient (~$10^{27}$ cm$^2$ s$^{-1}$ at 100 TeV). The integrated X-ray flux, (4-6)$\times 10^{-12}$ erg s$^{-1}$ cm$^{-2}$ (2-10 keV), would require a magnetic field strength higher than the galactic mean (> 8 uG) if the diffuse X-ray emission originates from synchrotron radiation and the gamma-ray emission is predominantly hadronic. If the X-rays are of thermal origin, the measured extension, temperature, and plasma density can be explained by a jet with a luminosity of ~$2\times 10^{39}$ erg s$^{-1}$, which is comparable to the Eddington luminosity of this system.

astro-ph.HE↗

arXiv2024

A projected Euler Method for Random Periodic Solutions of Semi-linear SDEs with non-globally Lipschitz coefficients

The present work introduces and investigates an explicit time discretization scheme, called the projected Euler method,to numerically approximate random periodic solutions of semi-linear SDEs under non-globally Lipschitz conditions. The existence of the random periodic solution is demonstrated as the limit of the pull-back of the discretized SDE. Without relying on a priori high-order moment bounds of the numerical approximations, the mean square convergence rate of the approximation scheme is proved to be order $0.5$ for SDEs with multiplicative noise and order $1$ for SDEs with additive noise. Numerical examples are also provided to validate our theoretical findings.

math.NA↗

arXiv2024

Strong convergence rates of Galerkin finite element methods for SWEs with cubic polynomial nonlinearity

In the present work, strong approximation errors are analyzed for both the spatial semi-discretization and the spatio-temporal fully discretization of stochastic wave equations (SWEs) with cubic polynomial nonlinearities and additive noises. The fully discretization is achieved by the standard Galerkin ffnite element method in space and a novel exponential time integrator combined with the averaged vector ffeld approach. The newly proposed scheme is proved to exactly satisfy a trace formula based on an energy functional. Recovering the convergence rates of the scheme, however, meets essential difffculties, due to the lack of the global monotonicity condition. To overcome this issue, we derive the exponential integrability property of the considered numerical approximations, by the energy functional. Armed with these properties, we obtain the strong convergence rates of the approximations in both spatial and temporal direction. Finally, numerical results are presented to verify the previously theoretical findings.

math.NA↗

arXiv2024

Weak error analysis for strong approximation schemes of SDEs with super-linear coefficients II: finite moments and higher-order schemes

This paper is the second in a series of works on weak convergence of one-step schemes for solving stochastic differential equations (SDEs) with one-sided Lipschitz conditions. It is known that the super-linear coefficients may lead to a blowup of moments of solutions and numerical solutions and thus affect the convergence of numerical methods. Wang et al. (2023, IMA J. Numer. Anal.) have analyzed weak convergence of one-step numerical schemes when solutions to SDEs have all finite moments. Therein some modified Euler schemes have been discussed about their weak convergence orders. In this work, we explore the effects of limited orders of moments on the weak convergence of a family of explicit schemes. The schemes are based on approximations/modifications of terms in the Ito-Talyor expansion. We provide a systematic but simple way to establish weak convergence orders for these schemes. We present several numerical examples of these schemes and show their weak convergence orders.

math.NA↗

arXiv2024

Postprocessing of tilt-to-length noise with coefficient drifts in TianQin using a null time-delay interferometry channel

Tilt-to-length (TTL) coupling is expected to be one of the major noise sources in the interferometric phase readouts in TianQin mission. Arising from the angular motion of spacecraft (SC) and the onboard movable optical subassemblies (MOSAs), TTL noise needs to be removed in postprocessing after suppressing the laser phase noise with time-delay interferometry (TDI) technique. In this article, we show that we can estimate the TTL coupling coefficients using the null TDI channel ζ and remove the TTL noise in the commonly used Michelson variables with the estimated coefficients. We introduce the theoretical model of TTL noise in TDI and consider linear drifts in the linear TTL coefficients for noise estimation and subtraction. The TTL coefficients with drifts are estimated successfully with an accuracy of 10 μm/rad in our numerical simulation. We discuss the impact of point-ahead angle compensation error and wavefront error, and find it necessary to estimate linear drift coefficients and quadratic TTL coefficients to keep TTL noise residuals below the 0.3 pm noise reference curve. However, the estimation accuracy suffers greatly from the correlation between yaw jitter measurements that contain the same SC jitter. Assuming all angular jitters induced by MOSAs are independent, choosing a frequency range with relatively higher MOSA yaw jitter noise levels is beneficial to the TTL coefficient estimation.

astro-ph.IM↗