arXiv subjects

Qiyao Peng

Publications and source records attributed to Qiyao Peng.

At least 19 recordsLinked to original sources

arXiv2026

A Stabilized Finite Element Method for a Morpho-Visco-Poroelastic Model

Studying the structure of soft tissues is important and relevant in biology, particularly in some diseases, such as tumor growth and dermal contraction after burn injury. Based on the complicated characteristics of the tissue and for the sake of a better understanding of the underlying biomechanics, we propose a mathematical model that combines elastic, viscous, and porous effects with growth or shrinkage due to microstructural changes. The framework is referred to as morpho-visco-poroelasticity. Although the existence results of the solution to the problem are not given in this study, we assess the stability of the equilibria for both the continuous and semi-discrete versions of the model, and the key features of this modelling framework have been discussed. To obtain reliable numerical solutions, a stabilized finite element (FE) scheme is proposed for the morpho-visco-poroelasticity equations to avoid spurious oscillations in the pressure profile; the success of this FE scheme is verified by numerical simulations and convergence investigation in both spatial and temporal aspects. For a more quantitative assessment, the total variation of the pressure profile is evaluated as a function of the stabilization parameter.

math.NA↗

arXiv2026

Unsupervised Graph Representation Learning with Complementary View Alignment

Unsupervised graph representation learning aims to derive meaningful node embeddings by capturing both structural and attribute information without relying on labeled data. Existing methods, such as GAEs, have demonstrated effectiveness but typically rely on message-passing mechanisms that assume homophily, leading to performance degradation on heterophilous graphs, where connected nodes exhibit dissimilar features. This homophily bias results in the loss of critical high-frequency components that are essential for identifying heterophilous patterns. To address these challenges, we propose \textsc{AlignGAE}, a novel extension of \textit{MaskGAE} that preserves the full frequency spectrum through complementary view alignment. Our framework introduces a dual-encoder architecture that separately processes structural and attribute information, incorporates node positional encoding to approximate Neighborhood Identity Distribution (NID), and employs dual reconstruction tasks for both edges and node attributes. We further propose theoretically grounded NID alignment strategies that ensure semantic consistency across views while preserving their distinct characteristics. Through comprehensive spectral analysis, we demonstrate that \textsc{AlignGAE} achieves optimal representation properties when the alignment loss converges. Extensive experiments across 12 benchmark datasets validate our approach, showing that \textsc{AlignGAE} outperforms state-of-the-art methods by up to 18.7\% on heterophilous graphs in node classification, while maintaining competitive performance on homophilous graphs. Our results establish a new paradigm for frequency-aware graph representation learning.

cs.LG↗

arXiv2026

MARDoc: A Memory-Aware Refinement Agent Framework for Multimodal Long Document QA

Iterative retrieval-reasoning agents have recently shown promise for multimodal long-document question answering. However, most existing systems maintain a single growing context that mixes retrieval traces, observations, and intermediate reasoning. As interactions accumulate, key evidence becomes scattered and diluted, making multi-hop reasoning noisy. We propose MARDoc, a Memory-Aware Refinement Agent framework that decouples long-document QA into three specialized agents: an Explorer for multi-granularity multimodal retrieval, a Refiner for distilling interaction traces into structured evidence and reasoning memories, and a Reflector for checking evidence sufficiency and providing targeted feedback. Across iterations, the agents rely on a dynamically updated structured memory rather than a full accumulated interaction history. This design reduces context noise while preserving answer-critical facts and their logical dependencies. Experiments on MMLongBench-Doc and DocBench show that MARDoc achieves strong results, outperforming same-backbone baselines and demonstrating the effectiveness of structured memory for agentic document QA.

cs.CL↗

arXiv2026

Benchmark Leakage Trap: Can We Trust LLM-based Recommendation?

The expanding integration of Large Language Models (LLMs) into recommender systems poses critical challenges to evaluation reliability. This paper identifies and investigates a previously overlooked issue: benchmark data leakage in LLM-based recommendation. This phenomenon occurs when LLMs are exposed to and potentially memorize benchmark datasets during pre-training or fine-tuning, leading to artificially inflated performance metrics that fail to reflect true model performance. To validate this phenomenon, we simulate diverse data leakage scenarios by conducting continued pre-training of foundation models on strategically blended corpora, which include user-item interactions from both in-domain and out-of-domain sources. Our experiments reveal a dual-effect of data leakage: when the leaked data is domain-relevant, it induces substantial but spurious performance gains, misleadingly exaggerating the model's capability. In contrast, domain-irrelevant leakage typically degrades recommendation accuracy, highlighting the complex and contingent nature of this contamination. Our findings reveal that data leakage acts as a critical, previously unaccounted-for factor in LLM-based recommendation, which could impact the true model performance. We release our code at https://github.com/yusba1/LLMRec-Data-Leakage.

cs.LG↗

arXiv2026

Convergence of the Immersed Interface Method in Linear Elasticity

We consider an open, bounded, simply connected (Lipschitz) domain in $\mathbb{R}^d$, which contains a closed polyhedral surface or polygonal contour, referred to as the interface. From this interface, forces are exerted in the normal direction. The forces are continuously distributed over the interface, resulting in an integral expression. This features an important characteristic of the immersed interface method. Since the integral cannot be resolved exactly, one relies on numerical quadrature rules to approximate the integral. Therefore, we consider two different linear elasticity problems with forces over a curve or surface (interface) that is located within the (open) domain of computation: (1) The force is defined by an integral over the interface; (2) The force is defined by a quadrature approximation of the integral over the interface. We prove that the ${\bf L}^2$-norm of the difference between the solutions from the two elasticity problems is of the same order as the error of quadrature. The results are demonstrated for both bounded and unbounded domains. The proof that we establish relies on the use of: (i) fundamental solutions for linear elasticity, exhibiting singular behaviors (in particular around points of action) and not being in ${\bf H}^1$, and (ii) on the use of singularity removal principle and the Extended Trace Theorem. Convergence is demonstrated in the ${\bf L}^2$-norm on curves and manifolds. We show some numerical experiments on the basis of fundamental solutions with a Midpoint quadrature rule in an unbounded and a bounded domain. We note that the error that we estimate is for the exact solutions and not for finite element solutions. Hence in the numerical finite element-based simulations, the numerical results contain an additional error due to the finite element approach.

math.NA↗

arXiv2026

Recent Analytical and Computational Developments on the Advection-Diffusion-Reaction Wildfire Model

Wildfires represent a problem for ecosystems, human activities, and economies, driven by the climate crisis and land-use changes. Predicting wildfire propagation through mathematical modelling is essential for damage mitigation and risk assessment. This paper provides a comprehensive review of a physics-based Advection-Diffusion-Reaction (ADR) model, focusing on the balance between physical accuracy and computational efficiency. We analyze the ability of the ADR model to estimate fire front speed and behaviour and discuss its preliminary mathematical properties. Additionally, we discuss some modelling improvements which enhance the physical realism of the model. Furthermore, we address the challenge of reducing computational costs, emphasizing the need for inexpensive but precise numerical schemes. We report recent findings outlining open challenges in model discretization and technological solutions. All these developments highlight the potential of ADR models as powerful tools for efficient wildfire simulation and risk assessment.

math.AP↗

arXiv2026

Towards Data-Driven Modeling of Cell Cycle and Wound Closure Processes

Effective wound repair treatments rely on a clear picture of how cell proliferation and migration are coordinated during tissue restoration. Fibroblasts are key contributors to tissue restoration in the dermis, and modern imaging tools allow their cell-cycle progression to be observed directly, enabling comparison between experiments and computational models. Here we investigate how different stages of the cell cycle influence fibroblast-driven wound closure using the Discrete Laplacian Cell Mechanics (DLCM) framework driven by time-lapse microscopy data. \textit{In vitro} assays provide cell positions, migration behaviour, and cycle-stage information, and we show that incorporating proliferation, migration, and cell cycle arrest allows the computational model to reproduce the essential experimental trends. The results reveal that arrest in the G1 phase notably impacts the cell cycle dynamics and that the initial spatial arrangement of cycle states significantly affects wound closure. By linking single-cell cycle dynamics with emergent tissue behaviour this work establishes a quantitative approach for exploring how intracellular processes shape repair processes. More broadly, it demonstrates the value of integrating high-resolution data with cell-based mechanical models and provides a foundation for systematic \textit{in silico} evaluation of therapeutic interventions.

q-bio.CB↗

arXiv2025

Positivity and long-term behaviour of a diffusion model with measure-valued nonlocal reaction term

The behaviour is investigated of solutions to a diffusion equation on the real line with nonlocal and singular reaction term, i.e., given by a Dirac source or sink at the origin. It gives a simplified representation of for example a control system that senses concentration at a distance, but "intervenes" at the origin. Positivity of solutions (for positive initial conditions) cannot be guaranteed for all parameter settings in the model. We determine a parameter regime and conditions on the positive initial condition in terms of monotonicity and symmetry, that do allow us to conclude the positivity of the solution for all time. In addition, we provide conditions that ensure convergence of the system to a constant steady state (pointwise), outside the region of observation. Technically, we extensively use Laplace transform arguments to achieve these results.

math.AP↗

arXiv2025

On the Inversion of Polynomials of Discrete Laplace Matrices

The efficient inversion of matrix polynomials is a critical challenge in computational mathematics. We design a procedure to determine the inverse of matrices polynomial of multidimensional Laplace matrices. The method is based on eigenvector and eigenvalue expansions. The method is consistent with previous expressions of the inverse discretized Laplacian in one spatial dimension \citep{Vermolen_2022}. Several examples are given.

math.NA↗

arXiv2025

FRONTIER-RevRec: A Large-scale Dataset for Reviewer Recommendation

Reviewer recommendation is a critical task for enhancing the efficiency of academic publishing workflows. However, research in this area has been persistently hindered by the lack of high-quality benchmark datasets, which are often limited in scale, disciplinary scope, and comparative analyses of different methodologies. To address this gap, we introduce FRONTIER-RevRec, a large-scale dataset constructed from authentic peer review records (2007-2025) from the Frontiers open-access publishing platform https://www.frontiersin.org/. The dataset contains 177941 distinct reviewers and 478379 papers across 209 journals spanning multiple disciplines including clinical medicine, biology, psychology, engineering, and social sciences. Our comprehensive evaluation on this dataset reveals that content-based methods significantly outperform collaborative filtering. This finding is explained by our structural analysis, which uncovers fundamental differences between academic recommendation and commercial domains. Notably, approaches leveraging language models are particularly effective at capturing the semantic alignment between a paper's content and a reviewer's expertise. Furthermore, our experiments identify optimal aggregation strategies to enhance the recommendation pipeline. FRONTIER-RevRec is intended to serve as a comprehensive benchmark to advance research in reviewer recommendation and facilitate the development of more effective academic peer review systems. The FRONTIER-RevRec dataset is available at: https://anonymous.4open.science/r/FRONTIER-RevRec-5D05.

cs.IR↗

arXiv2025

Beyond Fixed Length: Bucket Pre-training is All You Need

Large Language Models (LLMs) have demonstrated exceptional performance across various tasks, with pre-training stage serving as the cornerstone of their capabilities. However, the conventional fixed-length data composition strategy for pre-training presents several practical challenges. When using shorter sequences, documents are often truncated, potentially leading to information loss and affecting the model's ability to capture long-range dependencies. Conversely, longer sequences require concatenation of multiple documents, which can introduce noise and affect the natural document boundaries and semantic coherence as well as require substantial computational overhead. To address these challenges, we first establish three quantitative metrics for evaluating data composition quality: padding ratio, truncation ratio, and concatenation ratio. Building upon these metrics, we propose a novel multi-bucket data composition method that transcends the fixed-length paradigm. Our approach adaptively organizes training data to achieve optimal composition quality as measured by the proposed metrics, offering a more flexible and efficient approach for pre-training. We conduct extensive experiments and the results demonstrate that our proposed method significantly enhances both the efficiency and effectiveness of LLM pre-training.

cs.CL↗

arXiv2025

Crafting Synthetic Realities: Examining Visual Realism and Misinformation Potential of Photorealistic AI-Generated Images

Advances in generative models have created Artificial Intelligence-Generated Images (AIGIs) nearly indistinguishable from real photographs. Leveraging a large corpus of 30,824 AIGIs collected from Instagram and Twitter, and combining quantitative content analysis with qualitative analysis, this study unpacks AI photorealism of AIGIs from four key dimensions, content, human, aesthetic, and production features. We find that photorealistic AIGIs often depict human figures, especially celebrities and politicians, with a high degree of surrealism and aesthetic professionalism, alongside a low degree of overt signals of AI production. This study is the first to empirically investigate photorealistic AIGIs across multiple platforms using a mixed-methods approach. Our findings provide important implications and insights for understanding visual misinformation and mitigating potential risks associated with photorealistic AIGIs. We also propose design recommendations to enhance the responsible use of AIGIs.

cs.CY↗

arXiv2025

Approximating a spatially-heterogeneously mass-emitting object by multiple point sources in a diffusion model

Various biological cells secrete diffusing chemical compounds into their environment for communication purposes. Secretion usually takes place over the cell membrane in a spatially heterogeneous manner. Mathematical models of these processes will be part of more elaborate models, e.g. of the movement of immune cells that react to cytokines in their environment. Here, we compare two approaches to modelling of the secretion-diffusion process of signalling compounds. The first is the so-called spatial exclusion model, in which the intracellular space is excluded from consideration and the computational space is the extracellular environment. The second consists of point source models, where the secreting cell is replaced by one or more non-spatial point sources or sinks, using -- mathematically -- Dirac delta distributions. We propose a multi-Dirac approach and provide explicit expressions for the intensities of the Dirac distributions. We show that two to three well-positioned Dirac points suffice to approximate well a temporally constant but spatially heterogeneous flux distribution of compound over the cell membrane, for a wide range of variation in flux density and diffusivity. The multi-Dirac approach is compared to a single-Dirac approach that was studied in previous work. Moreover, an explicit Green's function approach is introduced that has significant benefits in circumventing numerical instability that may occur when the Dirac sources have high intensities.

math.NA↗

arXiv2025

A Survey on LLM-powered Agents for Recommender Systems

Recommender systems are essential components of many online platforms, yet traditional approaches still struggle with understanding complex user preferences and providing explainable recommendations. The emergence of Large Language Model (LLM)-powered agents offers a promising approach by enabling natural language interactions and interpretable reasoning, potentially transforming research in recommender systems. This survey provides a systematic review of the emerging applications of LLM-powered agents in recommender systems. We identify and analyze three key paradigms in current research: (1) Recommender-oriented approaches, which leverage intelligent agents to enhance the fundamental recommendation mechanisms; (2) Interaction-oriented approaches, which facilitate dynamic user engagement through natural dialogue and interpretable suggestions; and (3) Simulation-oriented approaches, which employ multi-agent frameworks to model complex user-item interactions and system dynamics. Beyond paradigm categorization, we analyze the architectural foundations of LLM-powered recommendation agents, examining their essential components: profile construction, memory management, strategic planning, and action execution. Our investigation extends to a comprehensive analysis of benchmark datasets and evaluation frameworks in this domain. This systematic examination not only illuminates the current state of LLM-powered agent recommender systems but also charts critical challenges and promising research directions in this transformative field.

cs.IR↗

arXiv2025

Multi-Agent Collaboration for Multilingual Code Instruction Tuning

Recent advancement in code understanding and generation demonstrates that code LLMs fine-tuned on a high-quality instruction dataset can gain powerful capabilities to address wide-ranging code-related tasks. However, most previous existing methods mainly view each programming language in isolation and ignore the knowledge transfer among different programming languages. To bridge the gap among different programming languages, we introduce a novel multi-agent collaboration framework to enhance multilingual instruction tuning for code LLMs, where multiple language-specific intelligent agent components with generation memory work together to transfer knowledge from one language to another efficiently and effectively. Specifically, we first generate the language-specific instruction data from the code snippets and then provide the generated data as the seed data for language-specific agents. Multiple language-specific agents discuss and collaborate to formulate a new instruction and its corresponding solution (A new programming language or existing programming language), To further encourage the cross-lingual transfer, each agent stores its generation history as memory and then summarizes its merits and faults. Finally, the high-quality multilingual instruction data is used to encourage knowledge transfer among different programming languages to train Qwen2.5-xCoder. Experimental results on multilingual programming benchmarks demonstrate the superior performance of Qwen2.5-xCoder in sharing common knowledge, highlighting its potential to reduce the cross-lingual gap.

cs.CL↗

arXiv2024

Using multiple Dirac delta points to describe inhomogeneous flux density over a cell boundary in a single-cell diffusion model

Biological cells can release compounds into their direct environment, generally inhomogeneously over their cell membrane, after which the compounds spread by diffusion. In mathematical modelling and simulation of a collective of such cells, it is theoretically and numerically advantageous to replace spatial extended cells with point sources, in particular when cell numbers are large, but still so small that a continuum density description cannot be justified, or when cells are moving. We show that inhomogeneous flux density over the cell boundary may be realized in a point source approach, thus maintaining computational efficiency, by utilizing multiple, clustered point sources (and sinks). In this report, we limit ourselves to a sinusoidal function as flux density in the spatial exclusion model, and we show how to determine the amplitudes of the Dirac delta points in the point source model, such that the deviation between the point source model and the spatial exclusion model is small.

math.NA↗

arXiv2024

ExecRepoBench: Multi-level Executable Code Completion Evaluation

Code completion has become an essential tool for daily software development. Existing evaluation benchmarks often employ static methods that do not fully capture the dynamic nature of real-world coding environments and face significant challenges, including limited context length, reliance on superficial evaluation metrics, and potential overfitting to training datasets. In this work, we introduce a novel framework for enhancing code completion in software development through the creation of a repository-level benchmark ExecRepoBench and the instruction corpora Repo-Instruct, aim at improving the functionality of open-source large language models (LLMs) in real-world coding scenarios that involve complex interdependencies across multiple files. ExecRepoBench includes 1.2K samples from active Python repositories. Plus, we present a multi-level grammar-based completion methodology conditioned on the abstract syntax tree to mask code fragments at various logical units (e.g. statements, expressions, and functions). Then, we fine-tune the open-source LLM with 7B parameters on Repo-Instruct to produce a strong code completion baseline model Qwen2.5-Coder-Instruct-C based on the open-source model. Qwen2.5-Coder-Instruct-C is rigorously evaluated against existing benchmarks, including MultiPL-E and ExecRepoBench, which consistently outperforms prior baselines across all programming languages. The deployment of \ourmethod{} can be used as a high-performance, local service for programming development\footnote{\url{https://execrepobench.github.io/}}.

cs.CL↗

arXiv2024

ULMRec: User-centric Large Language Model for Sequential Recommendation

Recent advances in Large Language Models (LLMs) have demonstrated promising performance in sequential recommendation tasks, leveraging their superior language understanding capabilities. However, existing LLM-based recommendation approaches predominantly focus on modeling item-level co-occurrence patterns while failing to adequately capture user-level personalized preferences. This is problematic since even users who display similar behavioral patterns (e.g., clicking or purchasing similar items) may have fundamentally different underlying interests. To alleviate this problem, in this paper, we propose ULMRec, a framework that effectively integrates user personalized preferences into LLMs for sequential recommendation. Considering there has the semantic gap between item IDs and LLMs, we replace item IDs with their corresponding titles in user historical behaviors, enabling the model to capture the item semantics. For integrating the user personalized preference, we design two key components: (1) user indexing: a personalized user indexing mechanism that leverages vector quantization on user reviews and user IDs to generate meaningful and unique user representations, and (2) alignment tuning: an alignment-based tuning stage that employs comprehensive preference alignment tasks to enhance the model's capability in capturing personalized information. Through this design, ULMRec achieves deep integration of language semantics with user personalized preferences, facilitating effective adaptation to recommendation. Extensive experiments on two public datasets demonstrate that ULMRec significantly outperforms existing methods, validating the effectiveness of our approach.

cs.IR↗