arXiv subjects

Tao Zhang

Publications and source records attributed to Tao Zhang.

At least 217 records · Page 12Linked to original sources

arXiv2025

The 1st Solution for 7th LSVOS RVOS Track: SaSaSa2VA

Referring video object segmentation (RVOS) requires segmenting and tracking objects in videos conditioned on natural-language expressions, demanding fine-grained understanding of both appearance and motion. Building on Sa2VA, which couples a Multi-modal Large Language Model (MLLM) with the video segmentation model SAM2, we identify two key bottlenecks that limit segmentation performance: sparse frame sampling and reliance on a single [SEG] token for an entire video. We propose Segmentation Augmented and Selective Averaged Sa2VA (SaSaSa2VA) to address these issues. On the 7th LSVOS Challenge (RVOS track), SaSaSa2VA achieves a $\mathcal{J\&F}$ of 67.45, ranking first and surpassing the runner-up by 2.80 points. This result and ablation studies demonstrate that efficient segmentation augmentation and test-time ensembling substantially enhance grounded MLLMs for RVOS. The code is released in Sa2VA repository: https://github.com/bytedance/Sa2VA.

cs.CV↗

arXiv2025

ParaVul: A Parallel Large Language Model and Retrieval-Augmented Framework for Smart Contract Vulnerability Detection

Smart contracts play a significant role in automating blockchain services. Nevertheless, vulnerabilities in smart contracts pose serious threats to blockchain security. Currently, traditional detection methods primarily rely on static analysis and formal verification, which can result in high false-positive rates and poor scalability. Large Language Models (LLMs) have recently made significant progress in smart contract vulnerability detection. However, they still face challenges such as high inference costs and substantial computational overhead. In this paper, we propose ParaVul, a parallel LLM and retrieval-augmented framework to improve the reliability and accuracy of smart contract vulnerability detection. Specifically, we first develop Sparse Low-Rank Adaptation (SLoRA) for LLM fine-tuning. SLoRA introduces sparsification by incorporating a sparse matrix into quantized LoRA-based LLMs, thereby reducing computational overhead and resource requirements while enhancing their ability to understand vulnerability-related issues. We then construct a vulnerability contract dataset and develop a hybrid Retrieval-Augmented Generation (RAG) system that integrates dense retrieval with Best Matching 25 (BM25), assisting in verifying the results generated by the LLM. Furthermore, we propose a meta-learning model to fuse the outputs of the RAG system and the LLM, thereby generating the final detection results. After completing vulnerability detection, we design chain-of-thought prompts to guide LLMs to generate comprehensive vulnerability detection reports. Simulation results demonstrate the superiority of ParaVul, especially in terms of F1 scores, achieving 0.9398 for single-label detection and 0.9330 for multi-label detection.

cs.CR↗

arXiv2025

MooseAgent: A LLM Based Multi-agent Framework for Automating Moose Simulation

The Finite Element Method (FEM) is widely used in engineering and scientific computing, but its pre-processing, solver configuration, and post-processing stages are often time-consuming and require specialized knowledge. This paper proposes an automated solution framework, MooseAgent, for the multi-physics simulation framework MOOSE, which combines large-scale pre-trained language models (LLMs) with a multi-agent system. The framework uses LLMs to understand user-described simulation requirements in natural language and employs task decomposition and multi-round iterative verification strategies to automatically generate MOOSE input files. To improve accuracy and reduce model hallucinations, the system builds and utilizes a vector database containing annotated MOOSE input cards and function documentation. We conducted experimental evaluations on several typical cases, including heat transfer, mechanics, phase field, and multi-physics coupling. The results show that MooseAgent can automate the MOOSE simulation process to a certain extent, especially demonstrating a high success rate when dealing with relatively simple single-physics problems. The main contribution of this research is the proposal of a multi-agent automated framework for MOOSE, which validates its potential in simplifying finite element simulation processes and lowering the user barrier, providing new ideas for the development of intelligent finite element simulation software. The code for the MooseAgent framework proposed in this paper has been open-sourced and is available at https://github.com/taozhan18/MooseAgent

cs.LG↗

arXiv2025

LSVOS 2025 Challenge Report: Recent Advances in Complex Video Object Segmentation

This report presents an overview of the 7th Large-scale Video Object Segmentation (LSVOS) Challenge held in conjunction with ICCV 2025. Besides the two traditional tracks of LSVOS that jointly target robustness in realistic video scenarios: Classic VOS (VOS), and Referring VOS (RVOS), the 2025 edition features a newly introduced track, Complex VOS (MOSEv2). Building upon prior insights, MOSEv2 substantially increases difficulty, introducing more challenging but realistic scenarios including denser small objects, frequent disappear/reappear events, severe occlusions, adverse weather and lighting, etc., pushing long-term consistency and generalization beyond curated benchmarks. The challenge retains standard ${J}$, $F$, and ${J\&F}$ metrics for VOS and RVOS, while MOSEv2 adopts ${J\&\dot{F}}$ as the primary ranking metric to better evaluate objects across scales and disappearance cases. We summarize datasets and protocols, highlight top-performing solutions, and distill emerging trends, such as the growing role of LLM/MLLM components and memory-aware propagation, aiming to chart future directions for resilient, language-aware video segmentation in the wild.

cs.CV↗

arXiv2025

Decoupling Correctness from Policy: A Deterministic Causal Structure for Multi-Agent Systems

In distributed multi-agent systems, correctness is often entangled with operational policies such as scheduling, batching, or routing, which makes systems brittle since performance-driven policy evolution may break integrity guarantees. This paper introduces the Deterministic Causal Structure (DCS), a formal foundation that decouples correctness from policy. We develop a minimal axiomatic theory and prove four results: existence and uniqueness, policy-agnostic invariance, observational equivalence, and axiom minimality. These results show that DCS resolves causal ambiguities that value-centric convergence models such as CRDTs cannot address, and that removing any axiom collapses determinism into ambiguity. DCS thus emerges as a boundary principle of asynchronous computation, analogous to CAP and FLP: correctness is preserved only within the expressive power of a join-semilattice. All guarantees are established by axioms and proofs, with only minimal illustrative constructions included to aid intuition. This work establishes correctness as a fixed, policy-agnostic substrate, a Correctness-as-a-Chassis paradigm, on which distributed intelligent systems can be built modularly, safely, and evolvably.

cs.DC↗

arXiv2025

Diffusion Model as a Noise-Aware Latent Reward Model for Step-Level Preference Optimization

Preference optimization for diffusion models aims to align them with human preferences for images. Previous methods typically use Vision-Language Models (VLMs) as pixel-level reward models to approximate human preferences. However, when used for step-level preference optimization, these models face challenges in handling noisy images of different timesteps and require complex transformations into pixel space. In this work, we show that pre-trained diffusion models are naturally suited for step-level reward modeling in the noisy latent space, as they are explicitly designed to process latent images at various noise levels. Accordingly, we propose the Latent Reward Model (LRM), which repurposes components of the diffusion model to predict preferences of latent images at arbitrary timesteps. Building on LRM, we introduce Latent Preference Optimization (LPO), a step-level preference optimization method conducted directly in the noisy latent space. Experimental results indicate that LPO significantly improves the model's alignment with general, aesthetic, and text-image alignment preferences, while achieving a 2.5-28x training speedup over existing preference optimization methods. Our code and models are available at https://github.com/Kwai-Kolors/LPO.

cs.CV↗

arXiv2025

Affordable AI Assistants with Knowledge Graph of Thoughts

Large Language Models (LLMs) are revolutionizing the development of AI assistants capable of performing diverse tasks across domains. However, current state-of-the-art LLM-driven agents face significant challenges, including high operational costs and limited success rates on complex benchmarks like GAIA. To address these issues, we propose Knowledge Graph of Thoughts (KGoT), an innovative AI assistant architecture that integrates LLM reasoning with dynamically constructed knowledge graphs (KGs). KGoT extracts and structures task-relevant knowledge into a dynamic KG representation, iteratively enhanced through external tools such as math solvers, web crawlers, and Python scripts. Such structured representation of task-relevant knowledge enables low-cost models to solve complex tasks effectively while also minimizing bias and noise. For example, KGoT achieves a 29% improvement in task success rates on the GAIA benchmark compared to Hugging Face Agents with GPT-4o mini. Moreover, harnessing a smaller model dramatically reduces operational costs by over 36x compared to GPT-4o. Improvements for other models (e.g., Qwen2.5-32B and Deepseek-R1-70B) and benchmarks (e.g., SimpleQA) are similar. KGoT offers a scalable, affordable, versatile, and high-performing solution for AI assistants.

cs.AI↗

arXiv2025

Cohomology and automorphisms of Com-PreLie algebras

This paper introduces the concept of representations for Com-PreLie algebras and develops corresponding cohomology theories, examining how cohomology groups can be applied in the context of Com-PreLie algebras. Initially, we utilize the cohomology theory to investigate abelian extensions of Com-PreLie algebras. Next, given an abelian extension of Com-PreLie algebras and its representation, we explore the inducibility of Com-PreLie automorphisms, deriving both necessary and sufficient conditions for the inducibility problem. Lastly, we delve deeper into the inducibility of Com-PreLie automorphisms using the Wells exact sequences, offering a clear framework for studying the inducibility of Com-PreLie automorphisms.

math.RA↗

arXiv2025

SVAC: Scaling Is All You Need For Referring Video Object Segmentation

Referring Video Object Segmentation (RVOS) aims to segment target objects in video sequences based on natural language descriptions. While recent advances in Multi-modal Large Language Models (MLLMs) have improved RVOS performance through enhanced text-video understanding, several challenges remain, including insufficient exploitation of MLLMs' prior knowledge, prohibitive computational and memory costs for long-duration videos, and inadequate handling of complex temporal dynamics. In this work, we propose SVAC, a unified model that improves RVOS by scaling up input frames and segmentation tokens to enhance video-language interaction and segmentation precision. To address the resulting computational challenges, SVAC incorporates the Anchor-Based Spatio-Temporal Compression (ASTC) module to compress visual tokens while preserving essential spatio-temporal structure. Moreover, the Clip-Specific Allocation (CSA) strategy is introduced to better handle dynamic object behaviors across video clips. Experimental results demonstrate that SVAC achieves state-of-the-art performance on multiple RVOS benchmarks with competitive efficiency. Our code is available at https://github.com/lizhang1998/SVAC.

cs.CV↗

arXiv2025

Fully Tensorized GPU-accelerated Multi-population Evolutionary Algorithm for Constrained Multiobjective Optimization Problems

Real world constrained multiobjective optimization problems (CMOPs) are prevalent and often come with stringent time-sensitive requirements. However, most contemporary constrained multiobjective evolutionary algorithms (CMOEAs) suffer from a number of drawbacks, including complex designs, low computational efficiency, and long convergence times, which are particularly pronounced when addressing time-sensitive CMOPs. Although research on accelerating evolutionary algorithms using GPU parallelism has advanced, existing CMOEAs still face significant limitations within GPU frameworks. To overcome these challenges, this paper proposes a GPU-accelerated multi-population evolutionary algorithm, termed GMPEA. We first systematically analyze the performance bottlenecks of representative CMOEAs when implemented in a GPU environment. To address the trade-off between computational speed and solution performance, GMPEA introduces a decomposition-based multi-population approach that is fully parallelized across its entire workflow. We conducted comparative experiments on various benchmark tests and real world applications: the Weapon Target Assignment Problems. The results demonstrate that GMPEA achieves competitive performance even without time constraints, while its computational speed significantly surpasses that of the compared algorithms. More critically, under a strict time limit, the performance of GMPEA drastically outperforms its counterparts. This work provides compelling evidence of GMPEA's superiority in solving time-sensitive CMOPs.

cs.NE↗

arXiv2025

A Detection Region Method-Based Evolutionary Algorithm for Binary Constrained Multiobjective Optimization

Solving constrained multi-objective optimization problems (CMOPs) is a challenging task. While many practical algorithms have been developed to tackle CMOPs, real-world scenarios often present cases where the constraint functions are unknown or unquantifiable, resulting in only binary outcomes (feasible or infeasible). This limitation reduces the effectiveness of constraint violation guidance, which can negatively impact the performance of existing algorithms that rely on this approach. Such challenges are particularly detrimental for algorithms employing the epsilon-based method, as they hinder effective relaxation of the feasible region. To address these challenges, this paper proposes a novel algorithm called DRMCMO based on the detection region method. In DRMCMO, detection regions dynamic monitor feasible solutions to enhance convergence, helping the population escape local optima. Additionally, these regions collaborate with the neighbor pairing strategy to improve population diversity within narrow feasible areas. We have modified three existing test suites to serve as benchmark test problems for CMOPs with binary constraints(CMOP/BC) and conducted comprehensive comparative experiments with state-of-the-art algorithms on these test suites and real-world problems. The results demonstrate the strong competitiveness of DRMCMO against state-of-the-art algorithms. Given the limited research on CMOP/BC, our study offers a new perspective for advancing this field.

cs.NE↗

arXiv2025

Cohomology and automorphisms for a matched pair of 3-Lie algebras

We begin by reviewing the definition of 3-Lie algebras and the fundamental concepts of matched pairs. Subsequently, we introduce the representation theory of matched pairs and define the semidirect product. Building on this foundation, we define the low-dimensional cohomology groups of matched pairs. In addition, we explore the infinitesimal deformations and abelian extensions of matched pairs. Finally, we examine the inducibility of automorphisms of matched pairs and present related results through the Wells exact sequence.

math.RA↗

arXiv2025

Periodicity of tiles in finite Abelian groups

In this paper, we introduce the periodic tiling (PT) property for finite abelian groups. A finite abelian group is said to have the PT property if every non-periodic set that tiles the group by translation admits a periodic tiling complement. This notion extends the scope beyond groups with the Hajós property. We give a complete classification of cyclic groups possessing the PT property and identify certain non-cyclic groups that enjoy the PT property but fail to satisfy the Hajós property.. As a byproduct, we obtain new families of groups for which the implication ``Tile $\Longrightarrow$ Spectral" holds. Furthermore, for elementary $p$-groups with the PT property, by analyzing the structure of tiles, we prove that every tile is a complete set of representatives of the cosets of some subgroup.

math.GR↗

arXiv2025

Electrically Reconfigurable Arbitrary Splitting-Ratio Optical Splitter Based on Low-Loss Sb2Se3

Reconfigurable beam splitters capable of being arbitrarily programmed for the power splitting ratios are vital for the adaptive optical networks and photonic computing. Conventional mechanisms such as thermo-optic, free-carrier, or mechanical tuning are usually volatile and require continuous power, limiting their suitability for low-frequency and low power-consumption programmable operations. Here, we experimentally demonstrate an electrically reconfigurable beam splitter based on the low-loss phase-change material Sb2Se3, enabling multi-level and arbitrary splitting-ratio (SR) control. By locally triggering phase transitions in the coupling region with integrated micro-electrodes, we exploit the high refractive-index contrast between different phases and negligible absorption in the near-infrared wavelength of Sb2Se3 to precisely tune the coupling strength with non-volatile retention. 8-level of power splitting states is achieved within a compact footprint of ~14.5-μm in the experiments, with insertion loss is ~1 dB across 1515-1550 nm and near-zero static power. Combining the advantages of compactness, broad bandwidth, low loss, non-volatility, and multi-level control experimentally, this device provides a universal building block for scalable, energy-efficient reconfigurable photonic circuits, with great prospects in optical computing and intelligent communication systems.

physics.optics↗

arXiv2025

RSMA Assisted ISAC With Hybrid Beamforming

The harsh environment and scarce resources post-disaster drive the equipment to be miniaturized and portable. Based on this, integrated sensing and communication (ISAC) systems play a significant role in providing emergency wireless networks. In order to reduce the hardware cost, a hybrid beamforming (HBF) assisted millimeter-wave (mmWave) ISAC system, which exploits the limited number of radio frequency (RF) chains, is considered in this paper. However, the HBF structure reduces the spatial degrees of freedom, thus leading to increased interference among communication users and radar sensing. To solve this problem, a rate-splitting multiple access (RSMA) strategy is adopted to enhance the emergency mmWave-ISAC system. We formulate the weighted sum rate (WSR) maximization objective by jointly designing common rate allocation and HBF. Then, we propose the penalty dual decomposition (PDD) coupled with the weighted mean squared error (WMMSE) method to solve this high-dimensional non-convex problem. Numerical results demonstrate the effectiveness of the proposed algorithm and show that the RSMA-ISAC scheme outperforms other benchmark schemes.

eess.SP↗

arXiv2025

A Dataset Generation Scheme Based on Video2EEG-SPGN-Diffusion for SEED-VD

This paper introduces an open-source framework, Video2EEG-SPGN-Diffusion, that leverages the SEED-VD dataset to generate a multimodal dataset of EEG signals conditioned on video stimuli. Additionally, we disclose an engineering pipeline for aligning video and EEG data pairs, facilitating the training of multimodal large models with EEG alignment capabilities. Personalized EEG signals are generated using a self-play graph network (SPGN) integrated with a diffusion model. As a major contribution, we release a new dataset comprising over 1000 samples of SEED-VD video stimuli paired with generated 62-channel EEG signals at 200 Hz and emotion labels, enabling video-EEG alignment and advancing multimodal research. This framework offers novel tools for emotion analysis, data augmentation, and brain-computer interface applications, with substantial research and engineering significance.

cs.CV↗

arXiv2025

Accelerating Amorphous Alloy Discovery: Data-Driven Property Prediction via General-Purpose Machine Learning Interatomic Potential

While traditional trial-and-error methods for designing amorphous alloys are costly and inefficient, machine learning approaches based solely on composition lack critical atomic structural information. Machine learning interatomic potentials, trained on data from first-principles calculations, offer a powerful alternative by efficiently approximating the complex three-dimensional potential energy surface with near-DFT accuracy. In this work, we develop a general-purpose machine learning interatomic potential for amorphous alloys by using a dataset comprising 20400 configurations across representative binary and ternary amorphous alloys systems. The model demonstrates excellent predictive performance on an independent test set, with a mean absolute error of 5.06 meV/atom for energy and 128.51 meV/Å for forces. Through extensive validation, the model is shown to reliably capture the trends in macroscopic property variations such as density, Young's modulus and glass transition temperature across both the original training systems and the compositionally modified systems derived from them. It can be directly applied to composition-property mapping of amorphous alloys. Furthermore, the developed interatomic potential enables access to the atomic structures of amorphous alloys, allowing for microscopic analysis and interpretation of experimental results, particularly those deviating from empirical trends.This work breaks the long-standing computational bottleneck in amorphous alloys research by developing the first general-purpose machine learning interatomic potential for amorphous alloy systems. The resulting framework provides a robust foundation for data-driven design and high-throughput composition screening in a field previously constrained by traditional simulation limitations.

cond-mat.mtrl-sci↗

arXiv2025

AutoCodeBench: Large Language Models are Automatic Code Benchmark Generators

Large Language Models (LLMs) have demonstrated remarkable capabilities across various domains, with code generation emerging as a key area of focus. While numerous benchmarks have been proposed to evaluate their code generation abilities, these benchmarks face several critical limitations. First, they often rely on manual annotations, which are time-consuming and difficult to scale across different programming languages and problem complexities. Second, most existing benchmarks focus primarily on Python, while the few multilingual benchmarks suffer from limited difficulty and uneven language distribution. To address these challenges, we propose AutoCodeGen, an automated method for generating high-difficulty multilingual code generation datasets without manual annotations. AutoCodeGen ensures the correctness and completeness of test cases by generating test inputs with LLMs and obtaining test outputs through a multilingual sandbox, while achieving high data quality through reverse-order problem generation and multiple filtering steps. Using this novel method, we introduce AutoCodeBench, a large-scale code generation benchmark comprising 3,920 problems evenly distributed across 20 programming languages. It is specifically designed to evaluate LLMs on challenging, diverse, and practical multilingual tasks. We evaluate over 30 leading open-source and proprietary LLMs on AutoCodeBench and its simplified version AutoCodeBench-Lite. The results show that even the most advanced LLMs struggle with the complexity, diversity, and multilingual nature of these tasks. Besides, we introduce AutoCodeBench-Complete, specifically designed for base models to assess their few-shot code generation capabilities. We hope the AutoCodeBench series will serve as a valuable resource and inspire the community to focus on more challenging and practical multilingual code generation scenarios.

cs.CL↗