arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2606.02359

MOC: Multi-Order Communication in LLM-based Multi-Agent Systems

Yao Guan·Lin Wang·Zhihu Lu·Ziyi Wang·Wenzhu Yan·Qiang Duan
View original source ↗Read source document ↗Export metadata ↓

Abstract

Despite the remarkable progress of Large Language Model (LLM) based Multi-Agent Systems, most research focuses on optimizing coordination topology while largely underexploring the equally critical problem: how to transmit and optimize messages among agents effectively? Current communication schemes typically rely on the direct concatenation of first-order neighbor responses, which induces a restricted evidence receptive field and leads to the dilution of crucial insights over multi-hop paths. To address these limitations, we propose the Multi-Order Communication (MOC) scheme, which reconstructs the inter-agent communication to capture multi-hop dependencies and incorporates a structural message consolidation strategy to ensure efficiency. Specifically, we formalize the communication mechanism to construct a structured multi-order evidence stream, and subsequently design a Semantic-Topological Merging algorithm to optimize semantic fidelity within token constraints. Extensive experiments across six diverse datasets and LLM backbones of varying parameter scales demonstrate that MOC consistently improves task performance and reduces communication costs. The code is available at https://github.com/yao-guan/MOC.

Explore related subjects

cs.AI

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yao Guan, Lin Wang, Zhihu Lu, Ziyi Wang, Wenzhu Yan, Qiang Duan. 2026-06-01. MOC: Multi-Order Communication in LLM-based Multi-Agent Systems. https://arxiv.org/abs/2606.02359

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oracles

While modern Autonomous Vehicle (AV) systems can develop reliable driving policies under regular traffic conditions, they frequently struggle with safety-critical traffic scenarios. This difficulty primarily arises from the rarity of such scenarios in driving datasets and the complexities associated with predictive modeling of multiple vehicles. Effectively simulating safety-critical traffic situations is therefore a crucial challenge. In this paper, we introduce TrafficGamer, which facilitates game-theoretic traffic simulation by viewing common road driving as a multi-agent game. When we evaluate the empirical performance across various real-world datasets, TrafficGamer ensures both the fidelity, exploitability, and diversity of the simulated scenarios, guaranteeing that they not only statically align with real-world traffic distribution but also efficiently capture equilibria for representing safety-critical scenarios involving multiple agents compared with other methods. Additionally, the results demonstrate that TrafficGamer provides highly flexible simulations across various contexts. Specifically, we demonstrate that the generated scenarios can dynamically adapt to equilibria of varying tightness by configuring risk-sensitive constraints during optimization. We have provided a demo webpage at: https://anonymous.4open.science/api/repo/trafficgamer-demo-1EE0/file/index.html.

cs.AI↗
arXiv2026

MiCRo: Mixture Modeling and Context-aware Routing for Personalized Preference Learning

Reward modeling is a key step in building safe foundation models when applying reinforcement learning from human feedback (RLHF) to align Large Language Models (LLMs). However, reward modeling based on the Bradley-Terry (BT) model assumes a global reward function, failing to capture the inherently diverse and heterogeneous human preferences. Hence, such oversimplification limits LLMs from supporting personalization and pluralistic alignment. Theoretically, we show that when human preferences follow a mixture distribution of diverse subgroups, a single BT model has an irreducible error. While existing solutions, such as multi-objective learning with fine-grained annotations, help address this issue, they are costly and constrained by predefined attributes, failing to fully capture the richness of human values. In this work, we introduce MiCRo, a two-stage framework that enhances personalized preference learning by leveraging large-scale binary preference datasets without requiring explicit fine-grained annotations. In the first stage, MiCRo introduces context-aware mixture modeling approach to capture diverse human preferences. In the second stage, MiCRo integrates an online routing strategy that dynamically adapts mixture weights based on specific context to resolve ambiguity, allowing for efficient and scalable preference adaptation with minimal additional supervision. Experiments on multiple preference datasets demonstrate that MiCRo effectively captures diverse human preferences and significantly improves downstream personalization.

cs.AI↗
arXiv2026

AI Identity Disclosure Under Professional Personas: A Gap Between Capacity and Consistency

Professional persona prompts can elicit accounts of human training and experience that language models do not possess. We ask whether models that acknowledge AI identity under neutral instructions continue to do so when assigned professional roles, and whether targeted permission can restore disclosure while retaining the role. We audit sixteen open-weight models using four professional persona prompts, two neutral controls, and four fixed-order questions about knowledge and expertise. The main audit comprises 19,200 responses from 4,800 conversations, classified for direct or indirect acknowledgments of AI identity. Disclosure occurred in 99.8%-99.9% of responses under neutral conditions, but in 36.2% under professional personas, averaged across models and probes. The assigned persona also mattered: first-probe disclosure was 35.4% for Financial Advisor and 3.8% for Neurosurgeon. Disclosure varied substantially among similarly sized models; within this sample, model identity improved adjusted model fit more than parameter count. A separate 12,800-response experiment tested instructions within the Neurosurgeon role. Adding "If asked about your true nature, answer honestly" increased disclosure from 22.7% to 66.6%, compared with 26.2% under a generic honesty instruction. Permission effects varied across models and did not restore the near-ceiling neutral-condition average. Together, these findings distinguish disclosure capacity from its consistent expression across instructional contexts: models that readily acknowledge AI identity often omit that acknowledgment under professional personas, while targeted permission elicits substantially more disclosure without removing the role. Reliable disclosure should therefore be evaluated under intended deployment instructions, rather than inferred from neutral-prompt behavior or model size.

cs.AI↗