arXiv subjects

Hongwei Zheng

Publications and source records attributed to Hongwei Zheng.

At least 37 records · Page 2Linked to original sources

arXiv2026

IceBreaker for Conversational Agents: Breaking the First-Message Barrier with Personalized Starters

Conversational agents, such as ChatGPT and Doubao, have become essential daily assistants for billions of users. To further enhance engagement, these systems are evolving from passive responders to proactive companions. However, existing efforts focus on activation within ongoing dialogues, while overlooking a key real-world bottleneck. In the conversation initiation stage, users may have a vague need but no explicit query intent, creating a first-message barrier where the conversation holds before it begins. To overcome this, we introduce Conversation Starter Generation: generating personalized starters to guide users into conversation. However, unlike in-conversation stages where immediate context guides the response, initiation must operate in a cold-start moment without explicit user intent. To pioneer in this direction, we present IceBreaker that frames human ice-breaking as a two-step handshake: (i) evoke resonance via Resonance-Aware Interest Distillation from session summaries to capture trigger interests, and (ii) stimulate interaction via Interaction-Oriented Starter Generation, optimized with personalized preference alignment and a self-reinforced loop to maximize engagement. Online A/B tests on one of the world's largest conversational agent products show that IceBreaker improves user active days by +0.184% and click-through rate by +9.425%, and has been deployed in production.

cs.CL↗

arXiv2026

HalluSAE: Detecting Hallucinations in Large Language Models via Sparse Auto-Encoders

Large Language Models (LLMs) are powerful and widely adopted, but their practical impact is limited by the well-known hallucination phenomenon. While recent hallucination detection methods have made notable progress, we find most of them overlook the dynamic nature and underlying mechanisms of it. To address this gap, we propose HalluSAE, a phase transition-inspired framework that models hallucination as a critical shift in the model's latent dynamics. By modeling the generation process as a trajectory through a potential energy landscape, HalluSAE identifies critical transition zones and attributes factual errors to specific high-energy sparse features. Our approach consists of three stages: (1) Potential Energy Empowered Phase Zone Localization via sparse autoencoders and a geometric potential energy metric; (2) Hallucination-related Sparse Feature Attribution using contrastive logit attribution; and (3) Probing-based Causal Hallucination Detection through linear probes on disentangled features. Extensive experiments on Gemma-2-9B demonstrate that HalluSAE achieves state-of-the-art hallucination detection performance.

cs.CL↗

arXiv2026

Lyapunov Probes for Hallucination Detection in Large Foundation Models

We address hallucination detection in Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) by framing the problem through the lens of dynamical systems stability theory. Rather than treating hallucination as a straightforward classification task, we conceptualize (M)LLMs as dynamical systems, where factual knowledge is represented by stable equilibrium points within the representation space. Our main insight is that hallucinations tend to arise at the boundaries of knowledge-transition regions separating stable and unstable zones. To capture this phenomenon, we propose Lyapunov Probes: lightweight networks trained with derivative-based stability constraints that enforce a monotonic decay in confidence under input perturbations. By performing systematic perturbation analysis and applying a two-stage training process, these probes reliably distinguish between stable factual regions and unstable, hallucination-prone regions. Experiments on diverse datasets and models demonstrate consistent improvements over existing baselines.

cs.CV↗

arXiv2026

Replacing Parameters with Preferences: Federated Alignment of Heterogeneous Vision-Language Models

VLMs have broad potential in privacy-sensitive domains such as healthcare and finance, yet strict data-sharing constraints render centralized training infeasible. FL mitigates this issue by enabling decentralized training, but practical deployments face challenges due to client heterogeneity in computational resources, application requirements, and model architectures. We argue that while replacing data with model parameters characterizes the present of FL, replacing parameters with preferences represents a more scalable and privacy-preserving future. Motivated by this perspective, we propose MoR, a federated alignment framework based on GRPO with Mixture-of-Rewards for heterogeneous VLMs. MoR initializes a visual foundation model as a KL-regularized reference, while each client locally trains a reward model from local preference annotations, capturing specific evaluation signals without exposing raw data. To reconcile heterogeneous rewards, we introduce a routing-based fusion mechanism that adaptively aggregates client reward signals. Finally, the server performs GRPO with this mixed reward to optimize the base VLM. Experiments on three public VQA benchmarks demonstrate that MoR consistently outperforms federated alignment baselines in generalization, robustness, and cross-client adaptability. Our approach provides a scalable solution for privacy-preserving alignment of heterogeneous VLMs under federated settings.

cs.AI↗

arXiv2026

Nonlinear Public Goods Game in Dynamical Environments

The evolutionary mechanisms of cooperative behavior represent a fundamental topic in complex systems and evolutionary dynamics. Real-world collective interactions, particularly in multi-agent systems, are often characterized by behavior-dependent mechanism switching where the environmental state is endogenously shaped by group strategies. However, existing models typically treat such environmental variations as static stochasticity and neglect the closed-loop feedback between environmental states and cooperative behaviors. Here, we introduce a dynamic environmental feedback mechanism into a nonlinear public goods game framework to establish a coevolutionary model that couples environmental states and individual cooperative strategies. Our results demonstrate that the interplay among environmental feedback, nonlinear effects, and environmental randomness can drive the system toward a wide variety of steady-state structures, including full defection, full cooperation, stable coexistence, and periodic limit cycles. Further analysis reveals that asymmetric nonlinear parameters and environmental feedback rates exert significant regulatory effects on cooperation levels and system dynamics. This study not only enriches the theoretical framework of evolutionary game theory but also provides a foundation for modeling environmental feedback loops in scenarios ranging from ecological management to the design of cooperative mechanisms in autonomous systems.

nlin.AO↗

arXiv2026

Indirect Reciprocity with Environmental Feedback

Indirect reciprocity maintains cooperation in stranger societies by mapping individual behaviors onto reputation signals via social norms. Existing theoretical frameworks assume static environments with constant resources and fixed payoff structures. However, in real-world systems, individuals' strategic behaviors not only shape their reputation but also induce collective-level resource changes in ecological, economic, or other external environments, which in turn reshape the incentives governing future individual actions. To overcome this limitation, we establish a co-evolutionary framework that couples moral assessment, strategy updating, and environmental dynamics, allowing the payoff structure to dynamically adjust in response to the ecological consequences of collective actions. We find that this environmental feedback mechanism helps lower the threshold for the emergence of cooperation, enabling the system to spontaneously transition from a low-cooperation state to a stable high-cooperation regime, thereby reducing the dependence on specific initial conditions. Furthermore, while lenient norms demonstrate adaptability in static environments, norms with strict discrimination are shown to be crucial for curbing opportunism and maintaining evolutionary resilience in dynamic settings. Our results reveal the evolutionary dynamics of coupled systems involving reputation institutions and environmental constraints, offering a new theoretical perspective for understanding collective cooperation and social governance in complex environments.

physics.soc-ph↗

arXiv2026

Less is More: Compact Clue Selection for Efficient Retrieval-Augmented Generation Reasoning

Current RAG retrievers are designed primarily for human readers, emphasizing complete, readable, and coherent paragraphs. However, Large Language Models (LLMs) benefit more from precise, compact, and well-structured input, which enhances reasoning quality and efficiency. Existing methods rely on reranking or summarization to identify key sentences, but may introduce semantic breaks and unfaithfulness. Thus, efficiently extracting and organizing answer-relevant clues from large-scale documents while reducing LLM reasoning costs remains challenging in RAG systems. Inspired by Occam's razor, we frame LLM-centric retrieval as MinMax optimization: maximizing the extraction of potential clues and reranking them for well-organization, while minimizing reasoning costs by truncating to the smallest sufficient set of clues. In this paper, we propose CompSelect, a compact clue selection mechanism for LLM-centric RAG, consisting of a clue extractor, a reranker, and a truncator. (1) The clue extractor first uses answer-containing sentences as fine-tuning targets, aiming to extract sufficient potential clues; (2) The reranker is trained to prioritize effective clues based on real LLM feedback; (3) The truncator uses the truncated text containing the minimum sufficient clues for answering the question as fine-tuning targets, thereby enabling efficient RAG reasoning. Experiments on three QA datasets demonstrate that CompSelect improves performance while reducing both total and online latency compared to a range of baseline methods. Further analysis also confirms its robustness to unreliable retrieval and generalization across different scenarios.

cs.CL↗

arXiv2025

Emergence, Evolution and Manipulation of Swing Voters in Presidential Election

Political polarization, fueled by public discourse and echo chambers, threatens the foundation of democratic elections. However, traditional one-dimensional opinion models -- assuming ``support for one party equals opposition to another'' -- fail to capture the nuanced dynamics of swing voters (including neutrals, left leaners and right leaners), who are critical for the final election outcomes. This study introduces a two-dimensional opinion model that classifies voters into five groups, enabling precise characterization of the swing group's interactive behaviors. Importantly, we introduce antagonism effect to describe the intensities with which the two camps incite opposition and exert voting pressure in the run-up to the election, typically via Us-versus-Them framing. By integrating the open-mindedness of voters, the stubbornness of opinion interactions, and the antagonism effect manipulated by the two parties, we systematically explore the intricate interplay between top-down political campaigns and bottom-up interpersonal opinion dynamics, unveiling their nonlinear coupling impacts on the emergence, and evolution of swing voters. Counterintuitively, we find that extreme antagonism effects might backfire in presidential election: when both parties adopt intense antagonistic strategies, the party that polarizes more strongly risks alienating swing voters, thereby enabling its ostensibly weaker opponent to prevail. These insights are also validated on the core retweet networks during 2020 U.S. presidential election. Building upon multidimensional opinion model, our results highlight the possibility of manipulating swing voters and shaping electoral outcomes through antagonistic strategies of political parties. Our work also provides a nuanced and generalizable framework for analyzing opinion dynamics in other polarized public discourse.

physics.soc-ph↗

arXiv2025

Toward a Realistic Encoding Model of Auditory Affective Understanding in the Brain

In affective neuroscience and emotion-aware AI, understanding how complex auditory stimuli drive emotion arousal dynamics remains unresolved. This study introduces a computational framework to model the brain's encoding of naturalistic auditory inputs into dynamic behavioral/neural responses across three datasets (SEED, LIRIS, self-collected BAVE). Guided by neurobiological principles of parallel auditory hierarchy, we decompose audio into multilevel auditory features (through classical algorithms and wav2vec 2.0/Hubert) from the original and isolated human voice/background soundtrack elements, mapping them to emotion-related responses via cross-dataset analyses. Our analysis reveals that high-level semantic representations (derived from the final layer of wav2vec 2.0/Hubert) exert a dominant role in emotion encoding, outperforming low-level acoustic features with significantly stronger mappings to behavioral annotations and dynamic neural synchrony across most brain regions ($p < 0.05$). Notably, middle layers of wav2vec 2.0/hubert (balancing acoustic-semantic information) surpass the final layers in emotion induction across datasets. Moreover, human voices and soundtracks show dataset-dependent emotion-evoking biases aligned with stimulus energy distribution (e.g., LIRIS favors soundtracks due to higher background energy), with neural analyses indicating voices dominate prefrontal/temporal activity while soundtracks excel in limbic regions. By integrating affective computing and neuroscience, this work uncovers hierarchical mechanisms of auditory-emotion encoding, providing a foundation for adaptive emotion-aware systems and cross-disciplinary explorations of audio-affective interactions.

eess.AS↗

arXiv2025

Higher-order network adaptivity: co-evolution of higher-order structure and spreading dynamics

The co-evolution of structure and dynamics, known as adaptivity, is a fundamental property in various systems and drives diverse emergent behaviors. However, the adaptivity in previous works is primarily stemmed from pairwise situations, while is insufficient to capture ubiquitous higher-order characteristics of real systems. Here, we introduce higher-order network adaptivity to model the co-evolution of higher-order structure and spreading dynamics, and theoretically analyze the thresholds and spreading sizes. Results demonstrate that both pairwise-like and higher-order adaptivity consistently increase spreading thresholds, but surprisingly produce completely opposing qualitative effects. Specifically, contrary to pairwise-like adaptivity, higher-order adaptivity not only reduces or even eliminates the bistable region, but also leads to shifts of phase transitions from discontinuous to continuous. These findings are validated on both synthetic and real hypergraphs. Our work introduces an idea of higher-order adaptivity and highlights its fundamental differences from pairwise-like adaptivity, advancing further researches of adaptive higher-order systems.

physics.soc-ph↗

arXiv2025

Evolution of cooperation and competition in multilayer networks

Cooperation and competition coexist and coevolve in natural and social systems. Cooperation generates resources, which in turn, drive non-cooperative competition to secure individual shares. How this complex interplay between cooperation and competition shapes the evolution of social dilemmas and welfare remains unknown. In this study, we introduce a two-layer evolutionary game model, in which one layer is a cooperative public goods game, and the other is a competitive involution game, with cross-layer feedback linking the two. We find that feedback can either promote or inhibit cooperation, depending on the baseline conditions. For example, moderate resource and synergy factor values can promote social welfare when feedback strength is large. This provides an approach to adjusting the strength and asymmetry of cross-layer feedback to promote cooperation and social welfare. We thus emphasize the importance of managing feedback mechanisms to balance cooperation and competition in complex social systems.

physics.soc-ph↗

arXiv2025

ContribChain: A Stress-Balanced Blockchain Sharding Protocol with Node Contribution Awareness

Existing blockchain sharding protocols have focused on eliminating imbalanced workload distributions. However, even with workload balance, disparities in processing capabilities can lead to differential stress among shards, resulting in transaction backlogs in certain shards. Therefore, achieving stress balance among shards in the dynamic and heterogeneous environment presents a significant challenge of blockchain sharding. In this paper, we propose ContribChain, a blockchain sharding protocol that can automatically be aware of node contributions to achieve stress balance. We calculate node contribution values based on the historical behavior to evaluate the performance and security of nodes. Furthermore, we propose node allocation algorithm NACV and account allocation algorithm P-Louvain, which both match shard performance with workload to achieve stress balance. Finally, we conduct extensive experiments to compare our work with state-of-the-art baselines based on real Ethereum transactions. The evaluation results show that P-Louvain reduces allocation execution time by 86% and the cross-shard transaction ratio by 7.5%. Meanwhile, ContribChain improves throughput by 35.8% and reduces the cross-shard transaction ratio by 16%.

cs.NI↗

arXiv2025

CodeBC: A More Secure Large Language Model for Smart Contract Code Generation in Blockchain

Large language models (LLMs) excel at generating code from natural language instructions, yet they often lack an understanding of security vulnerabilities. This limitation makes it difficult for LLMs to avoid security risks in generated code, particularly in high-security programming tasks such as smart contract development for blockchain. Researchers have attempted to enhance the vulnerability awareness of these models by training them to differentiate between vulnerable and fixed code snippets. However, this approach relies heavily on manually labeled vulnerability data, which is only available for popular languages like Python and C++. For low-resource languages like Solidity, used in smart contracts, large-scale annotated datasets are scarce and difficult to obtain. To address this challenge, we introduce CodeBC, a code generation model specifically designed for generating secure smart contracts in blockchain. CodeBC employs a three-stage fine-tuning approach based on CodeLlama, distinguishing itself from previous methods by not relying on pairwise vulnerability location annotations. Instead, it leverages vulnerability and security tags to teach the model the differences between vulnerable and secure code. During the inference phase, the model leverages security tags to generate secure and robust code. Experimental results demonstrate that CodeBC outperforms baseline models in terms of BLEU, CodeBLEU, and compilation pass rates, while significantly reducing vulnerability rates. These findings validate the effectiveness and cost-efficiency of our three-stage fine-tuning strategy, making CodeBC a promising solution for generating secure smart contract code.

cs.CR↗

arXiv2025

HiPART: Hierarchical Pose AutoRegressive Transformer for Occluded 3D Human Pose Estimation

Existing 2D-to-3D human pose estimation (HPE) methods struggle with the occlusion issue by enriching information like temporal and visual cues in the lifting stage. In this paper, we argue that these methods ignore the limitation of the sparse skeleton 2D input representation, which fundamentally restricts the 2D-to-3D lifting and worsens the occlusion issue. To address these, we propose a novel two-stage generative densification method, named Hierarchical Pose AutoRegressive Transformer (HiPART), to generate hierarchical 2D dense poses from the original sparse 2D pose. Specifically, we first develop a multi-scale skeleton tokenization module to quantize the highly dense 2D pose into hierarchical tokens and propose a Skeleton-aware Alignment to strengthen token connections. We then develop a Hierarchical AutoRegressive Modeling scheme for hierarchical 2D pose generation. With generated hierarchical poses as inputs for 2D-to-3D lifting, the proposed method shows strong robustness in occluded scenarios and achieves state-of-the-art performance on the single-frame-based 3D HPE. Moreover, it outperforms numerous multi-frame methods while reducing parameter and computational complexity and can also complement them to further enhance performance and robustness.

cs.CV↗

arXiv2025

Expertise diversity of teams predicts originality and long-term impact in science and technology

Despite the growing importance of teams in producing innovative and high-impact science and technology, it remains unclear how expertise diversity among team members relates to the originality and impact of the work they produce. Here, we develop a new method to quantify the expertise distance of researchers based on their prior career histories and apply it to 23 million scientific publications and 4 million patents. We find that across science and technology, expertise-diverse teams tend to produce work with greater originality. Teams with more diverse expertise have no significant impact advantage in the short- (2 years) or mid-term (5 years). Instead, they exhibit substantially higher long-term impact (10 years), increasingly attracting larger cross-disciplinary influence. This impact premium of expertise diversity among team members becomes especially pronounced when other dimensions of team diversity are missing, as teams within the same institution or country appear to disproportionately reap the benefits of expertise diversity. While gender-diverse teams have relatively higher impact on average, teams with varied levels of gender diversity all seem to benefit from increased expertise diversity. Given the growing knowledge demands on individual researchers, implementation of incentives for original research, and the tradeoffs between short-term and long-term impacts, these results may have implications for funding, assembling, and retaining teams with originality and long-lasting impacts.

physics.soc-ph↗

arXiv2025

Know Your Account: Double Graph Inference-based Account De-anonymization on Ethereum

The scaled Web 3.0 digital economy, represented by decentralized finance (DeFi), has sparked increasing interest in the past few years, which usually relies on blockchain for token transfer and diverse transaction logic. However, illegal behaviors, such as financial fraud, hacker attacks, and money laundering, are rampant in the blockchain ecosystem and seriously threaten its integrity and security. In this paper, we propose a novel double graph-based Ethereum account de-anonymization inference method, dubbed DBG4ETH, which aims to capture the behavioral patterns of accounts comprehensively and has more robust analytical and judgment capabilities for current complex and continuously generated transaction behaviors. Specifically, we first construct a global static graph to build complex interactions between the various account nodes for all transaction data. Then, we also construct a local dynamic graph to learn about the gradual evolution of transactions over different periods. Different graphs focus on information from different perspectives, and features of global and local, static and dynamic transaction graphs are available through DBG4ETH. In addition, we propose an adaptive confidence calibration method to predict the results by feeding the calibrated weighted prediction values into the classifier. Experimental results show that DBG4ETH achieves state-of-the-art results in the account identification task, improving the F1-score by at least 3.75% and up to 40.52% compared to processing each graph type individually and outperforming similar account identity inference methods by 5.23% to 12.91%.

cs.SI↗

arXiv2024

MaFeRw: Query Rewriting with Multi-Aspect Feedbacks for Retrieval-Augmented Large Language Models

In a real-world RAG system, the current query often involves spoken ellipses and ambiguous references from dialogue contexts, necessitating query rewriting to better describe user's information needs. However, traditional context-based rewriting has minimal enhancement on downstream generation tasks due to the lengthy process from query rewriting to response generation. Some researchers try to utilize reinforcement learning with generation feedback to assist the rewriter, but these sparse rewards provide little guidance in most cases, leading to unstable training and generation results. We find that user's needs are also reflected in the gold document, retrieved documents and ground truth. Therefore, by feeding back these multi-aspect dense rewards to query rewriting, more stable and satisfactory responses can be achieved. In this paper, we propose a novel query rewriting method MaFeRw, which improves RAG performance by integrating multi-aspect feedback from both the retrieval process and generated results. Specifically, we first use manual data to train a T5 model for the rewriter initialization. Next, we design three metrics as reinforcement learning feedback: the similarity between the rewritten query and the gold document, the ranking metrics, and ROUGE between the generation and the ground truth. Inspired by RLAIF, we train three kinds of reward models for the above metrics to achieve more efficient training. Finally, we combine the scores of these reward models as feedback, and use PPO algorithm to explore the optimal query rewriting strategy. Experimental results on two conversational RAG datasets demonstrate that MaFeRw achieves superior generation metrics and more stable training compared to baselines.

cs.CL↗

arXiv2024

Indirect reciprocity in the public goods game with collective reputations

Indirect reciprocity unveils how social cooperation is founded upon moral systems. Within the frame of dyadic games based on individual reputations, the "leading-eight" strategies distinguish themselves in promoting and sustaining cooperation. However, in the real-world societies, there are widespread interactions at the group level, where individuals need to make a singular action choice when facing multiple individuals with different reputations. Here, through introducing the assessment of collective reputations, we develop a framework that embeds group-level reputation structure into public goods game to study the evolution of group-level indirect reciprocity. We show that changing the criteria of group assessment destabilize the reputation dynamics of leading-eight strategies. In a particular range of social assessment criteria, all leading-eight strategies can break the social dilemma in public goods games and sustain cooperation. Specifically, there exists an optimal, moderately set assessment criterion that is most conducive to promoting cooperation. Moreover, in the evolution of assessment criteria, the preference of the leading-eight strategies for social strictness is inversely correlated with the payoff level. Our work reveals the impact of social strictness on prosocial behavior, highlighting the importance of group-level interactions in the analysis of evolutionary games and complex social dynamics.

physics.soc-ph↗