Zhiqiang Guo | arXiv Science

arXiv2026

SelfDR: Self-Distillation from Reasoning for LLM-Based Recommendation

Large Language Models (LLMs) have recently emerged as powerful backbones for recommendation. To better elicit their capabilities, reasoning has been widely incorporated to help LLMs interpret rich textual signals and improve recommendation accuracy. However, explicitly generating intermediate reasoning traces often incurs substantial computational costs, which limits practical deployment in real-world recommender systems. To address this challenge, we propose SelfDR, a Self-Distillation from Reasoning framework for LLM-based Recommendation. SelfDR distills an LLM's own reasoning-enhanced predictions to produce recommendations directly, improving recommendation effectiveness while maintaining inference efficiency. All components in the framework are built on the same base LLM, without relying on any external models. Specifically, the teacher recommender is constructed by training a reasoner with downstream performance as the reward, enabling it to generate targeted rationales that are later incorporated into the teacher's input. A student recommender for direct recommendation, with the same underlying model, then learns from the teacher through self-distillation with a dynamic weighting strategy. Extensive experiments on three public datasets validate the effectiveness, rationality, and efficiency of SelfDR. Codes are available at https://github.com/JiangDeccc/SelfDistillation.

cs.IR↗

arXiv2026

Integrating LLM and Diffusion-Based Agents for Social Simulation

Large language models (LLMs) offer strong semantic reasoning capabilities for user modeling, but applying LLM-based simulation to an entire social network is computationally expensive and often unreliable for users with sparse behavioral histories. Meanwhile, conventional information diffusion models efficiently exploit historical propagation patterns and social structures, but provide limited understanding of item content and user-item semantic compatibility. We propose HySID, a hybrid framework for individual-level information adoption prediction that combines semantic reasoning with structural diffusion. HySID first analyzes the historical user-relation graph to adaptively select a small set of structurally informative core users. It then applies LLM-based simulation to estimate the engagement of these users and converts the judgments into a diffusion-compatible seed. Finally, a plug-in diffusion backbone propagates this seed through historical interaction structures to rank potential adopters across the full user population. This design enables LLMs to focus on users for whom semantic reasoning is most informative while allowing neural diffusion models to generalize the evidence to users that are not explicitly simulated. Experiments on three real-world datasets from Weibo, Zhihu, and KuaiRand show that HySID consistently improves four diffusion backbones in Recall and NDCG, while outperforming full-population LLM simulation baselines. At the same time, selective simulation reduces LLM inference cost by approximately 83\% to 99.9\%, demonstrating that HySID provides an effective and computationally practical approach to scalable information adoption prediction.

cs.CY↗