arXiv · 2602.02524
GASTON: Graph-Aware Social Transformer for Online Networks
Abstract
Online communities have become essential places for socialization and support, yet they also possess toxicity, echo chambers, and misinformation. Detecting this harmful content is difficult because the meaning of an online interaction stems from both what is written (textual content) and where it is posted (social norms). We propose GASTON (Graph-Aware Social Transformer for Online Networks), which learns text and user embeddings that are grounded in their local norms, providing the necessary context for downstream tasks. The heart of our solution is a contrastive initialization strategy that pretrains community embeddings based on user membership patterns, capturing a community's user base before processing any text. This allows GASTON to distinguish between communities (e.g., a support group vs. a hate group) based on who interacts there, even if they share similar vocabulary. Experiments on tasks such as stress detection, toxicity scoring, and norm violation demonstrate that the embeddings produced by GASTON outperform state-of-the-art baselines.
Explore related subjects
Keep this discovery
Olha Wloch, Liam Hebert, Robin Cohen, Lukasz Golab. 2026-01-26. GASTON: Graph-Aware Social Transformer for Online Networks. https://arxiv.org/abs/2602.02524
Cite the original work for its findings. Save a collection to share your selection of sources.