arXiv Science⌕ Search
Home/Archive/arXiv

arXiv · 2601.21963

Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems

Alexander Loth·Martin Kappes·Marc-Oliver Pahl
View original source ↗Read source document ↗Export metadata ↓

Abstract

Generative AI and misinformation research has evolved since our 2024 survey. This paper presents an updated perspective, transitioning from literature review to practical countermeasures. We report on changes in the threat landscape, including improved AI-generated content through Large Language Models (LLMs) and multimodal systems. Central to this work are our practical contributions: JudgeGPT, a platform for evaluating human perception of AI-generated news, and RogueGPT, a controlled stimulus generation engine for research. Together, these tools form an experimental pipeline for studying how humans perceive and detect AI-generated misinformation. Our findings show that detection capabilities have improved, but the competition between generation and detection continues. We discuss mitigation strategies including LLM-based detection, inoculation approaches, and the dual-use nature of generative AI. This work contributes to research addressing the adverse impacts of AI on information quality.

Explore related subjects

cs.CYcs.AIcs.CLcs.SI

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Alexander Loth, Martin Kappes, Marc-Oliver Pahl. 2026-02-11. Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems. https://doi.org/10.1145/3774905.3795471

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

LLM-Ideoplasticity: Measuring Ideological Plasticity in the Political Behavior of LLMs as a Context-Conditioned Distribution

We argue, with systematic empirical evidence, that a large language model's political ideology is not a fixed point, but a conditional distribution $\mathbb{P}($position$\mid$context$)$ over a real political space. We evaluate nine current LLMs using a unified measurement framework anchored by VAA-CHES projection models, which map responses onto three validated dimensions (lrgen, lrecon, galtan) across six contextual axes. Our findings reveal high sensitivity to context: persuasive framing and under-represented languages displace coordinates by up to 0.57 and 0.52 units, respectively, while chain-of-thought reasoning often amplifies rather than dampens paraphrase instability. Despite this local plasticity, the model cohort occupies a remarkably narrow Overton envelope overall, occupying roughly one-third the spread of major European parties. Supported by a multi-trait multi-method (MTMM) analysis, we conclude that a single point cannot summarize LLM political behavior; it must be characterized as a shape. Our code and data are publicly available at https://github.com/sakhadib/LLM-Ideoplasticity.

cs.CY↗
arXiv2026

Students' Perceptions of Peer Grading

Peer grading is widely used in education, yet it elicits mixed reactions from educators and students. Although many studies have examined students' views of peer grading, their findings are scattered, and no clear overall picture has emerged. To address this gap, we conducted a mixed-source thematic analysis of literature and student discussions on Reddit. To scale our analysis of the Reddit data, we fine-tuned a Gemini 2.5 text-classification model to classify an initial dataset of 659 posts and 6,607 comments by relevance. Manual review of the items classified as relevant by the model yielded a final dataset of 114 posts and 300 comments. Drawing on evidence from 107 papers and the Reddit dataset, we found that students perceive peer grading as both beneficial and problematic. Positive perceptions included learning and understanding benefits, skill development, engagement, and collaboration, while negative perceptions centered on unreliable grading, unfairness, weak feedback quality, emotional stress, and workload. Reddit discussions also suggested an emerging concern that remains underexplored in the literature: AI use in peer grading may weaken students' trust in the accuracy and authenticity of the process. We further identified eight mitigation strategies and mapped them to the negative perceptions they help address. Among these, instructor oversight and training played the most central role.

cs.CY↗
arXiv2026

Work, Wellbeing, and Choice: Empirical Lessons for AI Futures

Advances in AI-driven automation have raised questions about how humans might find wellbeing in a world where paid employment is less necessary or less available than before. Paid work has been variously characterized as both a contributor and an impediment to human wellbeing. What is already known about the relationship between paid work and wellbeing? What factors influence wellbeing among people who do not work---or who do not need to work? And how might these factors bear upon prospective AI-induced economic transformations? To help provide empirical grounding for these questions, we survey the psychological, sociological, and economic literature that investigates the relationship between wellbeing and work. We draw on evidence from multiple populations, including the unemployed, retirees, lottery winners, and financially dependent spouses. This comparative review draws from studies across OECD countries, China, India, and Gulf states. We identify three key factors that mediate the relationship between work status and wellbeing: (1) agency and choice---whether the exit from work is voluntary or involuntary, as well as long-term agency; (2) the availability of alternative sources of work's latent benefits---such as volunteering, hobbies, or state-provisioned employment; and (3) social and systemic context---including cultural norms around work and the robustness of social safety nets. We draw on these three factors to derive specific implications for different AI automation scenarios, connecting the empirical evidence to concrete policy considerations.

cs.CY↗