arXiv Science⌕ Search

arXiv subjects

Abdelkader Metales

Publications and source records attributed to Abdelkader Metales.

2 recordsLinked to original sources

Copies Are Not Confirmations: How News Duplication Fools LLM Judges and Continual Learners

A language model that keeps learning from the news sees the same claim many times, but many reports are copies of one source: wire stories, content shared within a media group, syndication and press releases. We ask whether LLM judges and continual learners treat such copies as independent confirmations. In 200,000 English articles from CC-News, a near-duplicate detector identifies copy links to another outlet for 18.9% of the articles, a detector-based lower bound. In a controlled experiment with claims about invented people, three identical reprints instead of one report raised the lies accepted by Llama 3.2 from 0.06 to 0.71 and by phi4 from 0.21 to 0.90; Gemini 2.5 Flash already believed a single report, and Gemini 2.5 Pro followed provenance information most consistently. In a simulated continual-learning stream, showing the judge one report per detected copy chain cut the copied lies accepted by 0.10-0.24 across four judges, at a mean cost of at most 4.2 points of accepted truths. Text similarity links none of the copies reworded by three LLMs. An entity-novelty test, the share of a report's named entities absent from an earlier look-alike, separates these rewrites from 100 author-labelled independent reports of the same event (AUC 0.98-0.99), statistically indistinguishable from TF-IDF and the best tested embedding model, but recognises only 17% of natural same-source derivatives. With both detectors run on 15,084 real articles carrying inserted claims, one report per chain cut the lies accepted by phi4 from 0.57-0.67 to 0.09 (copies), 0.14 (rewrites) and 0.34 (rewrites with invented details), and by Llama 3.2 from 0.56-0.62 to 0.07, 0.09 and 0.25, at a cost of 2.4 and 10 points of accepted truths. Counting reports or chains without a judge is unreliable, and colluding sources that do not copy each other remain an open problem.

cs.LG↗

Surprise Alone Learns Lies: Evidence-Gated Continual Learning for LLMs from Streaming Claims

Continual learning methods for large language models increasingly decide what to learn by surprise, keeping the inputs the model finds least predictable. This rule is unsafe when the stream contains lies. A planted falsehood about something the model knows has low probability under the model's belief, so it is highly surprising by construction, and a surprise-driven learner absorbs nearly every such lie, at a rate similar to random selection with the same budget. We study the problem with LoRA-adapted students (Qwen2.5-1.5B, Qwen2.5-3B and Llama-3.2-3B) that learn from a stream of true and false claims about invented people and real CounterFact facts. We report four findings. (1) A verifier key, a judge that must approve each claim, removes lies to the extent that its verifier is accurate; real LLM judges are cautious and reject unsourced truths and even source-backed updates. (2) Calibrated regression tests on unrelated knowledge slow learning down without filtering out lies. (3) The original model's own prior flags claims that contradict what it knows, without a judge. It separates lies about known facts from true new facts (AUC 0.78-0.83 across three models) but not from legitimate updates of the same kind of fact (AUC 0.53). It saves 43% of judge calls, but an attacker with access to the model can choose lies that pass it. (4) If trusted sources exist that an attacker cannot plant, routing contradicted claims to evidence recovers legitimate updates and the combined system has the lowest poison rate among learned claims; when an attacker plants matching sources for 30% of the lies, the system ends up worse than the judge alone. The acceptance signals answer different questions, and none of them decides on its own whether a claim is true.

cs.LG↗