arXiv subjects

Jacob Morrier

Publications and source records attributed to Jacob Morrier.

4 recordsLinked to original sources

arXiv2025

Reinforcement Learning for Efficient Toxicity Detection in Competitive Online Video Games

Online platforms take proactive measures to detect and address undesirable behavior, aiming to focus these resource-intensive efforts where such behavior is most prevalent. This article considers the problem of efficient sampling for toxicity detection in competitive online video games. To make optimal monitoring decisions, video game service operators need estimates of the likelihood of toxic behavior. If no model is available for these predictions, one must be estimated in real time. To close this gap, we propose a contextual bandit algorithm that makes monitoring decisions based on a small set of variables that, according to domain expertise, are associated with toxic behavior. This algorithm balances exploration and exploitation to optimize long-term outcomes and is deliberately designed for easy deployment in production. Using data from the popular first-person action game Call of Duty: Modern Warfare III, we show that our algorithm consistently outperforms baseline algorithms that rely solely on players' past behavior. This finding has substantive implications for the nature of toxicity. It also illustrates how domain expertise can be harnessed to help video game service operators identify and mitigate toxicity, ultimately fostering a safer and more enjoyable gaming experience.

cs.LG↗

arXiv2024

Uncovering the Viral Nature of Toxicity in Competitive Online Video Games

Toxicity is a widespread phenomenon in competitive online video games. In addition to its direct undesirable effects, there is a concern that toxicity can spread to others, amplifying the harm caused by a single player's misbehavior. In this study, we estimate whether and to what extent a player's toxic speech spreads, causing their teammates to behave similarly. To this end, we analyze proprietary data from the free-to-play first-person action game Call of Duty: Warzone. We formulate and implement an instrumental variable identification strategy that leverages the network of interactions among players across matches. Our analysis reveals that all else equal, all of a player's teammates engaging in toxic speech increases their probability of engaging in similar behavior by 26.1 to 30.3 times the average player's likelihood of engaging in toxic speech. These findings confirm the viral nature of toxicity, especially toxic speech, in competitive online video games.

cs.CY↗

arXiv2024

Uncovering the Effect of Toxicity on Player Engagement and its Propagation in Competitive Online Video Games

This article seeks to provide accurate estimates of the causal effect of exposure to toxic language on player engagement and the proliferation of toxic language. To this end, we analyze proprietary data from the first-person action video game Call of Duty: Modern Warfare III, published by Activision. To overcome causal identification problems, we implement an instrumental variables estimation strategy. Our findings confirm that exposure to toxic language significantly affects player engagement and the probability that players use similar language. Accordingly, video game publishers have a vested interest in addressing toxic language. Further, we demonstrate that this effect varies significantly depending on whether toxic language originates from opponents or teammates, whether it originates from teammates in the same party or a different party, and the match's outcome. This has meaningful implications regarding how resources for addressing toxicity should be allocated.

cs.HC↗

arXiv2024

Measuring the Quality of Answers in Political Q&As with Large Language Models

This article proposes a new approach for assessing the quality of answers in political question-and-answer sessions. We measure the quality of an answer based on how easily and accurately it can be recognized in a random set of candidate answers given the question's text. This measure reflects the answer's relevance and depth of engagement with the question. Like semantic search, we can implement this approach by training a language model on the corpus of observed questions and answers without additional human-labeled data. We showcase and validate our methodology within the context of the Question Period in the Canadian House of Commons. Our analysis reveals that while some answers have a weak semantic connection to questions, hinting at some evasion or obfuscation, they are generally at least moderately relevant, far exceeding what we would expect from random replies. We also find a meaningful correlation between answer quality and the party affiliation of the members of Parliament asking the questions.

cs.CL↗