arXiv Science⌕ Search

arXiv subjects

Wally Toh

Publications and source records attributed to Wally Toh.

1 recordsLinked to original sources

From Viral Exposure to Engagement: A Causal Mediation Framework for Digital Platforms

At Roblox, viral hits can change how exposed players engage with the viral game and with the rest of the platform. We develop a causal mediation framework to decompose the effect of viral-game playtime on subsequent player engagement into a direct effect and indirect effects through measured player interaction and discovery behaviors. The framework uses a causal DAG to state the assumed causal structure and a time-ordered design that measures covariates, exposure, mediators, and outcomes in non-overlapping time windows. Under stated identification assumptions and a model linear in the exposure and each mediator at fixed covariates, we estimate every path as a function of player covariates with cross-fitted R-learners, which use only prediction models and therefore scale to platform-size data. Averaging the fitted surfaces inherits their regularization bias, so we add a per-player bias correction before averaging (Chernozhukov et al., 2018). In simulation, the correction restored nominal coverage of 90% to 95%, against at most 39% for intervals built by averaging the surfaces. Counterintuitively, interval coverage worsened with more data on a difficult mediator-outcome path, bias shrank more slowly than the standard error, reducing corrected coverage from 93.6% to 57.3% as n increased from 2k to 200k. We applied the same design to two de-identified viral games with different lifecycle histories, comparing effects across outcome scopes, player subgroups, and a placebo window without a viral event. The results indicate that subsequent engagement is not explained by viral exposure alone, player interaction behaviors mediate 46% engagement within the viral game, whereas new game discovery mediates 52% engagement in other games. Finally, we compare the estimator with its alternatives and generalize the study design into a reusable framework for similar mediation studies across product domains.

stat.AP↗