arXiv subjects

David Randahl

Publications and source records attributed to David Randahl.

8 recordsLinked to original sources

arXiv2026

Conflict Forecasting via Conformal Prediction for Markov Processes

Whether or not a country is at war, or experiencing escalating or deescalating levels of conflict, has massive ramifications on a country's national and foreign policy. Given a country's history of conflict, or lack thereof, future predictions about the war-status of a country are valuable information. In this paper, we present the use of conformal prediction on temporally-dependent data to obtain prediction sets of possible future conflict state-sequences. More specifically, we compare the results of conformal prediction to a likelihood-based prediction strategy when the data are assumed to come from a discrete-state Markov process. A point-prediction may not supply sufficient information because the penalty for a wrong prediction is extreme, and so we consider a machine learning alternative that gives valid uncertainty quantification and is robust to model misspecification. In the data analysis, we present real forecasts of conflict dynamics across multiple countries. Lastly, we comment on the possible limitations of existing approaches for applying conformal prediction to Markovian data, where the exchangeability assumption is violated.

stat.ME↗

arXiv2026

pintervals: an R package for model-agnostic prediction intervals

The \pkg{pintervals} package aims to provide a unified framework for constructing prediction intervals and calibrating predictions in a model-agnostic setting using set-aside calibration data. It comprises routines to construct conformal as well as parametric and bootstrapped prediction intervals from any model that outputs point predictions. Several R packages and functions already exist for constructing prediction intervals, but they often focus on specific modeling frameworks or types of predictions, or require manual customization for different models or applications. By providing a consistent interface for a variety of prediction interval construction approaches (all model-agnostic), \pkg{pintervals} allows researchers to apply and compare them across different modeling frameworks and applications.

stat.AP↗

arXiv2024

Bin-Conditional Conformal Prediction of Fatalities from Armed Conflict

Forecasting armed conflicts is a critical area of research with the potential to save lives and mitigate suffering. While existing forecasting models offer valuable point predictions, they often lack individual-level uncertainty estimates, limiting their usefulness for decision-making. Several approaches exist to estimate uncertainty, such as parametric and Bayesian prediction intervals, bootstrapping, quantile regression, but these methods often rely on restrictive assumptions, struggle to provide well-calibrated intervals across the full range of outcomes, or are computationally intensive. Conformal prediction offers a model-agnostic alternative that guarantees a user-specified level of coverage but typically provides only marginal coverage, potentially resulting in non-uniform coverage across different regions of the outcome space. In this paper, we introduce a novel extension called bin-conditional conformal prediction (BCCP), which enhances standard conformal prediction by ensuring consistent coverage rates across user-defined subsets (bins) of the outcome variable. We apply BCCP to simulated data as well as the forecasting of fatalities from armed conflicts, and demonstrate that it provides well-calibrated uncertainty estimates across various ranges of the outcome. Compared to standard conformal prediction, BCCP offers improved local coverage, though this comes at the cost of slightly wider prediction intervals.

stat.ME↗

arXiv2024

Forecasting Densities of Fatalities from State-based Conflicts using Observed Markov Models

In this contribution to the VIEWS 2023 prediction challenge, we propose using an observed Markov model for making predictions of densities of fatalities from armed conflicts. The observed Markov model can be conceptualized as a two-stage model. The first stage involves a standard Markov model, where the latent states are pre-defined based on domain knowledge about conflict states. The second stage is a set of regression models conditional on the latent Markov-states which predict the number of fatalities. In the VIEWS 2023/24 prediction competition, we use a random forest classifier for modeling the transitions between the latent Markov states and a quantile regression forest to model the fatalities conditional on the latent states. For the predictions, we dynamically simulate latent state paths and randomly draw fatalities for each country-month from the conditional distribution of fatalities given the latent states. Interim evaluation of out-of-sample performance indicates that the observed Markov model produces well-calibrated forecasts which outperform the benchmark models and are among the top performing models across the evaluation metrics.

stat.ME↗

arXiv2024

When Sensitivity Bias Varies Across Subgroups: The Impact of Non-uniform Polarity in List Experiments

Survey researchers face the problem of sensitivity bias: since people are reluctant to reveal socially undesirable or otherwise risky traits, aggregate estimates of these traits will be biased. List experiments offer a solution by conferring respondents greater privacy. However, little is know about how list experiments fare when sensitivity bias varies across respondent subgroups. For example, a trait that is socially undesirable to one group may socially desirable in a second group, leading sensitivity bias to be negative in the first group, while it is positive in the second. Or a trait may be not sensitive in one group, leading sensitivity bias to be zero in one group and non-zero in another. We use Monte Carlo simulations to explore what happens when the polarity (sign) of sensitivity bias is non-uniform. We find that a general diagnostic test yields false positives and that commonly used estimators return biased estimates of the prevalence of the sensitive trait, coefficients of covariates, and sensitivity bias itself. The bias is worse when polarity runs in opposite directions across subgroups, and as the difference in subgroup sizes increases. Significantly, non-uniform polarity could explain why some list experiments appear to 'fail'. By defining and systematically investigating the problem of non-uniform polarity, we hope to save some studies from the file-drawer and provide some guidance for future research.

stat.ME↗

arXiv2024

The underreported death toll of wars: a probabilistic reassessment from a structured expert elicitation

Event datasets including those provided by Uppsala Conflict Data Program (UCDP) are based on reports from the media and international organizations, and are likely to suffer from reporting bias. Since the UCDP has strict inclusion criteria, they most likely under-estimate conflict-related deaths, but we do not know by how much. Here, we provide a generalizable, cross-national measure of uncertainty around UCDP reported fatalities that is more robust and realistic than UCDP's documented low and high estimates, and make available a dataset and R package accounting for the measurement uncertainty. We use a structured expert elicitation combined with statistical modelling to derive a distribution of plausible number of fatalities given the number of battle-related deaths and the type of violence documented by the UCDP. The results can help scholars understand the extent of bias affecting their empirical analyses of organized violence and contribute to improve the accuracy of conflict forecasting systems.

stat.ME↗

arXiv2024

This is not normal! (Re-) Evaluating the lower $n$ guidelines for regression analysis

The commonly cited rule of thumb for regression analysis, which suggests that a sample size of $n \geq 30$ is sufficient to ensure valid inferences, is frequently referenced but rarely scrutinized. This research note evaluates the lower bound for the number of observations required for regression analysis by exploring how different distributional characteristics, such as skewness and kurtosis, influence the convergence of t-values to the t-distribution in linear regression models. Through an extensive simulation study involving over 22 billion regression models, this paper examines a range of symmetric, platykurtic, and skewed distributions, testing sample sizes from 4 to 10,000. The results show that it is sufficient that either the dependent or independent variable follow a symmetric distribution for the t-values to converge at much smaller sample sizes than $n=30$, unless the other variable is extremely skewed. This is contrary to previous guidance which suggests that the error term needs to be normally distributed for this convergence to happen at low $n$. However, when both variables are highly skewed, much larger sample sizes are required. These findings suggest the $n \geq 30$ rule is overly conservative in some cases and insufficient in others, offering revised guidelines for determining minimum sample sizes.

stat.ME↗

arXiv2024

The 2023/24 VIEWS Prediction Challenge: Predicting the Number of Fatalities in Armed Conflict, with Uncertainty

This draft article outlines a prediction challenge where the target is to forecast the number of fatalities in armed conflicts, in the form of the UCDP `best' estimates, aggregated to the VIEWS units of analysis. It presents the format of the contributions, the evaluation metric, and the procedures, and a brief summary of the contributions. The article serves a function analogous to a pre-analysis plan: a statement of the forecasting models made publicly available before the true future prediction window commences. More information on the challenge, and all data referred to in this document, can be found at https://viewsforecasting.org/research/prediction-challenge-2023.

stat.AP↗