A Practical Framework for Sensitivity Analysis in Externally Controlled Trials: An Illustration with a Bayesian Hybrid Evidence Synthesis Case Study

Abstract

Externally controlled trials (ECTs), including single-arm studies augmented with historical data and hybrid randomized designs with partial external augmentation, are increasingly used when concurrent randomized controls are infeasible or unethical. Regulatory guidance from the FDA, EMA, and NMPA calls for sensitivity analysis of borrowing assumptions, yet provides no structured template for which analyses to run or how to interpret them together. We propose a three-pillar framework organized around three questions: was the borrowing appropriate, did it contribute meaningful value, and are the conclusions robust to perturbation? The framework comprises eight modular analyses covering heterogeneity diagnostics, source influence, no-borrowing references, effective sample size, prior sensitivity, tipping points, alternative borrowing methods, and structural model sensitivity. It is method-agnostic and applies to both Bayesian and frequentist borrowing in patient-level or hybrid settings. We illustrate the framework using simulated data that mimic a hybrid evidence synthesis from a historical approval of ethnic-bridging submission under a real-world-evidence regulatory pathway. That original analysis combined individual patient data from a global pivotal study and a regional real-world study with aggregate data from two published cohorts, fitted via a Bayesian longitudinal model with ethnic-difference parameters. The worked example provides a reproducible template for sensitivity analysis in ECT submissions.