arXiv · 2611.14541
Bayesian Evidence Fusion for Capability Tracking-A Simulation Study and Historical CI Pilot
Abstract
SaaS capability assessments can become stale between questionnaires, while delivery telemetry offers incomplete and correlated evidence. Continuous assessment and Bayesian delivery analysis already exist, leaving uncertainty about how biased surveys and missing observations should influence capability estimates.We implement SAAS-MATURITY-TWIN, an anchored Gaussian state model that jointly filters capability proxies and persistent survey offsets. Source covariance prevents correlated observations from being counted independently. Conditional uncertainty supports forecasting and budgeted intervention screening, with action effects estimated from randomized synthetic cohorts. Ten seeds generate forty paired worlds spanning reference observations, extensive missingness, informative missingness, and increased noise. Reference latent root mean squared error is 0.1261, compared with 0.1452 for a tuned moving average; nominal ninety percent intervals cover 90.3 percent. Improved state recovery produces only small incident forecasting differences. Adaptive conformal inference and an adapted conformal PID controller are evaluated separately for observed telemetry, where noise shifts expose calibration limitations. A licensed TravisTorrent pilot evaluates build prediction on 13 074 held out builds from 224 projects. Logistic regression achieves a Brier score of 0.1289, close to random forests. These results support reproducible methodological testing, but do not establish real organizational maturity, intervention effectiveness, or production readiness. Independent calibration and longitudinal validation remain necessary.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Taimoor Ahmad. 2026-10-19. Bayesian Evidence Fusion for Capability Tracking-A Simulation Study and Historical CI Pilot. https://arxiv.science/abs/2611.14541
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.