Conflicting History in Foundation Model Return Forecasts

Levent Bulut

Home/Archive/arXiv

arXiv · 2610.25822

Conflicting History in Foundation Model Return Forecasts

Levent Bulut

View original source ↗Read source document ↗Export metadata ↓

Abstract

Older observations can help a forecaster learn a predictive relationship while becoming misleading when that relationship changes. We study this tension using paired return histories that differ in older observations but share recent returns and the conditional distribution of the next return. Across five foundation-model forecasting procedures and three simulated processes, each evaluated on 1,024 independent replications, conflicting history reduces the probability of improving on zero in all 30 higher-signal comparisons. This loss of usefulness occurs despite successful signal recovery under stable conditions. A separate exploratory comparison on 56 assets finds that shortening inputs from 256 to 64 returns increases mean absolute error for every model by 1.77-4.58 basis points; neither length improves observed overall error over zero. The evidence distinguishes the ability to extract a signal from the ability to withstand conflicting history, while showing why context sensitivity alone does not justify discarding older data.

Explore related subjects

q-fin.ST

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Levent Bulut. 2026-10-19. Conflicting History in Foundation Model Return Forecasts. https://arxiv.org/abs/2610.25822

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Market Efficiency in a Changing Asset Population: Mobility, Entry, and Survival over Cryptocurrency's Full History

Weak-form efficiency implies symmetry restrictions on the Markov chain governing movement across the cryptocurrency capitalisation distribution. We test them on the full listed population: 8,970 assets, 690 weekly cross-sections, 2013 to 2026, with entry, exit and survival observed rather than inferred. Symmetry is rejected in every era, but the asymmetry falls by seventy percent, and what converged is entry-driven compositional churn rather than coins' own valuations. The bottom decile earns 27.5% per week on paper and nothing among assets that trade, on capacity of $293,000. Compensation for neglect exists precisely where trading does not.

q-fin.ST↗

arXiv2026

More Mentions, Less Information? Diagnosing Identity and Alignment in Reddit Embeddings for Volatility Forecasting

Since the 2021 GameStop short squeeze, r/WallStreetBets (WSB) has been associated with episodes of extreme volatility, and its text is increasingly used to forecast volatility. A model using only large language model (LLM) embeddings of WSB posts attains an out-of-sample $R^2$ of 0.13 for log realized variance. That number shows predictive power, but it does not reveal where the information comes from or how much the text adds beyond a firm's own volatility history. We answer these questions with a diagnostic protocol that nests embeddings on a heterogeneous autoregressive (HAR) benchmark, compares them with text-free firm-identity controls, shuffles the day-to-text pairing within firm-years to test day-specific alignment, and checks whether gains persist across periods and coverage groups. We apply the protocol to frozen LLM embeddings in a panel of 202,145 mentioned stock-days, using retrospective rolling out-of-sample tests over 2015-2022. The results indicate that most of the standalone fit reflects firm or firm-year information: on firms seen in training, a text-free firm baseline reaches $R^2 = 0.32$, shuffling preserves 89-92% of the standalone fit, and masking ticker strings reduces standalone $R^2$ to -0.005. Adding embeddings to HAR reduces equal-date MSE by 1.22% (95% CI [0.94, 1.49]). This small but statistically significant gain survives firm controls and ticker masking, but is largely eliminated by alignment shuffling. The gain is concentrated in 2015-2019 and is not distinguishable from zero in 2020-2022. Expanding coverage by 48% through off-hours and weekend posts adds stock-days with no reliable positive increment. More mentions therefore do not imply more incremental forecasting information.

q-fin.ST↗

arXiv2026

Real-time identification of the onset of financial rogue waves

Extreme events in financial systems, often captured by indicators such as volatility, remain difficult to identify close to their onset. Volatility shares many statistical properties with other natural, complex systems which experience extreme events, which we explore in this manuscript. We extend the analogy between rogue waves in optical and hydrodynamical systems to financial volatility by identifying rogue-wave-like peaks with similar statistical properties. We use a Schrödinger equation where the potential follows the shape of a Kerr nonlinearity to examine the properties of financial volatility indices within a moving time window. We see evidence of Anderson localisation as a rogue peak approaches in the VIX, and show that the numerical gradient of the system's minimum eigenvalue reliably spikes at the onset of an extreme event. We adapt our methodology to simulate the real-time arrival of data, and show that all but one of the VIX's major peaks can be detected given a reasonable amount of history. We then perform two out-of-sample tests, one for the VXO index, and one for the VSTOXX index, and successfully replicate our initial results, identifying all but one major peak (87.5% or 7/8) in both cases. This method of analysis shows considerable promise as a tool for identifying potential financial crises, aiding in their mitigation.

q-fin.ST↗