arXiv Science⌕ Search

arXiv · 2610.22745

Reading the News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock Returns

Abstract

Language models that read financial news are usually trained on text from the same years used to test them, so a backtest can reward hindsight. We build news topics from NoLBERT, an encoder pretrained only on text published between 1976 and 1995, adapted into a sentence encoder by contrastive fine-tuning on passages of the same article, with no labels or returns. We compare it with LDA, MiniLM and FinBERT readers on 1.26 million articles from 2012 to 2024, convert each reader's topics into attention shocks and stock exposures, and forecast the returns of the 1,000 largest US stocks with eight models at three rebalancing frequencies. Models are fitted on 2013-2019, choices are made on 2020-2021, and 2022-2024 is held out. The experiment with the best validation score loses money at every frequency. Measuring attention shocks against the past 63 trading days instead of 5 raises the test rank IC of every reader. NoLBERT gives the most stable topics and forecasts about as well as LDA. An equal-weight combination of all readers and models earns a monthly net Sharpe ratio of 1.12, significant against zero before adjusting for the search but not against a price-only benchmark.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Kevin Foley, Jonathan Hartadi, Shivesh Prakash, Charishma Takkallapalli, Swapnil Vatsal. 2026-10-15. Reading the News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock Returns. https://arxiv.science/abs/2610.22745

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

On the use of case estimate and transactional payment data in neural networks for individual loss reserving

The use of neural networks trained on individual claims data has become increasingly popular in the actuarial reserving literature. We consider how to best input historical payment data in neural network models. Additionally, case estimates are also available in the format of a time series, and we extend our analysis to assessing their predictive power. In this paper, we compare a feed-forward neural network trained on summarised transactions to a recurrent neural network equipped to analyse a claim's entire payment history and/or case estimate development history. We draw conclusions from training and comparing the performance of the models on multiple, comparable highly complex datasets simulated from SPLICE (Avanzi, Taylor and Wang, 2023). In environments where covariate data is limited, we find evidence that case estimates will improve predictions substantially, but that equipping the neural network with memory only leads to meagre improvements. Although the case estimation process and quality will vary significantly between insurers, we provide a standardised methodology for assessing their value.

q-fin.ST↗

Which Past Matters? Training History and Multi-Forecast Horizon in Equity Transformers

More historical data can improve estimation while introducing relationships that transfer poorly to current market conditions. We therefore examine how training quantity and historical selection interact with forecast horizon in intraday equity prediction. We deploy twelve configurations which combine four sampling and validation policies with 6, 12 and 24 month training quantities under a fixed cross-sectional Transformer and feature set. A monthly walk-forward experiment produces 264 refits and eight cumulative return forecasts from 5 to 120 minutes. Evaluation covers January 2025 through 20 October 2026 and uses cross-sectional Spearman information coefficients against future five-factor residual returns. Six-month recency sampling leads individual models at 5-15 minutes, while multi recency configurations lead at 20-30 minutes and uniform configurations at 60-120 minutes. Increasing training quantity does not uniformly improve accuracy while an equal-weight ensemble of all twelve models exceeds every individual mean at 15, 20 and 25 minutes, but not at the remaining horizons. These findings support evaluating historical selection jointly with forecast horizon without identifying a universal policy or a causal benefit from recency.

q-fin.ST↗

EWMA Principal Eigenportfolios of Equity Returns: Market Representation and Beta-Hedging Performance

This study examines whether an adaptively estimated principal eigenportfolio improves equity beta hedging relative to capitalisation-weighted and equal-weighted market benchmarks. Using stock returns from a historically changing S&P 500 universe, it constructs a portfolio from the leading principal component of an exponentially weighted second-moment matrix of volatility-standardised returns. The resulting portfolio, EWMA-PC1, is compared with SPY and RSP under a common beta-hedging procedure across randomly generated portfolios of varying sizes and weighting schemes. Evaluation considers variance reduction and average pairwise residual correlation, with paired blockbootstrap inference. EWMA-PC1 exhibits broad market participation and achieves greater mean variance reduction and lower average residual correlation than SPY across all tested configurations. Its incremental advantage over RSP is smaller and mixed. For 50-stock Dirichlet portfolios, mean variance reduction is 92.17% under PC1, compared with 79.03% under SPY and 91.93% under RSP; RSP instead achieves greater mean variance reduction for multistock liquidity-tilted portfolios. Statistical evidence of improvement is more consistent against SPY than against RSP. These findings distinguish the extraction of a market-like component from incremental hedge effectiveness and highlight the importance of benchmark weighting and targetportfolio composition. The results concern gross statistical risk reduction and exclude additional trading, financing, and borrowing costs.

q-fin.ST↗