arXiv · 2611.11499
JoMoHa: Joint Model--Harness Optimization with Reinforcement Learning
Abstract
The performance of language agents depends jointly on model weights and the harness. Optimizing either alone can be constrained by the other component, limiting overall performance gains. Our analysis of naive alternating training reveals progressive incompatibility between the model and harness, which increasingly interferes with task execution and may also undermine model training, leading to performance degradation. To coordinate the evolution of models and harnesses, we introduce JoMoHa, to our knowledge the first framework to jointly train an executable harness generation policy and a task execution policy through reinforcement learning. JoMoHa outperforms the evaluated weight-only and harness-only baselines and achieves the highest success rates among the evaluated methods on ALFWorld, WebShop, and DBBench, averaging 70.3% and reaching 97.0% on ALFWorld. By learning both task execution and runtime improvement from its own generated trajectories, JoMoHa performs recursive self-improvement (RSI).
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Xudong Wu, Guangchen Lan, Mingqi Yuan, Jiayu Chen. 2026-11-08. JoMoHa: Joint Model--Harness Optimization with Reinforcement Learning. https://arxiv.science/abs/2611.11499
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.