arXiv · 2611.14480
Pterodactyl: Pushing the Limits of Efficient Automated Translation Evaluation
Abstract
In this paper, we present 1020 Group's submission to the WMT26 shared task on automated quality evaluation. Our system, Pterodactyl, was engineered specifically for subtasks 2 and 3, that is, segment-level quality score prediction and the detection of error-free segments. Pterodactyl is a highly customizable, ultra-low cost system optimized for binary classification in translation triage and data curation. It is based on an LLM-as-a-judge approach, with prompt engineering and model selection guided by ROC analysis. We also developed several variants of Pterodactyl that were specifically adapted for subtasks 3.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Evelyn Y. Garland, Carola F. Berger. 2026-11-10. Pterodactyl: Pushing the Limits of Efficient Automated Translation Evaluation. https://doi.org/10.18653/2026.wmt-main.96. https://arxiv.science/abs/2611.14480
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.