An Empirical Investigation of Robustness in Large Language Models under Tabular Distortions
Distortions are a natural consequence of tables collected from real-world sources, where scraping, extraction, or manual intervention can introduce semantic and structural inconsistencies. Humans can often identify and mentally correct such errors autonomously before reasoning over the data. In this work, we investigate whether Large Language Models (LLMs) possess a similar capability by evaluating them on 506 distorted table question answering (TQA) samples derived from canonical tables. Our findings reveal systematic weaknesses in current LLM pre-training paradigms, where models exhibit a strong inductive bias toward assuming tables are well-formed, often overlooking distortions or discarding inconsistent entries instead of repairing them. Even frontier models like GPT-5.4 and Opus-4.6 achieve only 68% accuracy under distortion. While distortion-aware prompting partially mitigates these failures, errors persist. Through lightweight finetuning, we demonstrate that models can learn to autonomously detect and repair human-recoverable distorted tables.