GenAI Models Capture Urban Science but Oversimplify Complexity

Abstract

Generative artificial intelligence (GenAI) models are increasingly used for scientific data generation, yet their alignment with empirical knowledge in urban science remains unclear. We therefore ask whether generated urban data reproduce empirical regularities and support repeatable experiments. We introduce AI4US, a framework for evaluating data synthesis and conditional intervention across text and image modalities. Four cases spanning urban systems, within-city structure, neighbourhood vitality and streetscape perception are evaluated against published parameters, observed urban data and human judgements. Generated outputs recovered recognizable scaling and distance-decay patterns and yielded measurable associations between neighbourhood morphology indicators and pedestrian activity, while model judgements showed positive agreement with sampled human choices. Controlled changes to urban conditions produced repeatable output responses across all four cases. However, generated data often compressed empirical numerical coverage, local variation and visual diversity. In an inspectable GenAI model, intermediate activations linearly distinguished some urban relationships, while activation edits changed only selected output scores. AI4US provides an empirically grounded approach for assessing GenAI as the virtual urban laboratory in urban data synthesis and controlled model experiments, while revealing its tendency to simplify empirical complexity.