arXiv ScienceSearch

arXiv · 2609.00663

Separating perception from reasoning in vision-language models: a model-free render ceiling for crystal structures

Abstract

Multimodal evaluations cannot say whether a vision-language model misread an image or misreasoned about it, because every existing method for separating the two places a second model in the loop. We introduce the render ceiling, a model-free reference for benchmarks built by rendering known objects: inverting the frozen cameras and re-solving cross-view correspondence recovers exactly the answer the images support. We prove the ceiling fails only through an enumerable set of projection coincidences and certify that set empty on 2,160 rendered crystal structures, so every point of a model's deficit belongs to the model. Across fourteen vision-language models, supplying exact geometry as text lifts every model yet closes under half the gap for thirteen, while a supervised vision model with no language component reads the same images at 0.8952, above every vision-language model. The instrument exposes extraction-stage fabrication that downstream accuracy would misattribute to reasoning, yields camera-placement rules for benchmark builders, and transfers to any benchmark with an invertible forward rendering.

Explore related subjects

Keep this discovery

BibTeXRIS

Can Polat, Mustafa Kurban, Erchin Serpedin, Hasan Kurban. 2026-09-01. Separating perception from reasoning in vision-language models: a model-free render ceiling for crystal structures. https://arxiv.org/abs/2609.00663

Cite the original work for its findings. Save a collection to share your selection of sources.

Discover connections

Connections use source metadata and explicit phrase matches, not verified experimental comparisons.

KEEP EXPLORING

Related papers

Polarizable atomic multipoles for learning long-range electrostatics

Long-range electrostatics and polarization remain central obstacles to extending machine learning interatomic potentials (MLIPs) to ionic, polar, and interfacial systems. Here we introduce a semi-local framework for learning electrostatics from energies and forces using polarizable atomic multipoles. Local equivariant descriptors predict environment-dependent latent monopoles, dipoles, and quadrupoles, while residual non-local charge transfer and polarization are captured by non-self-consistent linear response in induced charges and dipoles. Across four diverse benchmarks and four short-range MLIP architectures, the multipole hierarchy and response terms systematically improve potential energy surface accuracy, with the largest gains in systems where long-range effects are essential. More importantly, physically meaningful electrical responses emerge without direct supervision. The learned latent multipoles yield accurate Born effective charge tensors and infrared spectra in close agreement with experiments. The induced-dipole extension introduces new capabilities: it predicts polarizabilities and thereby enables semi-quantitative Raman spectra for bulk water and hybrid MAPbI$_3$ perovskite, as well as the essential features of the surface-specific vibrational sum-frequency generation spectrum at the water-air interface. In ferroelectric HfO$_2$, the predicted electrical response also captures LO-TO splitting and polarization switching. This systematically improvable, physically transparent framework enables MLIPs trained on standard energy and force labels to predict polarization-sensitive observables.

cond-mat.mtrl-sci

A unified geometric design framework for kirigami structures

In recent years, kirigami metamaterials have been widely studied and applied in science and engineering. While various two- and three-dimensional kirigami design methods have been developed, most of them are only applicable to a limited class of kirigami structures. In this work, we develop a unified framework for kirigami design that encompasses a wide range of 2D-to-2D, 2D-to-3D, and 3D-to-3D shape-morphing effects, as well as additional geometric and physical properties such as compact reconfigurability and rigid deployability. In particular, by reformulating the design task as a length-based constrained optimization problem and solving it simultaneously for multiple target states of the kirigami structure, our unified design framework enables greater design flexibility and stronger theoretical support. Experimental results with a wide range of shape-morphing effects are presented to demonstrate the effectiveness of our framework. We further present a rigorous theoretical analysis of several key aspects of kirigami design, covering inertia transposition, aspect-ratio law, and angle defects, thereby elucidating important design rules and limitations. Altogether, our work paves a new way for the design of shape-morphing mechanical metamaterials.

cond-mat.soft

Evaluating LLM-based AI agents integrated with materials synthesis tools: the case of atomic layer deposition

This work provides an overview of the different strategies that can be used to evaluate the performance of AI models and agents based on large language models (LLMs) for materials synthesis. After providing a brief overview of the key technologies behind the current generation of AI agents based on LLMs, we summarize the different approaches to evaluating these models in the context of materials science and in particular on materials synthesis, with a specific emphasis on scenarios in which the models are directly integrated with experimental tools. We discuss evaluation strategies spanning knowledge and reasoning benchmarks, tool-use benchmarks, and closed loop benchmarks involving the interaction with experimental systems or realistic virtual tools. We use atomic layer deposition (ALD) as a case study, emphasizing how existing approaches in the literature both build from general approaches used beyond materials science and can be generalized to other materials synthesis techniques. Finally, we provide a practical evaluation framework to evaluate LLMs in the context of materials synthesis

cond-mat.mtrl-sci