An Algebra of Transformers

Yong Wang; Zhiyan Wang; Hexiao Kang

Home/Archive/arXiv

arXiv · 2610.36795

An Algebra of Transformers

Yong Wang·Zhiyan Wang·Hexiao Kang

View original source ↗Read source document ↗Export metadata ↓

Abstract

On the theoretic analyses on transforms, they mainly focus on the computability analysis, such the Turing-completeness of unbounded precision transformers, the advantage of parallelizability of unbounded precision transformers and the limitations of bounded precision transformers. This paper give transformers an algebra for reasoning, which relies heavily on the functional decomposition results of transformers. This algebra uses functional decompositions as atomic actions, includes sequential composition and parallel composition, recursion for feedback and abstraction for hidden layers. As we know, it is the first attempt to model transformers logically and can be used to verify the correctness of transformer based applications.

Explore related subjects

cs.LO cs.AI

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Yong Wang, Zhiyan Wang, Hexiao Kang. 2026-10-27. An Algebra of Transformers. https://arxiv.org/abs/2610.36795

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Referential Regimes: Transformation-Based Identity Profiles for Neutral Substrates

Data systems operating under persistent legal, institutional, and analytic disagreement require shared reference without presupposing agreement about interpretation. This paper investigates identity preservation under transformation, building on the conditional neutrality result of Neutral Substrates (arXiv:2601.14271). We pair candidate identity bases with families of record transformations and classify each family as preserving, breaking, neutral, or inapplicable for a basis. Using invariant-defined identity bases and explicit effect models, we derive and certify six classification cells in Lean 4 for scope decomposition, rule refinement, and forking. The derivations show how classifications depend on field granularity, admissible transformation steps, and explicit continuity warrants. We also characterize the identity relations generated by invariant-preserving steps. Two bases generate equal relations exactly when they agree on the preservation of every admissible step in a shared comparison domain, and a single separating step witnesses a difference. The formalization makes identity claims auditable, provides testable conditions for systems that transform records, and exposes the assumptions behind each classification. The results are conditional on the declared bases, models, and warrants, whose adequacy for particular referents requires independent justification.

cs.LO↗

arXiv2026

Normal forms in cubical type theory

This note documents the specification of normal forms in cubical type theory. The definition is already present in the proof of normalization for cubical type theory, but we present it in a more traditional style explicitly for reference.

cs.LO↗

arXiv2026

Automaton-based Characterisations of First Order Logic over Infinite Trees

We study the expressive power of First-Order Logic (\FO) over (unordered) infinite trees, with the aim of identifying robust characterisations in terms of branching-time specification formalisms. While such correspondences are well understood in the linear-time setting, the branching-time case presents well-known structural challenges. To this end, we introduce two classes of hesitant tree automata and show that they capture precisely the expressive power of two branching-time temporal logics, namely \PolPCTL and \CTLsf, both of which have been previously shown to be equivalent to \FO over infinite trees. These results provide uniform automata-theoretic characterisations and yield a natural normal form for the latter in terms of a new fragment of \CTLs called \PolCTLs. As a consequence, we identify a fundamental limitation of \FO in this setting: along each branch, it can express only properties that are either safety or co-safety, thereby revealing a sharp expressive boundary for first-order definability over infinite trees.

cs.LO↗