arXiv ScienceSearch

arXiv subjects

A Rodriguez

Publications and source records attributed to A Rodriguez.

3 recordsLinked to original sources

A logical re-conception of neural networks: Hamiltonian bitwise part-whole architecture

We introduce a simple initial working system in which relations (such as part-whole) are directly represented via an architecture with operating and learning rules fundamentally distinct from standard artificial neural network methods. Arbitrary data are straightforwardly encoded as graphs whose edges correspond to codes from a small fixed primitive set of elemental pairwise relations, such that simple relational encoding is not an add-on, but occurs intrinsically within the most basic components of the system. A novel graph-Hamiltonian operator calculates energies among these encodings, with ground states denoting simultaneous satisfaction of all relation constraints among graph vertices. The method solely uses radically low-precision arithmetic; computational cost is correspondingly low, and scales linearly with the number of edges in the data. The resulting unconventional architecture can process standard ANN examples, but also produces representations that exhibit characteristics of symbolic computation. Specifically, the method identifies simple logical relational structures in these data (part-of; next-to), building hierarchical representations that enable abductive inferential steps generating relational position-based encodings, rather than solely statistical representations. Notably, an equivalent set of ANN operations are derived, identifying a special case of embedded vector encodings that may constitute a useful approach to current work in higher-level semantic representation. The very simple current state of the implemented system invites additional tools and improvements.

cs.LG

On the contrast-dependence of crowding

Visual clutter affects our ability to see: objects that would be identifiable on their own, may become unrecognizable when presented close together ("crowding") -- but the psychophysical characteristics of crowding have resisted simplification. Image properties initially thought to produce crowding have paradoxically yielded unexpected results, e.g., adding flanking objects can ameliorate crowding (Manassi, Sayim et al., 2012; Herzog, Sayim et al., 2015; Pachai, Doerig et al., 2016). The resulting theory revisions have been sufficiently complex and specialized as to make it difficult to discern what principles may underlie the observed phenomena. A generalized formulation of simple visual contrast energy is presented, arising from straightforward analyses of center and surround neurons in the early visual stream. Extant contrast measures, such as RMS contrast, are easily shown to fall out as reduced special cases. The new generalized contrast energy metric surprisingly predicts the principal findings of a broad range of crowding studies. These early crowding phenomena may thus be said to arise predominantly from contrast, or are, at least, severely confounded by contrast effects. (These findings may be distinct from accounts of other, likely downstream, "configural" or "semantic" instances of crowding, suggesting at least two separate forms of crowding that may resist unification.) The new fundamental contrast energy formulation provides a candidate explanatory framework that addresses multiple psychophysical phenomena beyond crowding.

q-bio.NC

The grammar of mammalian brain capacity

Uniquely human abilities may arise from special-purpose brain circuitry, or from concerted general capacity increases due to our outsized brains. We forward a novel hypothesis of the relation between computational capacity and brain size, linking mathematical formalisms of grammars with the allometric increases in cortical-subcortical ratios that arise in large brains. In sum, i) thalamocortical loops compute formal grammars; ii) successive cortical regions describe grammar rewrite rules of increasing size; iii) cortical-subcortical ratios determine the quantity of stacks in single-stack pushdown grammars; iii) quantitative increase of stacks yields grammars with qualitatively increased computational power. We arrive at the specific conjecture that human brain capacity is equivalent to that of indexed grammars, far short of full Turing-computable (recursively enumerable) systems. The work provides a candidate explanatory account of a range of existing human and animal data, addressing longstanding questions of how repeated similar brain algorithms can be successfully applied to apparently dissimilar computational tasks (e.g., perceptual versus cognitive, phonological versus syntactic); and how quantitative increases to brains can confer qualitative changes to their computational repertoire.

q-bio.NC