arXiv Science⌕ Search

arXiv subjects

Michael Schroeder

Publications and source records attributed to Michael Schroeder.

6 recordsLinked to original sources

Why Sub-4-Bit Vision CNNs Collapse and Where Mixed-Precision Recovery Stops

Deep vision models operating in resource-constrained environments depend heavily on low-bit quantization, yet compressing weights below 4 bits frequently induces catastrophic accuracy collapse. While mixed-precision recovery strategies aim to rescue accuracy by selectively retaining high-precision parameters, the fundamental mechanics of where and why these models collapse remain poorly understood. In this study, we systematically analyze the anatomy of quantization collapse across standard Vision CNNs (including ResNet and EfficientNet backbones) evaluated on the full 50,000-image ImageNet-1k validation set. First, we map the exact progression of degradation, demonstrating that collapse is highly non-linear and concentrated in late-stage pointwise projections and depthwise layers. Second, we introduce a structured, multi-step recovery waterfall that evaluates selective integer precision (INT4/INT8) and selective floating-point scales. We show that keeping less than 5% of critical layer activations in 8-bit precision recovers up to 92% of the accuracy lost during aggressive sub-4-bit compression. Finally, we bridge the hardware reality gap by evaluating deployment performance on standard ARM and x86 CPU architectures. We show that while low-bit quantization reduces memory storage requirements, standard runtime software bit-unpacking introduces a 1.48x to 21.5x execution slowdown depending on batch size, highlighting a critical trade-off between model footprint and actual edge throughput. Our findings provide a practical blueprint for navigating the limits of sub-4-bit deployment without sacrificing hardware performance.

cs.AI↗

Where Global Context and Weight Sharing Work in Compact Vision Backbones

Compact convolutional backbones such as EfficientNet achieve strong parameter efficiency through local depthwise separable convolutions, yet two structural questions remain central to hybrid design: where does global self-attention improve recognition over pure convolution, and can repeated blocks share weights without losing representational capacity? We investigate both questions on ImageNet-1k (50,000-image validation) using controlled EfficientNet-B0 experiments. First, we show that wrapping a classification backbone in multi-scale feature pyramids (BiFPN) fails to outperform a plain MBConv trunk (69.99% - 71.81% vs. 72.86% plain B0) until paired with stage attention (73.15%). In contrast, keeping the MBConv trunk intact and inserting lightweight zero-gated residual self-attention adapters at stages P3 (28x28 windowed), P4 (14x14 global), and P5 (7x7 global) reaches 74.02% standalone and outperforms a bit-for-bit matched plain-B0 control by +0.954 percentage points (73.88% vs. 72.92%) across an 88-epoch stateless replay schedule, with learned attention amplitude rising monotonically with semantic depth (27.2% at P3 -> 45.4% at P4 -> 66.3% at P5). Second, we evaluate recurrent weight sharing across repeated MBConv blocks with pass-specific BatchNorm statistics (+1,536 parameters per pass). While post-hoc kernel averaging degrades accuracy to 17.03% and single-template stage tying (-27.6% parameters) plateaus at 66.10%, alternating two shared block templates ([B1, A, B, A]) in Stage 6 cuts total model parameters by 10.9% (582K weights) and recovers by +10.82 points in a single epoch to 70.92% (-1.84 points vs. unshared control).

cs.CV↗

Patterson-Sullivan distributions for symmetric spaces of the noncompact type

We generalize parts of a special non-Euclidean calculus of pseudodifferential operators, which was invented by S. Zelditch for hyperbolic surfaces, to symmetric spaces $X=G/K$ of the noncompact type and their compact quotients $Y=Γ\backslash G/K$. We sometimes restrict our results to the case of rank one symmetric spcaes. The non-Euclidean setting extends the defintion of so-called Patterson-Sullivan distributions, which were first defined by N. Anantharaman and S. Zelditch for hyperbolic systems, in a natural way to arbitrary symmetric spaces of the noncompact type. We find an explicit intertwining operator mapping Patterson-Sullivan distributions into Wigner distributions. We study the important invariance and equivariance properties of these distributions. Finally, we describe asymptotic properties of these distributions.

math.GR↗

Patterson--Sullivan distributions for rank one symmetric spaces of the noncompact type

There is a remarkable relation between two kinds of phase space distributions associated to eigenfunctions of the Laplacian of a compact hyperbolic manifold: It was observed in \cite{AZ} that for compact hyperbolic surfaces $X_Γ=Γ\backslash\mathbb{H}$ Wigner distributions $\int_{S^* X_Γ} a dW_{ir_j} = < \mathrm{Op}(a)ϕ_{ir_j},ϕ_{ir_j} >_{L^2(X_Γ)}$ and Patterson--Sullivan distributions $PS_{ir_j}$ are asymptotically equivalent as $r_j\to\infty$. We generalize the definitions of these distributions to all rank one symmetric spaces of noncompact type and introduce off-diagonal elements $PS_{λ_j,λ_k}$. Further, we give explicit relations between off-diagonal Patterson--Sullivan distributions and off-diagonal Wigner distributions and describe the asymptotic relation between these distributions.

math.SP↗

A Parameterised Hierarchy of Argumentation Semantics for Extended Logic Programming and its Application to the Well-founded Semantics

Argumentation has proved a useful tool in defining formal semantics for assumption-based reasoning by viewing a proof as a process in which proponents and opponents attack each others arguments by undercuts (attack to an argument's premise) and rebuts (attack to an argument's conclusion). In this paper, we formulate a variety of notions of attack for extended logic programs from combinations of undercuts and rebuts and define a general hierarchy of argumentation semantics parameterised by the notions of attack chosen by proponent and opponent. We prove the equivalence and subset relationships between the semantics and examine some essential properties concerning consistency and the coherence principle, which relates default negation and explicit negation. Most significantly, we place existing semantics put forward in the literature in our hierarchy and identify a particular argumentation semantics for which we prove equivalence to the paraconsistent well-founded semantics with explicit negation, WFSX$_p$. Finally, we present a general proof theory, based on dialogue trees, and show that it is sound and complete with respect to the argumentation semantics.

cs.LO↗

Well-Founded Argumentation Semantics for Extended Logic Programming

This paper defines an argumentation semantics for extended logic programming and shows its equivalence to the well-founded semantics with explicit negation. We set up a general framework in which we extensively compare this semantics to other argumentation semantics, including those of Dung, and Prakken and Sartor. We present a general dialectical proof theory for these argumentation semantics.

cs.LO↗