Canonical systems and their limits on stable curves

Abstract

We propose an object called 'sepcanonical system' on a stable curve $X_0$ which is to serve as limiting object- distinct from other such limits introduced previously- for the canonical system, as a smooth curve degenerates to $X_0$. First for curves which cannot be separated by 2 or fewer nodes, the so-called '2-inseparable' curves, the sepcanonical system is just the sections of the dualizing sheaf, which is not very ample iff $X_0$ is a limit of smooth hyperelliptic curves (such $X_0$ are called 2-inseparable hyperelliptics). For general, 2-separable curves $X_0$ this assertion is false, leading us to introduce the sepcanonical system, which is a collection of linear systems on the '2-inseparable parts' of $X_0$, each associated to a different twisted limit of the canonical system, where the entire collection varies smoothly with $X_0$. To define sepcanonical system, we must endow the curve with extra structure called an 'azimuthal structure'. We show that the sepcanonical system is 'essentially very ample' unless the curve is a tree-like arrangement of 2-inseparable hyperelliptics. In a subsequent paper, we will show that the latter property is equivalent to the curve being a limit of smooth hyperelliptics, and will essentially give defining equation for the closure of the locus of smooth hyperelliptic curves in the moduli space of stable curves. The current version includes additional references to, among others, Catanese, Maino, Esteves and Caporaso.