arXiv · 2611.15087
Scaffolding Self-Transduction with Alignment Attention Mask for Aligner-Encoder ASR
Abstract
End-to-end ASR systems must jointly solve speech- text alignment and token prediction from sequence-level super- vision. We study this problem in Aligner-Encoder ASR, where alignment is performed inside encoder self-attention and can thus be directly intervened on with an attention mask. We use forced alignment to build an attention mask that confines selected encoder self-attention heads to a narrow window around the alignment path. The mask is faded out over training, leaving a deployable model with an unmodified inference architecture; alternatively, kept active at training and inference, it serves as an oracle that measures recognition performance once alignment is externally resolved. On LibriSpeech, the faded alignment mask improves test-clean/test-other WER from 3.9/6.4 to 3.5/5.9 over an Aligner baseline. The oracle masks are far stronger, reaching 1.2/2.9 WER, which can be thought of as an upper- bound accuracy in the 100M-class Conformer regime without an external language model. This indicates that alignment inference is a major bottleneck in Aligner-Encoder ASR, and suggests that improved alignment mechanisms might yield substantial accuracy gains for end-to-end ASR.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Jaeyoung Lee, Masato Mimura. 2026-11-11. Scaffolding Self-Transduction with Alignment Attention Mask for Aligner-Encoder ASR. https://arxiv.science/abs/2611.15087
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.