arXiv · 2611.14557
Probe Before You Preach: Conformal Ambiguity Sets and Neuro-Symbolic Counterfactual Probing for Diagnosing Algebraic Misconceptions in Middle School Mathematics
Abstract
Distinct mathematical misconception rules can produce the same incorrect answer, making diagnosis from a single response ambiguous. We formalize this algebraic collision and derive a conditional Bayes error bound; internally generated reasoning does not add student-specific information beyond its inputs under an explicit conditional-independence assumption. We propose Mondrian Adaptive Conformal Misconception Sets (MACMS) and Symbolic-Verified Counterfactual Micro-Probing (Sym-EIG). MACMS has curriculum-group marginal coverage under exchangeability, not a per-student correctness guarantee. Sym-EIG searches for probes whose outputs separate modeled candidate rules; identification additionally depends on the candidate set and response model. An audit of a local public Eedi graph finds 2,118 of 2,258 linked constructs associated with at least two misconception IDs; construct-level associations alone do not establish same-answer collisions. Other project performance tables require recomputation because their script assigns numerical results directly. No diagnostic performance or classroom learning benefit is claimed here. A classroom study is proposed for future validation.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Caihong Xu, Xiangyu Yu. 2026-11-04. Probe Before You Preach: Conformal Ambiguity Sets and Neuro-Symbolic Counterfactual Probing for Diagnosing Algebraic Misconceptions in Middle School Mathematics. https://arxiv.science/abs/2611.14557
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.