arXiv Science⌕ Search

arXiv subjects

Celeste Kidd

Publications and source records attributed to Celeste Kidd.

2 recordsLinked to original sources

AYO: A Safe and Privacy-Preserving Platform for Studying Children's Interaction with LLMs

Children and adolescents are increasingly interacting with generative AI and large language models (LLMs), yet little is known about how these interactions may influence their development, beliefs, and behavior. Existing research has relied heavily on surveys, while direct study of children's interactions with LLMs presents substantial challenges related to safety, privacy, consent, and experimental control. We introduce AYO (AI Youth Open Science), an open-source platform designed for safe and systematic research on children's interactions with conversational AI. AYO provides a child-friendly interface, configurable age-based safety guardrails, researcher monitoring, and privacy-preserving data practices. These capabilities enable cross-sectional, longitudinal, and experimental research on how children use and respond to LLMs and how AI design may shape trust, epistemic judgment, curiosity, and other aspects of development. AYO provides the infrastructure to generate evidence that guides safer AI systems, educational practices, and policies for children growing up with AI.

cs.AI↗

The Illusion of Understanding: How Middle-Schoolers Fail to Regulate Inquiry with ChatGPT in a Science Task

Generative AI (GenAI) tools allow for effortless task completion, potentially fostering cognitive and metacognitive laziness in students. While surveys indicate widespread GenAI use among students as young as 11, their interactions strategies remain under-explored. A critical indicator of these interactions' quality is the ability to lead Question-Asking (QA) cycles: initiating goal-oriented inquiries, critically evaluating AI responses, and regulating subsequent strategies. While these behaviors predict robust learning in traditional settings, their role in AI-mediated environments remains unclear. Addressing this gap, this study investigates middle school students' (N=63, aged 14--15) capacity to adopt these behaviors with GenAI during science investigation tasks. We analyzed their proficiency in distinguishing efficient goal-oriented prompt from inefficient ones, their critical evaluation of AI responses, and their ability to generate follow-up questions to regulate learning in alignment with their informational needs. Findings reveal a pattern of over-reliance: students struggled to discriminate between prompt types, failed to detect vague AI explanations, and frequently terminated inquiry prematurely, without follow-up. Consequently, task performance remained moderate despite unrestricted AI access and high self-reported prior knowledge. Notably, positive AI attitudes were negatively associated with interaction quality, suggesting a disconnect between perceived and actual competence, whereas higher metacognitive skills predicted superior sensitivity to prompt quality. These results underscore the necessity for AI literacy interventions that move beyond technical understanding to explicitly train metacognitive regulation strategies, required for meaningful and sustainable QA-based learning with GenAI.

cs.CY↗