arXiv ScienceSearch

arXiv · 2207.05872

Exploring the relationship between surface features and explaining quality of YouTube explanatory videos

Abstract

Physics education research on explanatory videos has experienced a boost in recent years. Due to the vast number of explanatory videos available online, e.g. on YouTube, finding videos of high explaining quality is a challenging task for learners, teachers, and lecturers alike. Prior research on the explaining quality of explanatory videos on classical mechanics topics has uncovered that the surface features provided by YouTube (e.g. number of views or likes) do not seem to be suitable indicators of the videos' explaining quality. Instead, the number of content-related comments was found to be statistically significantly correlated with the explaining quality. To date, these findings have only been observed in the context of explanatory videos on classical mechanics topics. The question arises whether similar correlations between the explaining quality and YouTube surface features can be found for videos on topics that are difficult to access visually and verbally, for example from quantum physics. Therefore, we conducted an exploratory study analyzing the explaining quality of N = 60 YouTube videos on quantum entanglement and tunnelling. To this end, we made use of a category-based measure of explanatory videos' explaining quality from the literature. We report correlations between the videos' explaining quality, and the surface features provided by YouTube. On the one hand, our results substantiate earlier findings for mechanics topics. On other hand, partial correlations shed new light on the relationship between YouTube's surface features and explaining quality of explanatory videos.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Philipp Bitzenbauer, Sebastian Höfler, Joaquin M. Veith, Bianca Winkler, Tim Zenger, Christoph Kulgemeyer. 2022-07-12. Exploring the relationship between surface features and explaining quality of YouTube explanatory videos. https://arxiv.org/abs/2207.05872

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The Force Concept Inventory Across Continents: Testing Q-Matrix Transferability and Cross-Cultural Differences in Mechanics Reasoning

The Force Concept Inventory (FCI) is one of the most widely used research-based assessments in physics education, yet the assumption that its underlying cognitive structure is transferable across educational contexts remains largely untested. This study investigates the transferability of FCI Q-matrices using the Generalized Deterministic Inputs, Noisy "And" Gate (G-DINA) cognitive diagnostic applied to two large cohorts: students from the Learning About STEM Student Outcomes (LASSO) online system database in the United States (N = 4,750) and introductory physics students at the University of Johannesburg, South Africa (N = 1,016). Rather than treating the analysis as a local model calibration exercise, we frame the problem as one of cross-context cognitive invariance. Differential Item Functioning (DIF) analyses revealed substantial cross-cultural differences, with 14 of 30 items exhibiting high DIF after controlling for latent skill mastery. These differences were concentrated in force dynamics and contact-force reasoning and remained invariant under alternative Q-matrix specifications. The findings suggest that observed differences reflect genuine variations in students' conceptual reasoning rather than psychometric artifacts, highlighting the importance of validating Q-matrix structures before deploying cognitive diagnostic and adaptive assessments across diverse non-local educational settings.

physics.ed-ph

Inference uncertainty about an aircraft crash

Problem-based learning benefits from situations taken from real life, which usually stimulate student interest. In this paper, we examine the shooting down of the Rwandan president's aircraft on April 6th, 1994. We discuss methods to infer information about the location from which the missile was launched, its trajectory and type, where the aircraft was struck and its trajectory during the fall. To this end, we developed a physics-based analysis based on expert reports, witness statements, and other publicly available information, as interpreted by our calculations. The analysis is designed to be understandable using undergraduate-level physics. The uncertainty of each result is discussed and propagated to ensure a proper assessment of the hypotheses and a traceability of their consequences. Such approach encourages the students to exercise their critical mind and teaches inference methods that are routinely used in physics research. In addition, it illustrates the importance and limits of scientific expertise during a judiciary process.

physics.ed-ph

Skepticism vs. Convenience: Physics Students' Perceptions and Use of Large Language Models Before and After Instruction

The recent emergence of large language models (LLMs) has produced research focusing on the ability of these tools to solve physics problems, evaluate student work, or otherwise impact the problem-solving process of students. However, studies exploring how physics students perceive LLMs (in terms of capabilities, educational impacts, usage, and role in problem solving) remain limited. This study evaluates the first-year physics students' perceptions toward LLMs and further explores how these perceptions change after practicing problem-solving with and without LLMs and engaging in a reflective lesson on the functioning and educational impacts of LLMs. We find that student opinions toward LLMs vary, with generally favorable perceptions of their capabilities but greater skepticism regarding their value for learning. Despite this skepticism, a majority of students self-report regularly using LLMs to obtain help, commonly reporting deadlines and convenience as motivating factors. Following the lesson, students expressed greater skepticism toward LLMs in several areas, with 88% of students believing that LLMs can leave them with a false sense of confidence about their understanding, up from 58% before the lesson.

physics.ed-ph