arXiv subjects

Eric Brewe

Publications and source records attributed to Eric Brewe.

At least 19 recordsLinked to original sources

arXiv2026

Strategies for Collecting Multi-Institutional Data in Discipline-Based Education Research

Multi-institutional studies are critical for advancing discipline-based education research (DBER) because they allow us to determine where and for whom research findings are applicable. Despite this benefit, such studies remain relatively rare due to the complexities of coordinating data collection across different institutions. In this paper, we describe key challenges and propose actionable strategies for implementing multi-institutional DBER studies. We focus on navigating Institutional Review Board procedures, recruiting participants from a range of institution types, standardizing data sources across institutions, and managing logistics. We also provide an applied example of these strategies from a national research project in which we collected concept inventory data, social network surveys, and classroom observations from 31 introductory physics instructors at 28 institutions in the United States.

physics.ed-ph↗

arXiv2025

Measuring fidelity of implementation of named active learning methods in physics

Various active learning methods have been developed for introductory physics, and these methods are increasingly being adopted by instructors. However, instructors often do not implement these methods exactly as was originally intended by the developers, as they may face issues related to funding and institutional support for active learning and/or have different instructional contexts (e.g., student populations) and environments (e.g., physical classroom layouts) than the developers. Existing research does not sufficiently capture the range of variation in instructor implementation of established active learning methods, especially in comparison to high-fidelity implementations. In this study, we first identify the critical components (i.e., components without which the active learning method cannot be said to have been implemented) of three named active learning methods: SCALE-UP, ISLE, and Tutorials. We then evaluate the fidelity with which 18 different introductory physics instructors implement these methods by analyzing classroom observations and comparing the extent to which these broader implementations use each critical component in their classroom to high-fidelity implementations. We find across all three active learning methods that broader implementations spend similar amounts of class time on the critical components as high-fidelity implementations. At the same time, we observe substantial variation in the specific styles that broader implementers operationalize these critical components (e.g., doing a few long activities versus many short activities). Finally, we find no clear relationship between fidelity of implementation and student conceptual learning gains for our study's sample of instructors, providing preliminary evidence that different ways of implementing the critical components of active learning method may all effectively improve student understanding.

physics.ed-ph↗

arXiv2025

Beyond named methods: A typology of active learning based on classroom observation networks

A growing number of introductory physics instructors are implementing active learning methods in their classrooms, and they are modifying the methods to fit their local instructional contexts. However, we lack a detailed framework for describing the range of what these instructor adaptations of active learning methods look like in practice. Existing studies apply structured protocols to classroom observations and report descriptive statistics, but this approach overlooks the complex nature of instruction. In this study, we apply network analysis to classroom observations to define a typology of active learning that considers the temporal and interactional nature of instructional practices. We use video data from 30 instructors at 27 institutions who implemented one of the following named active learning methods in their introductory physics or astronomy course: Investigative Science Learning Environment (ISLE), Peer Instruction, Tutorials, and Student-Centered Active Learning Environment with Upside-down Pedagogies (SCALE-UP). We identify five types of active learning instruction: clicker lecture, dialogic clicker lecture, dialogic lecture with short groupwork activities, short groupwork activities, and long groupwork activities. We find no significant relationship between these instruction types and the named active learning methods; instead, implementations of each of the four methods are spread across different instruction types. This result prompts a shift in the way we think and talk about active learning: the names of developed active learning methods may not actually reflect the specific activities that happen during instruction. We also find that student conceptual learning does not vary across the identified instruction types, suggesting that instructors may be flexible when modifying these methods without sacrificing effectiveness.

physics.ed-ph↗

arXiv2025

Multi-institutional assessment of Peer Instruction implementation and impacts using the Framework for Interactive Learning in Lectures

Substantial research indicates that active learning methods improve student learning more than traditional lecturing. Accordingly, current studies aim to characterize and evaluate different instructors' implementations of active learning methods. Peer Instruction is one of the most commonly used active learning methods in undergraduate physics instruction and typically involves the use of classroom response systems (e.g., clickers) where instructors pose conceptual questions that students answer individually and/or in collaboration with nearby peers. Several research studies have identified that different instructors vary in the ways they implement Peer Instruction (e.g., the time they give students to answer a question and the time they spend explaining the correct answer); however, these studies only take place at a single institution and do not relate the implementation of Peer Instruction to student learning. In this study, we analyze variation in both the implementation and impacts of Peer Instruction. We use classroom video observations and conceptual inventory data from seven introductory physics instructors across six U.S. institutions. We characterize implementation using the Framework for Interactive Learning in Lectures (FILL+), which classifies classroom activities as interactive (e.g., clicker questions), vicarious interactive (e.g., individual students asking a question), or non-interactive (e.g., instructor lecturing). Our preliminary results suggest that instructors who use both interactive and vicarious interactive strategies may exhibit larger student learning gains than instructors who predominantly use only one of the two strategies.

physics.ed-ph↗

arXiv2025

Evaluating recognition and recall formats of social network surveys in physics education research

An increasing number of studies in physics education research use social network analysis to quantify interactions among students. These studies typically gather data through online surveys using one of two different survey formats: recognition, where students select peers' names from a provided course roster, and recall, where students type their peers' names from memory as an open response. These survey formats, however, may be subject to two possible systematic errors. First, students may report more peers' names on a recognition survey than a recall survey because the course roster facilitates their memory of their interactions, whereas they may only remember a subset of their interactions on the recall format. Second, recognition surveys may be subject to name order effects, where students are more likely to select peers' names that appear early on in the roster than those that appear later on (e.g., due to survey fatigue). Here we report the results of two methodological studies of these possible errors in the context of introductory physics courses: one directly comparing 65 student responses to recognition and recall versions of the same network survey prompt, and the other measuring name order effects on 54 recognition surveys from 27 different courses. We find that students may report more peer interactions on a recognition survey than a recall survey and that most recognition surveys are not subject to significant name order effects. These results help to inform survey design for future network studies in physics education research.

physics.ed-ph↗

arXiv2025

Relative benefits of different active learning methods to conceptual physics learning

It has been shown that active learning methods are more effective than traditional lecturing at improving student conceptual understanding and reducing failure rates in undergraduate physics courses. Researchers have developed distinct, active learning methods that are now widely implemented in introductory physics. However, the relative benefits of these methods remain unknown. Here we present a multi-institutional comparison of the impacts of four well-established active learning methods -- Peer Instruction, Investigative Science Learning Environment (ISLE), Tutorials and Student-Centered Active Learning Environment with Upside-Down Pedagogies (SCALE-UP) -- on conceptual learning. We find measurable increases in student conceptual learning in all four active learning methods, and significantly larger gains in SCALE-UP than in either Peer Instruction or ISLE. Student development of peer networks is similar across the four methods, but classroom activities differ. In many of the observed Peer Instruction and ISLE courses, instructors lecture for a large fraction of class time. In Tutorials and SCALE-UP courses, instructors dedicate most in-class time to student-centred activities such as worksheets and laboratory work. These results prompt future work to identify causal mechanisms between specific classroom activities and conceptual learning and to examine additional factors related to variation in student learning across different methods.

physics.ed-ph↗

arXiv2023

Towards a Generalized Assessment of Computational Thinking for Introductory Physics Students

Computational thinking in physics has many different forms, definitions, and implementations depending on the level of physics, or the institution it is presented in. In order to better integrate computational thinking in introductory physics, we need to understand what physicists find important about computational thinking in introductory physics. We present a qualitative analysis of twenty-six interviews asking academic (N=18) and industrial (N=8) physicists about the teaching and learning of computational thinking in introductory physics courses. These interviews are part of a longer-term project towards developing an assessment protocol for computational thinking in introductory physics. We find that academic and industrial physicists value students' ability to read code and that Python (or VPython) and spreadsheets were the preferred computational language or environment used. Additionally, the interviewees mentioned that identifying the core physics concepts within a program, explaining code to others, and good program hygiene (i.e., commenting and using meaningful variable names) are important skills for introductory students to acquire. We also find that while a handful of interviewees note that the experience and skills gained from computation are quite useful for student's future careers, they also describe multiple limiting factors of teaching computation in introductory physics, such as curricular overhaul, not having "space" for computation, and student rejection. The interviews show that while adding computational thinking to physics students repertoire is important, the importance really comes from using computational thinking to learn and understand physics better. This informs us that the assessment we develop should only include the basics of computational thinking needed to assess introductory physics knowledge.

physics.ed-ph↗

arXiv2022

Understanding the development of interest and self-efficacy in active-learning undergraduate physics courses

Modeling Instruction (MI), an active-learning introductory physics curriculum, has been shown to improve student academic success. Peer-to-peer interactions play a salient role in the MI classroom. Their impact on student interest and self-efficacy -- preeminent constructs of various career theories -- has not been thoroughly explored. Our examination of three undergraduate MI courses (N=221) revealed a decrease in students' physics self-efficacy, physics interest, and general science interest. We found a positive link from physics interest to self-efficacy, and a negative relationship between science interest and self-efficacy. We tested structural equation models confirming that student interactions make positive contributions to self-efficacy. This study frames students' classroom interactions within broader career theory frameworks and suggests nuanced considerations regarding interest and self-efficacy constructs in the context of undergraduate active-learning science courses.

physics.ed-ph↗

arXiv2022

Closeness in a physics faculty online learning community predicts impacts in self-efficacy and teaching

Community-based professional development initiatives have been shown to support physics faculty in their adoption of research-based instructional strategies. Hoping to better understand these initiatives' mechanisms of success, we analyze the results of two surveys administered to a faculty online learning community teaching a common physics curriculum designed primarily for pre-service elementary teachers. We use social network analysis to represent the faculty network and compare members' centrality, a family of measures that capture the prominence of individuals within a network, to their reported experience in the community. We use a principal component analysis of different centrality measures to show that closeness, a measure of how closely connected a person is with every other person in their network, is the most appropriate centrality measure for our network. We then compare regression models according to Bayes factors to find relationships between participants' closeness and their survey responses. We find that participants' self-efficacy, as well as their sense of improvement to their teaching and sense of benefitting from the community, are predictors of their closeness with other participants and thus their breadth and depth of participation in the community. Our results are consistent with other studies that have highlighted interactions among faculty as key components of successful professional development initiatives. They may also be useful for designers of similar communities as they decide how to prioritize time and resources to meet specific goals.

physics.ed-ph↗

arXiv2021

Characterizing active learning environments in physics using latent profile analysis

The vast majority of research involving active learning pedagogies uses passive lecture methods as a baseline. We propose to move beyond such comparisons to understand the mechanisms that make different active learning styles unique. Here, we use COPUS observations to record student and instructor activities in six known styles of active learning in physics, and use latent profile analysis to classify these observations. Latent profile analysis using two profiles successfully groups COPUS profiles into interactive lecture-like and other. Five latent profiles successfully sorts observations into interactive lecture-like, Modeling Instruction, ISLE labs, Context-Rich problems labs, and recitation/discussion-like. This analysis serves as a proof of concept, and suggests instructional differences across pedagogies that can be further investigated using this method.

physics.ed-ph↗

arXiv2020

Characterizing active learning environments in physics using network analysis and COPUS observations

This study uses social network analysis and the Classroom Observation Protocol for Undergraduate STEM (COPUS) to characterize six research-based introductory physics curricula. Peer Instruction, Modeling Instruction, ISLE, SCALE-UP, Context-Rich Problems, and Tutorials in Introductory Physics were investigated. Students in each curriculum were given a survey at the beginning and end of term, asking them to self-identify peers with whom they had meaningful interactions in class. Every curriculum showed an increase in the average number of student connections from the beginning of term to the end of term, with the largest increase occurring in Modeling Instruction, SCALE-UP, and Context-Rich Problems. Modeling Instruction was the only curriculum with a drastic change in how tightly connected the student network was. Transitivity increased for all curricula except Peer Instruction. We also spent one week per research site in the middle of the term observing courses using COPUS. From these observations, the student COPUS profiles look nearly the same for Tutorials, ISLE recitations, and Context-Rich Problems discussion sections. This is likely due to the large resolution of activities that can be coded as "other group activity", suggesting the need for a more detailed observation instrument.

physics.ed-ph↗

arXiv2020

Network positions in active learning environments in physics

This study uses positional analysis to describe the student interaction networks in four research-based introductory physics curricula. Positional analysis is a technique for simplifying the structure of a network into blocks of actors whose connections are more similar to each other than to the rest of the network. This method describes social structure in a way that is comparable between networks of different sizes and densities and can show large-scale patterns such as hierarchy or brokering among actors. We detail the method and apply it to class sections using Peer Instruction, SCALE-UP, ISLE, and context-rich problems. At the level of detail shown in the blockmodels, most of the curricula are more alike than different, showing a late-term tendency to form coherent subgroups that communicate actively among themselves but have few inter-position links. This pattern may be a network signature of active learning classes, but wider data collection is needed to investigate.

physics.ed-ph↗

arXiv2018

Beyond performance metrics: Examining a decrease in students' physics self-efficacy through a social network lens

The Modeling Instruction (MI) approach to introductory physics manifests significant increases in student conceptual understanding and attitudes toward physics. In light of these findings, we investigated changes in student self-efficacy while considering the construct's contribution to the career-decision making process. Students in the Fall 2014 and 2015 MI courses at Florida International University exhibited a decrease on each of the sources of self-efficacy and overall self-efficacy (N = 147) as measured by the Sources of Self-Efficacy in Science Courses-Physics (SOSESC-P) survey. This held true regardless of student gender or ethnic group. Given the highly interactive nature of the MI course and the drops observed on the SOSESC-P, we chose to further explore students' changes in self-efficacy as a function of three centrality measures (i.e., relational positions in the classroom social network): inDegree, outDegree, and PageRank. We collected social network data by periodically asking students to list the names of peers with whom they had meaningful interactions. While controlling for PRE scores on the SOSESC-P, bootstrapped linear regressions revealed post-self-efficacy scores to be predicted by PageRank centrality. When disaggregated by the sources of self-efficacy, PageRank centrality was shown to be directly related to students' sense of mastery experiences. InDegree was associated with verbal persuasion experiences, and outDegree with both verbal persuasion and vicarious learning experiences. We posit that analysis of social networks in active learning classrooms helps to reveal nuances in self-efficacy development.

physics.ed-ph↗

arXiv2017

Educational commitment and social networking: The power of informal networks

The lack of an engaging pedagogy and the highly competitive atmosphere in introductory science courses tend to discourage students from pursuing science, technology, engineering, and mathematics (STEM) majors. Once in a STEM field, academic and social integration has been long thought to be important for students' persistence. Yet, it is rarely investigated. In particular, the relative impact of in-class and out-of-class interactions remains an open issue. Here, we demonstrate that, surprisingly, for students whose grades fall in the "middle of the pack," the out-of-class network is the most significant predictor of persistence. To do so, we use logistic regression combined with Akaike's information criterion to assess in- and out-of-class networks, grades, and other factors. For students with grades at the very top (and bottom), final grade, unsurprisingly, is the best predictor of persistence---these students are likely already committed (or simply restricted from continuing) so they persist (or drop out). For intermediate grades, though, only out-of-class closeness---a measure of one's immersion in the network---helps predict persistence. This does not negate the need for in-class ties. However, it suggests that, in this cohort, only students that get past the convenient in-class interactions and start forming strong bonds outside of class are or become committed to their studies. Since many students are lost through attrition, our results suggest practical routes for increasing students' persistence in STEM majors.

physics.ed-ph↗

arXiv2017

Student perceptions of the value of out-of-class interactions: Attitudes vs. Practice

From industry to government to academia, attracting and retaining science, technology, engineering, and mathematics majors is recognized as a key element of the 21$^{\text{st}}$ century knowledge economy. The ability to retain students seems to be intimately tied with understanding their immersion into the academic and social system of an institution. For instance, it has been noted that insufficient interactions with peers can lead to a low commitment to the university and, ultimately, affect one's decision about whether to drop out. Since nearly half of first-time students who leave a university by the end of the freshman year never come back to college, the importance of understanding experiences in introductory courses as a means for improving students' persistence is particularly pronounced. We investigate students' experiences in an introductory physics courses, focusing on their self-reported perception of the values of out-of-class collaborations. We find that, even though students consider the out-of-class collaborations to be important for success, it takes a relatively long time before they start practicing collaborative learning.

physics.ed-ph↗

arXiv2017

Linking engagement and performance: The social network analysis perspective

Theories developed by Tinto and Nora identify academic performance, learning gains, and involvement in learning communities as significant facets of student engagement that, in turn, support student persistence. Collaborative learning environments, such as those employed in the Modeling Instruction introductory physics course, provide structure for student engagement by encouraging peer-to-peer interactions. Because of the inherently social nature of collaborative learning, we examine student interactions in the classroom using network analysis. We use centrality---a family of measures that quantify how connected or "central" a particular student is within the classroom network---to study student engagement longitudinally. Bootstrapped linear regression modeling shows that students' centrality predicts future academic performance over and above prior GPA for three out of four centrality measures tested. In particular, we find that closeness centrality explains 28 % more of the variance than prior GPA alone. These results confirm that student engagement in the classroom is critical to supporting academic performance. Furthermore, we find that this relationship for social interactions does not emerge until the second half of the semester, suggesting that classroom community develops over time in a meaningful way.

physics.ed-ph↗

arXiv2016

Students' network integration as a predictor of persistence in introductory physics courses

Increasing student retention (successfully finishing a particular course) and persistence (continuing through a sequence of courses or the major area of study) is currently a major challenge for universities. While students' academic and social integration into an institution seems to be vital for student retention, research into the effect of interpersonal interactions is rare. We use network analysis as an approach to investigate academic and social experiences of students in the classroom. In particular, centrality measures identify patterns of interaction that contribute to integration into the university. Using these measures, we analyze how position within a social network in a Modeling Instruction (MI) course -- an introductory physics course that strongly emphasizes interactive learning -- predicts their persistence in taking a subsequent physics course. Students with higher centrality at the end of the first semester of MI are more likely to enroll in a second semester of MI. Moreover, we found that chances of successfully predicting individual student's persistence based on centrality measures are fairly high -- up to $75\%$, making the centrality a good predictor of persistence. These findings suggest that increasing student social integration may help in improving persistence in science, technology, engineering, and mathematics fields.

physics.ed-ph↗

arXiv2015

The impact of social integration on student persistence in introductory Modeling Instruction courses

Increasing student retention and persistence -- in particular classes or in their major area of study -- is a challenge for universities. Students' academic and social integration into an institution seems to be vital for student retention, yet, research on the effect of interpersonal interactions is rare. Social network analysis is an approach that can be used to identify patterns of interaction that contribute to integration into the university. We analyze how students position within a social network in a Modeling Instruction (MI) course that strongly emphasizes interactive learning impacts their persistence in taking a subsequent MI course. We find that students with higher centrality at the end of the first semester of MI are more likely to enroll in a second semester of MI. While the correlation with increased persistence is an ongoing study, these findings suggest that student social integration influences persistence.

physics.ed-ph↗