Instructional practices
Same Idea, Shifting Standards: An Experimental Study of Racial-Ethnic Biases in Ambitious Math Teaching
Topics: MethodsTeacher expectations and judgments about student capabilities are predictive of student achievement, yet such judgments may be influenced by salient dimensions of student identity and invite biases. Moreover, ambitious math teaching may also invite teacher biases due to the emphasis on student-… more →
Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise
Topics: Student LearningGenerative AI, particularly Language Models (LMs), has the potential to transform real-world domains with societal impact, particularly where access to experts is limited. For example, in education, training novice educators with expert guidance is important for effectiveness but expensive,… more →
Effectiveness of Structured Teacher Adaptations to an Online Content Literacy Intervention for Third Graders: A Randomized Controlled Trial During COVID-19
Jackie E. Relyea, Joshua B. Gilbert, Mary A. Burkhauser, Ethan Scherer, Douglas M. Mosher, Zhongyu Wei, Johanna N. Tvedt, James S. Kim.Topics: Student LearningScaling up evidence-based educational interventions to improve student outcomes presents challenges, particularly in adapting to new contexts while maintaining fidelity. Structured teacher adaptations that integrate the strengths of experimental science (high fidelity) and improvement science (… more →
The Decline in Teacher Working Conditions During and After the COVID Pandemic
Topics: Teacher and Leader DevelopmentWe study changes to teacher working conditions from 2016-17 to 2022-23, covering school years before, during, and after the COVID pandemic. We show working conditions were improving leading into the pandemic but declined when the pandemic arrived. Perhaps more surprisingly, the pandemic was not… more →
The Promises and Pitfalls of Using Language Models to Measure Instruction Quality in Education
Topics: MethodsAssessing instruction quality is a fundamental component of any improvement efforts in the education system. However, traditional manual assessments are expensive, subjective, and heavily dependent on observers’ expertise and idiosyncratic factors, preventing teachers from getting timely and… more →
Are Preschool Programs Becoming Less Effective?
Anamarie A. Whitaker, Margaret Burchinal, Jade M. Jenkins, Drew H. Bailey, Tyler W. Watts, Greg J. Duncan, Emma R. Hart, Ellen S. Peisner-Feinberg.Topics: Student LearningHigh-quality preschool programs are heralded as an effective policy tool to promote the development and life-long wellbeing of children from low-income families. Yet evaluations of recent preschool programs produce puzzling findings, including negative impacts, and divergent, weaker results than… more →
The long-term distributional impacts of a full-year interleaving math program in Nigeria
Topics: Student LearningThis study reports the findings from a year-long randomized evaluation assessing the impact of assigning 62 classrooms in Nigeria to receive either blocked or interleaved math problem sets. Blocked practice sessions focused on a single skill at a time. Interleaved problem sets alternated between… more →
Improving Teachers’ Questioning Quality through Automated Feedback: A Mixed-Methods Randomized Controlled Trial in Brick-and-Mortar Classrooms
Topics: Teacher and Leader DevelopmentWhile recent studies have demonstrated the potential of automated feedback to enhance teacher instruction in virtual settings, its efficacy in traditional classrooms remains unexplored. In collaboration with TeachFX, we conducted a pre-registered randomized controlled trial involving 523 Utah… more →
Teacher Preparation, Classroom Structure, and Learning Outcomes for Students with Disabilities
Topics: Student LearningAmple research investigates returns to teacher preparation and other instructional inputs for the general student population, yet evidence is lacking for students with disabilities (SWDs). This study uses North Carolina data to estimate achievement returns to teacher preparation by classroom… more →
Explaining the Productivity Paradox: Experimental Evidence from Educational Technology
Topics: Student LearningExplaining the productivity paradox—the phenomenon where an introduction of information and communication technology (ICT) does not lead to improvements in labor productivity—is difficult, as changes in technology often coincide with adjustments to working hours and substitution of labor. I… more →
Sit Down Now: How Teachers' Language Reveals the Dynamics of Classroom Management Practices
Teachers’ attitudes and classroom management practices critically affect students’ academic and behavioral outcomes, contributing to the persistent issue of racial disparities in school discipline. Yet, identifying and improving classroom management at scale is challenging, as existing methods… more →
Who Benefits from Remote Schooling? Self-Selection and Match Effects
Topics: Student LearningWe study the distributional effects of remote learning. Our approach combines newly collected data on parental preferences with administrative data from Los Angeles. The preference data allow us to account for selection into remote learning while also studying selection patterns and treatment… more →
Implementation Matters: Generalizing Treatment Effects in Education
Topics: MethodsTargeted instruction is one of the most effective educational interventions in low- and middle-income countries, yet reported impacts vary by an order of magnitude. We study this variation by aggregating evidence from prior randomized trials across five contexts, and use the results to inform a… more →
Instructional Alignment is Associated with Sustained Benefits of PreK
Meghan P. McCormick, Cullen MacDowell, Christina Weiland, JoAnn Hsueh, Michelle Maier, Mirjana Pralica, Samuel Maves, Catherine Snow, Jason Sachs.This study uses implementation fidelity data from PreK to 1st grade in the Boston Public Schools (BPS) to measure instructional alignment and examine whether stronger alignment is associated with sustained benefits of BPS PreK on children’s language, literacy, and math skills through first grade… more →
M-Powering Teachers: Natural Language Processing Powered Feedback Improves 1:1 Instruction and Student Outcomes
Topics: Teacher and Leader DevelopmentAlthough learners are being connected 1:1 with instructors at an increasing scale, most of these instructors do not receive effective, consistent feedback to help them improved. We deployed M-Powering Teachers, an automated tool based on natural language processing to give instructors feedback… more →
Heterogeneity of item-treatment interactions masks complexity and generalizability in randomized controlled trials
Ishita Ahmed, Masha Bertling, Lijin Zhang, Andrew D. Ho, Prashant Loyalka, Hao Xue, Scott Rozelle, Benjamin W. Domingue.Topics: MethodsResearchers use test outcomes to evaluate the effectiveness of education interventions across numerous randomized controlled trials (RCTs). Aggregate test data—for example, simple measures like the sum of correct responses—are compared across treatment and control groups to determine whether an… more →
Beginning Teachers & Strategies for Asset-Based Pedagogy
Topics: Teacher and Leader DevelopmentOur study examines roughly 2,000 novice teachers’ responses about how they account for students’ cultural, ethnic/racial, and linguistic diversity. We qualitatively analyze robust open-ended survey responses to explore teachers’ reported strategies for how they integrate asset-based pedagogy (… more →
How Do Homeowners, Teachers, and Students Respond to a Four-Day School Week?
Topics: Families and CommunitiesFaced with decreasing funds and increasing costs, a growing number of school districts across the United States are switching to four-day school weeks (4DSWs). Although previously used only by rural districts, the policy has begun to gain traction in metropolitan districts. We examine homeowner… more →
Teachers’ use of class time and student achievement
Topics: Teacher and Leader DevelopmentWe study teachers’ choices about how to allocate class time across different instructional activities, for example, lecturing, open discussion, or individual practice. Our data come from secondary schools in England, specifically classes preceding GCSE exams. Students score higher in math when… more →
The NCTE Transcripts: A Dataset of Elementary Math Classroom Transcripts
Topics: MethodsClassroom discourse is a core medium of instruction --- analyzing it can provide a window into teaching and learning as well as driving the development of new tools for improving instruction. We introduce the largest dataset of mathematics classroom transcripts available to researchers, and… more →