Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Educator preparation, professional development, performance and evaluation

Andrew Kwok, Tuan D. Nguyen.

This concurrent mixed methods study descriptively explores teacher residency programs (TRPs) across the nation. We examine program and participant survey data from the National Center for Teacher Residencies (NCTR) to identify important TRP structures for resident support. Latent class analysis of program-level data reveals three types of TRPs (locally-funded low tuition, multi-funded multifaceted, and federally-funded post-residency support), while regression models indicate significant relationships between individual program structures and participant (residents, graduates, mentors, and principals) perceptions. Qualitative analyses of multiple open response items across participants details four salient TRP structures: providing extended clinical experience, localizing individual support, offering programmatic training, and teaching practical professional knowledge. Findings inform policymakers on TRP investment, practitioners about program design, and researchers for continued large-scale evidence.

More →


Kathryn E. Gonzalez, Olivia Healy, Luke Miratrix, Terri J. Sabol.

Despite considerable evidence on the links between average classroom quality and children’s learning, the importance of variation in quality is not well understood. We examined whether three measures of variation in observed classroom quality over the school year – overall variation in quality, teacher-specific trends in quality, and instability in quality – were associated with children’s language, literacy, and regulatory outcomes. We also examined whether variation in quality was associated with teachers’ participation in coaching. Overall variation and instability in emotional support and classroom organization over the year were negatively associated with children’s regulatory and literacy outcomes. Participation in coaching was linked to increased variation only in instructional support. We discuss implications for policies focused on improving classroom quality.

More →


Danielle Sanderson Edwards, Matthew A. Kraft.

“Grow Your Own” (GYO) programs have recently emerged as a promising approach to expand teacher supply, address localized teacher shortages, and diversify the profession. However, little is known about the scale and design of GYO programs, which recruit and support individuals from the local community to become teachers. We conduct a quantitative content analysis to describe 94 GYO initiatives. We find that GYO is used broadly as an umbrella term to describe teacher pipeline programs with very different purposes, participants, and program features. Our results suggest that misalignment between some GYOs’ purposes and program features may inhibit their effectiveness. Finally, we propose a new typology to facilitate more precise discussions of GYO programs.

More →


Sarah Novicoff, Thomas S. Dee.

While policymakers have demonstrated considerable enthusiasm for “science of reading” initiatives, the evidence on the impact of related reforms when implemented at scale is limited. In this pre-registered, quasi-experimental study, we examine California’s recent initiative to improve early literacy across the state’s lowest-performing elementary schools. The Early Literacy Support Block Grant (ELSBG) provided teacher professional development grounded in the science of reading as well as aligned supports (e.g., assessments and interventions), new funding (about $1000 per student), spending flexibility within specified guidelines, and expert facilitation and oversight of school-based planning. We find that ELSBG generated significant (and cost-effective) improvements in ELA achievement in its first two years of implementation (0.14 SD) as well as smaller, spillover improvements in math achievement.

More →


Brendan Bartanen, Aliza N. Husain, David D. Liebowitz.

School principals are viewed as critical actors to improve student outcomes, but there remain important methodological questions about how to measure principals’ effects. We propose a framework for measuring principals’ contributions to student outcomes and apply it empirically using data from Tennessee, New York City, and Oregon. As commonly implemented, value-added models misattribute to principals changes in student performance caused by unobserved time-varying factors over which principals exert minimal control, leading to biased estimates of individual principals’ effectiveness and an overstatement of the magnitude of principal effects. Based on our framework, which better accounts for bias from time-varying factors, we find that little of the variation in student test scores or attendance is explained by persistent effectiveness differences between principals. Across contexts, the estimated standard deviation of principal value-added is roughly 0.03 student-level standard deviations in math achievement and 0.01 standard deviations in reading.

More →


Dorottya Demszky, Jing Liu, Heather C. Hill, Shyamoli Sanghi, Ariel Chung.

While recent studies have demonstrated the potential of automated feedback to enhance teacher instruction in virtual settings, its efficacy in traditional classrooms remains unexplored. In collaboration with TeachFX, we conducted a pre-registered randomized controlled trial involving 523 Utah mathematics and science teachers to assess the impact of automated feedback in K-12 classrooms. This feedback targeted “focusing questions” – questions that probe students’ thinking by pressing for explanations and reflection. Our findings indicate that automated feedback increased teachers’ use of focusing questions by 20%. However, there was no discernible effect on other teaching practices. Qualitative interviews revealed mixed engagement with the automated feedback: some teachers noticed and appreciated the reflective insights from the feedback, while others had no knowledge of it. Teachers also expressed skepticism about the accuracy of feedback, concerns about data security, and/or noted that time constraints prevented their engagement with the feedback. Our findings highlight avenues for future work, including integrating this feedback into existing professional development activities to maximize its effect.

More →


Zid Mancenido, Heather C. Hill, Jeannette Garcia Coppersmith, Hannah Carter, Cynthia Pollard, Chris Monschauer.

Practice-based teacher education has increasingly been adopted as an alternative to more traditional, conceptually-focused pedagogies, yet the field lacks causal evidence regarding the relative efficacy of these approaches. To address this issue, we randomly assigned 185 college students to one of three experimental conditions reflective of common conceptually-focused and practice-based teacher preparation pedagogies. We find significant and large positive effects of practice-based pedagogies on participants’ skills in eliciting and responding to student thinking as demonstrated through a written assessment and a short teaching episode. Our findings contribute to a developing evidence base that can assist policymakers and teacher educators in designing effective teacher preparation at scale.

More →


Rui Wang.

While it is commonly believed that teachers take more absences than other professionals, few empirical studies have systematically investigated the prevalence of teacher absences in the US. This study documents the level of teacher absences and compares it with other college-educated workers. Using the Monthly Current Population Survey between the 1995 and 2019 school years, we conduct descriptive and regression analysis to estimate the level of teacher absences and the absence gaps between teachers and other college-educated workers. Additional regression analysis using data from the Leave Module of the American Time Use Survey is conducted to explain the gaps in absences between teachers and other observationally similar college-educated workers. The analysis reveals that 7% of teachers are absent at least once weekly, accounting for around 4% of their weekly working time. Compared to observationally similar college-educated workers, teachers take the same, if not less, amount of absences. Further investigation of teachers’ absence behaviour indicates that teachers report fewer demands for absences, have fewer paid leaves, and are more likely to attend work despite needing to be absent. We also find that individuals who prefer fewer absences tend to enter the teaching profession. This study adds to the emerging group of research examining the nature, determinants, and consequences of teacher absences using national-level data. Our findings imply that policymakers may be able to use more support programs to increase teacher attendance.

More →


Arielle Boguslav, Julie Cohen.

Teacher preparation programs are increasingly expected to use data on pre-service teacher (PST) skills to drive program improvement and provide targeted supports. Observational ratings are especially vital, but also prone to measurement issues. Scores may be influenced by factors unrelated to PSTs’ instructional skills, including rater standards and mentor teachers’ skills. Yet we know little about how these measurement challenges play out in the PST context. Here we investigate the reliability and sensitivity of two observational measures. We find measures collected during student teaching are especially prone to measurement issues; only 3-4% of variation in scores reflects consistent differences between PSTs, while 9-17% of variation can be attributed to the mentors with whom they work. When high scores stem not from strong instructional skills, but instead from external circumstances, we cannot use them to make consequential decisions about PSTs’ individual needs or readiness for independent teaching.

More →


Moussa Blimpo, Todd Pugatch.

The persistently high employment share of the informal sector makes entrepreneurship a necessity for youth in many developing countries. We exploit exogenous variation in the implementation of Rwanda’s entrepreneurship education reform in secondary schools to evaluate its effect on student economic outcomes up to three years after graduation. Using a randomized controlled trial, we evaluated a three-year intensive training for entrepreneurship teachers, finding pedagogical changes as intended and increased entrepreneurial activity among students. In this paper, we tracked students following graduation and found that increased entrepreneurship persisted one year later, in 2019. Students from treated schools were six percentage points more likely to be entrepreneurs, an increase of 19 percent over the control mean. However, gains in entrepreneurship faded after three years, in 2021. Employment was six percentage points lower in the treatment group. By some measures, income and profits were lower in the treatment group, with no robust differences in these outcomes overall. Lower incomes and profits were concentrated among marginal students induced into entrepreneurship by the program. Youth entrepreneurship programs may therefore steer some participants away from their comparative advantage. Nonetheless, the program increased university enrollment, suggesting the potential for higher long run returns.

More →