Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

K-12 Education

Emily K. Penner, Dan Ma.

We examine access to high school Ethnic Studies in California, a new graduation requirement beginning in 2029-30. Data from the California Department of Education and the University of California Office of the President indicate that roughly 50 percent of public high school students in 2020-21 attend a school that offers Ethnic Studies or a related course, but as of 2018-19, only 0.2 percent of students were enrolled in such a course. Achieving parity with economics, a current graduation requirement, requires more than doubling the number of Ethnic Studies teachers relative to 2018-19. We also examine school and community factors that predict offering Ethnic Studies and provide descriptive information about the Ethnic Studies teaching force across the state.

More →


Brendan Bartanen, Aliza N. Husain, David D. Liebowitz.

School principals are viewed as critical actors to improve student outcomes, but there remain important methodological questions about how to measure principals’ effects. We propose a framework for measuring principals’ contributions to student outcomes and apply it empirically using data from Tennessee, New York City, and Oregon. As commonly implemented, value-added models misattribute to principals changes in student performance caused by unobserved time-varying factors over which principals exert minimal control, leading to biased estimates of individual principals’ effectiveness and an overstatement of the magnitude of principal effects. Based on our framework, which better accounts for bias from time-varying factors, we find that little of the variation in student test scores or attendance is explained by persistent effectiveness differences between principals. Across contexts, the estimated standard deviation of principal value-added is roughly 0.03 student-level standard deviations in math achievement and 0.01 standard deviations in reading.

More →


Melanie Rucinski.

Prior research has found that economic downturns have positive effects on new teacher quality, but has not been able to determine the extent to which this relationship arises from a supply response (increased quantity or positive selection of teaching candidates) vs. a demand response (selection in hiring enabled by falling demand). In this paper, I use longitudinal data on students and teachers in Massachusetts to describe the effects of higher unemployment rates on both supply and demand for teachers. I show that students who graduate from college when unemployment rates are higher are more likely to take a teacher certification test, and that this effect is stronger among students who were higher achieving while in high school. On the demand side of the market, higher unemployment reduces new teacher hiring and the overall number of teachers employed, but I find no evidence that schools differentially employ higher achieving teaching candidates during economic downturns. While I cannot definitively rule out changes in demand-side selection, I show that much of the positive relationship between unemployment rates and teacher quality can be explained by positively selected supply. My results suggest that economic incentives impact both the quantity and the quality of new teaching candidates, with implications for attracting and retaining high-quality teachers outside of economic downturns.

More →


Beth Schueler, Liz Nigro, John Wang.

The improvement of low-performing school systems is one potential strategy for mitigating educational inequality. Some evidence suggests districtwide reform may be more effective than school-level change, but limited research examines district-level turnaround. There is also little scholarship examining the effects of turnaround reforms on outcomes beyond the first few years of implementation, on outcomes beyond test scores, or on the effectiveness of efforts to replicate district improvement successes beyond an initial reform context. We study these topics in Massachusetts, home to the Lawrence district representing a rare case of demonstrated improvements in the early years of state takeover and turnaround and where state leaders have since intervened in three other contexts as a result. We use statewide student-level administrative data (2006-07 to 2018-19) and event study methods to estimate medium-term reform impacts on test and non-test outcomes across four Massachusetts-based contexts: Lawrence, Holyoke, Springfield, and Southbridge. We find substantial district improvement was possible although sustaining the rate of gains was more complicated. Replicating gains in new contexts was also possible but not guaranteed. 

More →


Quentin Brummet, Lindsay Liebert, Thurston Domina, Paul Yoo, Andrew Penner.

Although existing research suggests that students benefit on a range of outcomes when they enroll in early algebra classes, policy efforts that accelerate algebra enrollment for large numbers of students often have negative effects. Explanations for this apparent contradiction often emphasize the potential role of teacher and peer effects, which could create positive effects for individual students placed into early algebra that would not translate to larger-scale policies. We use detailed data from Oregon that contain information on the teachers and peers to whom students are exposed in order to investigate these explanations. Our regression discontinuity analyses replicate key findings from prior studies, indicating that placement in eighth-grade algebra boosts student achievement in math and English language arts. We then demonstrate that eighth-grade algebra placement positively affects the achievement level of students’ classmates, as well as the years of experience and value added of students’ math teachers. The effects on peer composition that we observe are large enough to plausibly explain the majority of the effects of eighth-grade algebra on student test scores.

More →


Lam D. Pham, Gage F. Matthews, Timothy A. Drake.

While multiple studies have examined the impact of school turnaround, less is known about reforms under the Every Student Succeeds Act (ESSA). To advance this literature, we examine North Carolina’s Restart (NCR) model. NCR aligns with ESSA by giving school leaders increased flexibility. Also, NCR differs from previous turnaround models by repackaging a traditionally sanction-based approach to instead motivate school leaders with increased autonomy. Using comparative interrupted time series models, we find positive NCR effects in math, but not in English Language Arts or on non-test-based student outcomes. Also, nearly a quarter of the positive NCR effect can be explained by decreased teacher and principal turnover. These results provide evidence to support current shifts toward reform models featuring local autonomy.

More →


Lotte van der Haar, Guthrie Gray-Lobe, Michael Kremer, Joost de Laat.

This study reports the findings from a year-long randomized evaluation assessing the impact of assigning 62 classrooms in Nigeria to receive either blocked or interleaved math problem sets. Blocked practice sessions focused on a single skill at a time. Interleaved problem sets alternated between different skills within a practice session. On tests of short-term retention, interleaved practice increased test scores by 0.29 standard deviations. In contrast, we find no evidence that interleaving improves average performance on a cumulative assessment measuring retention of material over the academic year. We find some evidence of large impacts on the cumulative assessment at the bottom of the distribution, but these impacts appear to be offset by negative impacts at the top.

More →


Dorottya Demszky, Jing Liu, Heather C. Hill, Shyamoli Sanghi, Ariel Chung.

While recent studies have demonstrated the potential of automated feedback to enhance teacher instruction in virtual settings, its efficacy in traditional classrooms remains unexplored. In collaboration with TeachFX, we conducted a pre-registered randomized controlled trial involving 523 Utah mathematics and science teachers to assess the impact of automated feedback in K-12 classrooms. This feedback targeted “focusing questions” – questions that probe students’ thinking by pressing for explanations and reflection. Our findings indicate that automated feedback increased teachers’ use of focusing questions by 20%. However, there was no discernible effect on other teaching practices. Qualitative interviews revealed mixed engagement with the automated feedback: some teachers noticed and appreciated the reflective insights from the feedback, while others had no knowledge of it. Teachers also expressed skepticism about the accuracy of feedback, concerns about data security, and/or noted that time constraints prevented their engagement with the feedback. Our findings highlight avenues for future work, including integrating this feedback into existing professional development activities to maximize its effect.

More →


Zid Mancenido, Heather C. Hill, Jeannette Garcia Coppersmith, Hannah Carter, Cynthia Pollard, Chris Monschauer.

Practice-based teacher education has increasingly been adopted as an alternative to more traditional, conceptually-focused pedagogies, yet the field lacks causal evidence regarding the relative efficacy of these approaches. To address this issue, we randomly assigned 185 college students to one of three experimental conditions reflective of common conceptually-focused and practice-based teacher preparation pedagogies. We find significant and large positive effects of practice-based pedagogies on participants’ skills in eliciting and responding to student thinking as demonstrated through a written assessment and a short teaching episode. Our findings contribute to a developing evidence base that can assist policymakers and teacher educators in designing effective teacher preparation at scale.

More →


Xi Yang, Jian Zou.

This paper studies how school spending impacts student achievement by exploiting the US interstate branching deregulation as state tax revenue shocks. Leveraging school finance data from universal school districts, our difference-in-differences estimation reveals that deregulation leads to an increase in per-pupil total revenue and expenditure. The rise in revenue is primarily attributed to higher state revenues, while the expenditure increase is more prominent in low-income school districts. Using restricted-use student assessments from the Nation’s Report Card, we find that deregulation results in improved student achievement, with no distributional effects evident across students’ ability, race, or free lunch status. We introduce an instrumental variables approach that accounts for dynamic treatment effects and estimate that a one-thousand-dollar increase in per-pupil spending leads to a 0.035 standard deviation improvement in student achievement.

More →