Search for EdWorkingPapers here by author, title, or keywords.
Ten years ago, many policymakers viewed the reform of teacher evaluation as a highly promising mechanism to improve teacher effectiveness and student achievement. Recently, that enthusiasm has dimmed as the available evidence suggests the subsequent reforms had a mixed record of implementation and efficacy. Even in districts where there was evidence of efficacy, the early promise of teacher evaluation may not sustain as these systems mature and change. This study examines the evolving design of IMPACT, the teacher evaluation system in the District of Columbia Public Schools (DCPS). We describe the recent changes to IMPACT which include higher performance standards for lower-performing teachers and a reduced emphasis on value-added test scores. Descriptive evidence on the dynamics of teacher retention and performance under this redesigned system indicate that lower-performing teachers are particularly likely to either leave or improve. Corresponding causal evidence similarly indicates that imminent dismissal threats for persistently low-performing teachers increased both teacher attrition and the performance of returning teachers. These findings suggest teacher evaluation can provide a sustained mechanism for improving the quality of teaching.
Few topics in education policy have received more attention than teacher turnover—and rightly so. The cost of losing a good teacher can be substantial and is born most directly by students. It is now widely recognized that teachers differ considerably in their ability to improve student outcomes, but discussions of teacher turnover rarely reflect these differences. Instead, we typically treat teacher turnover as uniformly negative. In this paper, we examine teacher turnover in the context of rigorous teacher evaluation to explore three questions. How does teacher turnover affect the quality of teaching and student achievement? How does teacher turnover vary by measured teaching effectiveness? And to what extent is the turnover of effective teachers associated with the evaluation system? We examine these questions employing data from the District of Columbia Public Schools. We find that in general turnover improves teacher quality and student achievement, but that this result masks large differences between teachers identified as more and less effective. Turnover among more effective teachers is relatively low, and when more-effective teachers exit, they infrequently report the evaluation system as a reason.
We show that grit, a skill that has been shown to be highly predictive of achievement, is malleable in childhood and can be fostered in the classroom environment. We evaluate a randomized educational intervention implemented in two independent elementary school samples. Outcomes are measured via a novel incentivized real effort task and performance in standardized tests. We find that treated students are more likely to exert effort to accumulate task-specific ability, and hence, more likely to succeed. In a follow up 2.5 years after the intervention, we estimate an effect of about 0.2 standard deviations on a standardized math test.
We study the effect of elementary school teachers’ beliefs about gender roles on student achievement. We exploit a natural experiment where teachers are prevented from self-selecting into schools, and conditional on school, students are allocated to teachers randomly. We show that girls who are taught for longer than a year by teachers with traditional gender views have lower performance in objective math and verbal tests, and this effect is amplified with longer exposure to the same teacher. We find no effect on boys. We show that the effect is partly mediated by teachers transmitting traditional beliefs to girls.
We evaluate the impact on competitiveness of a randomized educational intervention that aims to foster grit, a skill that is highly predictive of achievement. The intervention is implemented in elementary schools, and we measure its impact using a dynamic competition task with interim performance feedback. We find that when children are exposed to a worldview that emphasizes the role of effort in achievement and encourages perseverance, the gender gap in the willingness to compete disappears. We show that the elimination of this gap implies significant efficiency gains. We also provide suggestive evidence on a plausible causal mechanism that runs through the positive impact of enhanced grit on girls’ optimism about their future performance.
We evaluate the impact of a randomized educational intervention on children’s intertemporal choices. The intervention aims to improve the ability to imagine future selves, and encourages forward-looking behavior using a structured curriculum delivered by children’s own trained teachers. We find that treated students make more patient intertemporal decisions in incentivized experimental tasks. The results persist almost 3 years after the intervention, replicate well in a different sample, and are robust across different experimental elicitation methods. The effects also extend beyond experimental outcomes: we find that treated students are significantly less likely to receive a low “behavior grade”.
Despite frequent political and policy debates, the effects of imposing accountability pressures on public school teachers are empirically indeterminate. In this paper, we study the effects of accountability in the context of teacher responses to student behavioral infractions in the aftermath of teacher evaluation reforms. We leverage cross-state variation in the timing of state policy implementation to estimate whether teachers change the rate at which they remove students from their classrooms. We find that higher-stakes teacher evaluation had no causal effect on the rates of disciplinary referrals, and we find no evidence of heterogeneous effects for grades subject to greater accountability pressures or in schools facing differing levels of disciplinary infractions. Our results are precisely estimated and robust to a battery of specification checks. Our findings provide insights on the effects of accountability policy on the black-box of classroom practice and highlight the loose-coupling of education policy and teacher behaviors.
Despite large schooling and learning gains in many developing countries, children in highly deprived areas are often unlikely to achieve even basic literacy and numeracy. We study how much of this problem can be resolved using a multi-pronged intervention combining several distinct interventions known to be effective in isolation. We conducted a cluster-randomized trial in The Gambia evaluating a literacy and numeracy intervention designed for primary-aged children in remote parts of poor countries. The intervention combines para teachers delivering after-school supplementary classes, scripted lesson plans, and frequent monitoring focusing on improving teacher practice (coaching). A similar intervention previously demonstrated large learning gains in a cluster-randomized trial in rural India. After three academic years, Gambian children receiving the intervention scored 46 percentage points (3.2 SD) better on a combined literacy and numeracy test than control children. This intervention holds great promise to address low learning levels in other poor, remote settings.
While the importance of social-emotional learning for student success is well established, educators and researchers have less knowledge and agreement about which social-emotional skills are most important for students and how these skills distribute across student subgroups. Using a rich longitudinal dataset of 221,840 fourth through seventh grade students in California districts, this paper describes growth mindset gaps across student groups, and confirms, at a large scale, the predictive power of growth mindset for achievement gains, even with unusually rich controls for students’ background, previous achievement, and measures of other social-emotional skills. Average annual growth in English language arts and math corresponding to differences between students with fixed and growth mindset in a same school and grade level is 0.07 and 0.05 standard deviations respectively, after adjusting for students’ characteristics and previous achievement. This estimate is equivalent to 48 and 35 additional days of learning.
When charter schools first entered the landscape, the debate was contentious, with both advocates and critics using strong rhetoric. Advocates often sold charter schools as a silver bullet solution for not only the students who attend these schools, but the broader traditional public school system as well. Similarly, critics painted charter schools as an apocalyptic threat to public schools. To inform this debate, research has evolved over time, with much of the first generation (through about 2005) of research studies focusing on the effect charter schools have on test scores almost exclusively using non-experimental designs. The second generation of studies more frequently used experimental designs and broadened the scope of outcomes beyond test scores. Furthermore, the second generation of studies has also included studies seeking to explain the variance in performance. In this survey of the research, we summarize the findings across both generations of studies, but we put a greater emphasis on the second generation than prior literature reviews. This includes an examination of indirect effects, examination of explanation of charter effectiveness, and the recent use of charter schools as a mechanism of turning around low-performing schools.