Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Educator preparation, professional development, performance and evaluation

Virginia S. Lovison.

An increasing share of new teachers enter the profession through alternative certification programs. While these programs increase teacher supply in areas facing critical shortages, they also increase instability in local teacher labor markets via high teacher turnover. A fundamental question is what effect these programs have on student achievement over the long run. To address this question, I study Teach For America (TFA) teachers working in New York City (NYC) between 2012 and 2019. This research brief reports on three key findings. First, I document five-year cumulative retention rates and find that, as expected, retention is lower for TFA teachers (25%) than for other NYC teachers working in similar schools (43%). Second, I estimate within-teacher returns to experience using a teacher fixed effects strategy and find that TFA teachers who continue teaching through year five improve at double the rate of the average NYC teacher. Third, I model the joint relationship between turnover and performance over time and find that the TFA performance advantage is large enough to offset turnover costs. I conclude that the net effect of TFA hiring on student achievement is positive in the short and long run.

More →


Matthew A. Kraft, Megan Conklin, Grace Falken.

We examine the labor supply decisions of substitute teachers – a large, on-demand market with broad shortages and inequitable supply. In 2018, Chicago Public Schools implemented a targeted bonus program designed to reduce unfilled teacher absences in largely segregated Black schools with historically low substitute coverage rates. Using a regression discontinuity design, we find that incentive pay substantially improved coverage equity and raised student achievement. Changes in labor supply were concentrated among Black and Hispanic substitutes from nearby neighborhoods with experience in incentive schools. Wage elasticity estimates suggest incentives would need to be 50% of daily wages to close fill-rate gaps.

More →


Seth B. Hunter, Matthew P. Steinberg.

Districts nationwide have revised their educator evaluation systems, increasing the frequency with which administrators observe and evaluate teacher instruction. Yet, limited insight exists on the role of evaluator feedback for instructional improvement. Relying on unique observation-level data, we examine the alignment between evaluator and teacher assessments of teacher instruction and the potential consequences for teacher productivity and mobility. We show that teachers and evaluators typically rate teacher performance similarly during classroom observations, but with significant variability in teacher-evaluator ratings. While teacher performance improves across multiple classroom observations, evaluator ratings likely overstate productivity improvements among the lowest-performing teachers. Evaluators, but not teachers, systematically rate teacher performance lower in classrooms serving higher concentrations of economically disadvantaged students. And while teacher performance improves when evaluators provide more critical feedback about teacher instruction, teachers receiving critical feedback may seek alternative teaching assignments in schools with less critical evaluation settings. We discuss the implications of these findings for the design, implementation and impact of educator evaluation systems.

More →


Jessalynn James, James H. Wyckoff.

The distribution of teaching effectiveness across schools is fundamental to understanding how schools can address disparities in educational outcomes. Research and policy have recognized the importance of teaching effectiveness for decades. Five stylized facts predict that teachers should be differentially allocated across schools such that poor, Black and Hispanic students are taught by less qualified and less effective teachers. Yet, research is unclear whether these predictions have empirical support. Our purpose is to better understand whether there are meaningful differences in teacher effectiveness among schools. We find that poor, Black and Hispanic students are more likely to be taught by novice teachers when they live in more segregated MSAs. Moreover, the geographic nature of segregation varies across MSAs. Differentiating segregation within urban districts and segregation between urban districts and outlying districts in the same MSAs is essential to understanding poor students’ exposure to novice teachers and policies that address these disparities. We find that poor, Black and Hispanic students are 50 percent more likely to be exposed to at least one novice teacher during elementary school compared to their more affluent white peers. These results raise questions regarding the enforcement of ESSA’s requirements on the distribution of teacher qualifications and quality.

More →


Carly D. Robinson.

Few question the value of teacher-student relationships (TSRs) for educational outcomes. TSRs are positively associated with students’ achievement and engagement, as well as teachers’ well-being. Building and maintaining these crucial classroom relationships, however, is not easy. Drawing on prominent motivation theories in educational psychology, I present the Motivating Teacher-Student Relationships framework for understanding what motivates teachers to build positive TSRs. In particular, I focus on how teachers’ motivational beliefs about TSRs energize, direct, and sustain their efforts to engage in relationship-building behaviors and, thus, lead to positive relationships with their students. To build positive TSRs, teachers must believe it is their role to build TSRs, value TSRs, and believe they can successfully build TSRs (i.e., have relational self-efficacy). These beliefs are shaped by teachers’ sociocultural contexts and can facilitate or undermine the development of these learning relationships. With a greater understanding of how motivational beliefs influence social relationships, the field of education can more effectively develop theoretically grounded interventions to improve TSRs and mitigate inequality.

More →


Seth Gershenson, Stephen B. Holt, Adam Tyner.

Teachers are among the most important inputs in the education production function. One mechanism by which teachers might affect student learning is through the grading standards they set for their classrooms. However, the effects of grading standards on student outcomes are relatively understudied. Using administrative data that links individual students and teachers in 8th and 9th grade Algebra I classrooms from 2006 to 2016, we examine the effects of teachers’ grading standards on student learning and attendance. High teacher grading standards in Algebra I increase student learning both in Algebra I and in subsequent math classes. The effect on student achievement is positive and similar in size across student characteristics and levels of ability, students’ relative rank within the classroom, and school context. High teacher grading standards also lead to a modest reduction in student absences.

More →


Tuan D. Nguyen, Chanh B. Lam, Paul Bruno.

Teachers are critical to student learning, but adequately staffing classrooms has been challenging in many parts of the country. Even though teacher shortages are being reported across the U.S., teacher shortages are poorly understood. Determining and addressing teacher shortages is difficult due to the lack of data. Neither the federal government nor the majority of states have provided sufficient information on teacher shortages. To address this gap, we systematically examine news reports, department of education data, and publicly-available information on teacher shortages for every state in the U.S. We find there are at least 36,000 vacant positions along with at least 163,000 positions being held by underqualified teachers, both of which are conservative estimates of the extent of teacher shortages nationally. We discuss the implications of our findings for a robust data system, including more specific and consistent reporting of shortage, as well as implications for teacher preparation and education in the United States.

More →


Christine Mulhern.

Counselors are a common school resource for students navigating complicated and con- sequential education choices. I estimate counselors’ causal effects using quasi-random assignment policies in Massachusetts. Counselors vary substantially in their effectiveness at increasing high school graduation and college attendance, selectivity, and persistence. Counselor effects on educational attainment are similar in magnitude to teacher effects, but they flow through improved information and assistance more than cognitive or non-cognitive skill development. Counselor effectiveness is most important for low-income and low-achieving students, so improving access to effective counseling may be a promising way to increase educational attainment and close socioeconomic gaps in education.

More →


Heather C. Hill, Virginia S. Lovison.

In recent decades, U.S. education leaders have advocated for more intellectually ambitious mathematics instruction in classrooms. Evidence about whether more ambitious mathematics instruction has filtered into contemporary classrooms, however, is largely anecdotal. To address this issue, we analyzed 93 lessons recorded by a national random sample of middle school mathematics teachers. We find that lesson quality varies, with the typical lesson containing some elements of mathematical reasoning and sense-making, but also teacher-directed instruction with limited student input. Lesson quality correlates with teachers’ use of a textbook and with teachers’ mathematical background. We consider these findings in light of efforts to transform U.S. mathematics instruction.

More →


Stephen B. Holt, Katie Vinopal, Heasun Choi, Lucy C. Sorensen.
While a growing body of literature has documented the negative impacts of exclusionary punishments, such as suspensions, on academic outcomes, less is known about how teachers vary in disciplinary behaviors and the attendant impacts on students. We use administrative data from North Carolina elementary schools to examine the extent to which teachers vary in their use of referrals and investigate the impact of more punitive teachers on student attendance and achievement. We also estimate the effect of teachers' racial bias in the use of referrals on student outcomes. We find more punitive teachers increase student absenteeism and reduce student achievement. Moreover, more punitive teachers negatively affect the achievement of students who do not receive disciplinary sanctions from the teacher. Similarly, while teachers with racial bias in the use of referrals do not negatively affect academic outcomes for White students, they significantly increase absenteeism and reduce achievement for Black students. We find the negative effects of both more punitive and more biased teachers persist into middle school and beyond. The results suggest punitive disciplinary measures do not aid teachers in productively managing classrooms; rather, teachers taking more punitive stances may undermine student engagement and learning in both the short- and long- run. Furthermore, bias in teachers' referral usage contributes to inequities in student outcomes.

More →