EdWorkingPapers
The Effects of Race to the Top School Turnaround in North Carolina
Federal education policies gave political and financial support for state education agencies to turnaround low-performing schools on an unprecedented scale. North Carolina’s ambitious program turned around over half of all schools nationwide that underwent turnaround funded by Race to the Top. Exploiting the assignment to turnaround based on schools’ 2009-10 proficiency rates, we implement… more →
Does a successful randomized experiment lead to successful policy? Project Challenge and what happened in Tennessee after Project STAR
Evidence-based policy is the practice of basing policy decisions on rigorous research evidence, such as randomized experiments. But it is unclear how often evidence-based decisions produce more effective policy. We evaluate an evidence-based policy implemented in 1989-93, after the state of Tennessee completed the famous Project STAR randomized experiment, which showed that reducing average… more →
The Remarkable Unresponsiveness of College Students to Nudging And What We Can Learn from It
We present results from a five-year effort to design promising online and text-message interventions to improve college achievement through several distinct channels. From a sample of nearly 25,000 students across three different campuses, we find some improvement from coaching-based interventions on mental health and study time, but none of the interventions we evaluate significantly… more →
The Next Generation of State Reforms to Improve their Lowest Performing Schools: An Evaluation of North Carolina’s School Transformation Initiative
In contrast to prior federally mandated school reforms, the Every Student Succeeds Act (ESSA) allows states more discretion in reforming their lowest performing schools, removes requirements to disrupt the status quo, and does not allocate substantial additional funds. Using a regression discontinuity design, we evaluate a state turnaround initiative aligned with ESSA requirements. We find the… more →
Teachers, Schools, and Pre-K Effect Persistence: An Examination of the Sustaining Environment Hypothesis
The sustaining environments thesis hypothesizes that PreK effects are more likely to persist into later grades if children experience high-quality learning environments in the years subsequent to PreK. This study tests this hypothesis using data from a statewide PreK randomized experiment in Tennessee that found positive effects at the end of PreK that did not persist past kindergarten. These… more →
Does achievement rise fastest with school choice, school resources, or family resources? Chile from 2002 to 2013
Debates in education policy draw on different theories about how to raise children’s achievement. The school competition theory holds that achievement rises when families can choose among competing schools. The school resource theory holds that achievement rises with school spending and resources that spending can buy. The family resources theory holds that children’… more →
Teacher Skill Development: Evidence from Performance Ratings by Principals
We examine the dynamic nature of teacher skill development using panel data on principals’ subjective performance ratings of teachers. Past research on teacher productivity improvement has focused primarily on one important but narrow measure of performance: teachers’ value-added to student achievement on standardized tests. Unlike value-added, subjective performance ratings provide detailed… more →
Effects of the shift to English-only instruction on college outcomes: Evidence from Central Asia
English-only college education in non-English speaking countries is a rapidly growing phenomenon that has been dubbed as the most important trend in higher education internationalization. Despite worldwide popularity, there is little empirical evidence about how the transition to English-only instruction affects students’ academic outcomes. Using a natural experiment at a selective university… more →
The Added Value of Latinx and Black Teachers for Latinx and Black Students: Implications for the Reauthorization of the Higher Education Act
A research synthesis points to the added-value—benefits to social and emotional development, as well as learning outcomes—for students of color taught by teachers of color. Given ongoing education debates, policymakers can use this evidence base to craft legislation aimed at increasing the ethnoracial diversity of the U.S. educator workforce. To begin, historical research shows… more →
English Learner Labeling: How English Learner Status Shapes Teacher Perceptions of Student Skills & the Moderating Role of Bilingual Instructional Settings
Prior research has shown that EL classification is consequential for students, however, less is known about how EL classification impacts students’ outcomes. In this study, we examine one hypothesized mechanism: teacher perceptions. Using nationally-representative data (ECLS-K:2011), we use coarsened exact matching to estimate the effect of EL status on teachers’ perceptions of students’… more →
Turnover at the Top: Estimating the Effects of Principal Turnover on Student, Teacher, and School Outcomes
One in five schools loses its principal each year. Despite the prevalence of principal turnover, little empirical research has examined its effects on school outcomes. Because principal turnover may occur in response to or contemporaneous with a downturn in student achievement, the effect of a turnover is confounded with unobserved school-level factors. We employ a novel identification… more →
Helping Parents Navigate the Early Childhood Enrollment Process: Experimental Evidence from New Orleans
The early childhood enrollment process involves searching for programs, applying, verifying eligibility(for publicly funded seats), and enrolling. Many families do not complete the process. We conducted a randomized controlled trial to assess strategies for communicating with families as they verify eligibility. Working with administrators in New Orleans, we randomly assigned families to… more →
The Effect of Reduced Student Loan Borrowing on Academic Performance and Default: Evidence from a Loan Counseling Experiment
Student loan borrowing for higher education has emerged as a top policy concern. Policy makers at the institutional, state, and federal levels have pursued a variety of strategies to inform students about loan origination processes and how much a student has cumulatively borrowed, and to provide students with greater access to loan counseling. We conducted an experiment to evaluate the impact… more →
The Effects of Special Education on the Academic Performance of Students with Learning Disabilities
In the forty plus years since passage of the Individuals with Disabilities Education Act (IDEA), special education has grown in the number of students and amount spent on services. Despite this growth, the academic performance of students with disabilities (SWDs) remains troubling low compared to general education students (GENs). To some extent, these differences reflect persistent… more →
Community College Pathways for Disadvantaged Students
In this paper we estimate the impacts of the “pathways” chosen by community college students—in terms of desired credentials and fields of study, as well as other choices and outcomes along the paths—on the attainment of credentials with labor market value. We focus on the extent to which there are recorded changes in students’ choices over time, whether students make choices informed by their… more →
Are Schools Deemed Effective Based on Overall Student Growth Also Closing Achievement Gaps? Examining the Black-White Gap in Schools
Research has begun to investigate whether teachers and schools are as effective with certain student subgroups as they are with the overall student population. Most of this research has examined the issue by trying to produce causal estimates of school contributions to short-term student growth (usually using value-added models) and has emphasized rank orderings of schools by subgroup.… more →
When behavioral barriers are too high or low – How timing matters for parenting interventions
The time children spend with their parents affects their development. Parenting programs can help parents use that time more effectively. Text-messaged-based parenting curricula have proven an effective means of supporting positive parenting practices by providing easy and fun activities that reduce informational and behavioral barriers. These programs may be more effective if delivered during… more →
The Effects of Full-day Pre-kindergarten: Experimental Evidence of Impacts on Children’s School Readiness
This study is a randomized control trial of full- versus half-day pre-kindergarten in a school district near Denver, Colorado. Four-year-old children were randomly assigned an offer of half-day (four days/week) or full-day (five days/week) pre-k that increased class time by over 600 hours. The offer of full-day pre-k produced substantial, positive effects on children’s receptive vocabulary… more →
Restorative for All? Racial Disproportionality and School Discipline Under Restorative Justice
The well-documented racial disparities in school discipline have led many school districts in the U.S. to adopt restorative justice practices. The restorative justice philosophy differs from traditional disciplinary action by placing an emphasis on restitution and improving behavior rather than punishment. While models of restorative justice are descriptively and theoretically promising,… more →
Experimentally Estimated Impacts of School Voucher on Educational Attainments of Moderately and Severely Disadvantaged Students
Estimates of school voucher impacts on educational attainment have yet to explore heterogeneities in socioeconomic status among disadvantaged minority students. We theorize reasons for these heterogeneities and then estimate experimentally the differential impacts of voucher offers on college enrollment and graduation rates for minority and non-immigrant students from moderately and severely… more →
Stress in Boom Times: Understanding Teachers’ Economic Anxiety in a High Cost Urban District
Despite growing concern over teachers’ ability to live comfortably where they work, we know little about the systematic impacts of affordability on teachers’ well-being, particularly in high-cost urban areas. We use novel survey data from San Francisco Unified School District to identify the patterns and prevalence of economic anxiety among teachers and assess how this anxiety relates to… more →
Maxed Out? The Effect of Larger Student Loan Limits on Borrowing and Education Outcomes
Despite large and growing student loan balances, there is relatively little evidence on the effects of access to student loans on borrowing and educational outcomes. We examine the effect of access to credit by using policy variation in the maximum federal student loan amounts available to U.S. college students. In particular, first-, second-, and third-year students have access to different… more →
Using a Text-as-Data Approach to Understand Reform Processes: A Deep Exploration of School Improvement Strategies
Although program evaluations using rigorous quasi-experimental or experimental designs can inform decisions about whether to continue or terminate a given program, they often have limited ability to reveal the mechanisms by which complex interventions achieve their effects. To illuminate these mechanisms, this paper analyzes novel text data from thousands of school improvement planning and… more →
Will Mentoring a Student Teacher Harm My Evaluation Scores? Effects of Serving as a Cooperating Teacher on Evaluation Metrics
Growing evidence suggests that preservice candidates receive better coaching and are more instructionally effective when they are mentored by more instructionally effective cooperating teachers (CTs). Yet, teacher education program leaders indicate it can be difficult to recruit instructionally effective teachers to serve as CTs, in part because teachers worry that serving may negatively… more →
General Equilibrium Effects of Recruiting High-Performing Teachers for School Turnaround: Evidence from Tennessee
Many districts and states have begun implementing incentives to attract high-performing teachers to low-performing schools. Previous research has found that these incentives are effective. However, effects on the schools and students these teachers leave behind has not been examined. This study focuses on the general equilibrium effects of recruiting effective teachers to… more →
Beyond tracking and detracking: The dimensions of organizational differentiation in schools
Schools utilize an array of strategies to match curricula and instruction to students’ heterogeneous skills. While generations of scholars have debated “tracking” and its consequences, the literature fails to account for diversity of school-level sorting practices. In this paper we draw upon the work of Sørenson (1970) to articulate and develop empirical measures of five distinct dimensions of… more →
Altered Attitudes and Actions: Social-Emotional Effects of Multiple Arts Field Trips
In recent decades, institutions, teachers, and students report a decline in field trip attendance. The impact of this decline on educational and societal outcomes such as social-emotional skill acquisition is unknown. Social-emotional learning (SEL) are skills thought to be important to life and relationship success and are associated with better long-term student outcomes. This study… more →
The Effect of Increased Funding on Student Achievement: Evidence From Texas's Small District Adjustment
We leverage an obscure set of rules in Texas’s school funding formula granting some districts additional revenue as a function of size and sparsity. We use variation from kinks and discontinuities in this formula to ask how districts spend additional discretionary funds, and whether these improve student outcomes. A $1,000 annual increase in foundation funding, or 10% increase in expenditures… more →
School Principal Race and the Hiring and Retention of Racially Diverse Teachers
Exploiting variation from principal and teacher transitions over long administrative data panels in Missouri and Tennessee, we estimate the effects of principal race on the hiring and turnover of racially diverse teachers. Evidence from the two states is strikingly similar. Black principals increase the probability that a newly hired teacher is Black by 5–7 percentage points. This result… more →
Effect Sizes for Measuring Student and School Growth in Achievement: In Search of Practical Significance
Effect sizes in the Cohen’s d family are often used in education to compare estimates across studies, measures, and sample sizes. For example, effect sizes are used to compare gains in achievement students make over time, either in pre- and post-treatment studies or in the absence of intervention, such as when estimating achievement gaps. However, despite extensive… more →
A comparison of postsecondary outcomes for Army service members, Veterans, and civilians
Despite broad public interest in Veterans' education, there is relatively little evidence documenting the postsecondary trajectories of military service members after they return to civilian life. In the current report we investigate how U.S. Army service member college enrollment and progression trends compare to a similar population of civilians, using Army administrative… more →
The Play’s the Thing: Experimentally Examining the Social and Cognitive Effects of School Field Trips to Live Theater Performances
Field trips to see theater performances are a long-standing educational practice, however, there is little systematic evidence demonstrating educational benefits. This article describes the results of five random assignment experiments spanning two years where school groups were assigned by lottery to attend a live theater performance, or for some groups, watch a movie-version of the same… more →
Making a Match: How Successful High-Poverty Schools Hire Teachers
Effective teacher hiring is fundamental to improving schools and yet few studies investigate this process. In this exploratory study of six successful, high-poverty schools (three charter, three district) in one Massachusetts city, we analyze the policy contexts that influenced hiring and examine the schools’ hiring practices. Through interviews with 142 teachers and administrators, we learned… more →
Push or Pull: School-Level Factors That Influence Teacher Mobility in Turnaround Schools
Recruiting and retaining teachers can be challenging for many schools, especially in low-performing urban schools in which teachers turn over at higher rates. In this study, we examine three types of school-level attributes that may influence teachers’ decisions to enter or transfer schools: malleable school processes, structural features of employment, and school characteristics. Using… more →
A Tale of Two Types of Schools: An Exploration of How School Working Conditions Influence Black Male Teacher Turnover
This phenomenological study draws on semi-structured interviews with 27 Black male teachers across 14 schools in an urban school district—seven schools with three or more Black male teachers and seven schools with one Black male teacher. Consistent with theories about teacher turnover, findings indicate a relationship between organizational characteristics, reasons participants cited for… more →
Do Health Insurance Mandates Spillover to Education? Evidence from Michigan’s Autism Insurance Mandate
Social programs and mandates are usually studied in isolation even though they often interact closely with each other. Given the immense recent changes to health insurance systems, there is much potential for spillover effects to other systems in which health plays a large role. In this study, we examine how health insurance interacts with education, specifically the education of students with… more →
Realizing Your College Potential? Impacts of College Board’s RYCP Campaign on Postsecondary Enrollment
The College Board sought to reduce barriers in the college application process by minimizing information aggregation costs, encouraging a broad application portfolio, and providing an impetus to start the search process. Some students were offered additional encouragements, such as text message reminders or college application fee waivers. In a randomized control trial with 785,000 low- and… more →
The Formalized Processes Districts Use to Evaluate Mathematics Textbooks
Textbooks are a widely used educational intervention that can affect student achievement, and the marginal cost of choosing a more effective textbook is typically small. However, we know little about how textbooks get from the publisher to the classroom. We use a lens of institutional theory and interviews with district leaders in a stratified random sample of 34 California school districts to… more →
Peeking into the Black Box of School Turnaround: A Formal Test of Mediators and Suppressors
A growing body of research evaluates the effects of turnaround on chronically low-performing schools. We extend this research to formally test factors that either mediate or suppress the effects of two turnaround initiatives in Tennessee: the Achievement School District (ASD) and local Innovation Zones (iZones). Using difference-in-differences models within a mediational framework, we… more →
The Unwavering SES Achievement Gap: Trends in U.S. Student Performance
Concerns about the breadth of the U.S. income distribution and limited intergenerational mobility have led to a focus on educational achievement gaps by socio-economic status (SES). Uintertemporally linked assessments from NAEP, TIMSS, and PISA, we trace the achievement of U.S. student cohorts born between 1954 and 2001. Achievement gaps between the top and bottom deciles and the top… more →
Is Education Consumption or Investment? Implications for School Competition
Friedman (1955) argued that giving parents freedom to choose schools would improve education. His argument was simple and compelling because it extended results from markets for consumer goods to education. We review the evidence, which yields surprisingly mixed results on Friedman's prediction. A key reason is that households often seem to choose schools based on their absolute achievement… more →
Government Privatization and Political Participation: The Case of Charter Schools
Governments around the world have privatized public services in the name of efficiency and citizen empowerment, but some argue that privatization could also affect citizen participation in democratic governance. We explore this possibility by estimating the impact of charter schools (which are publicly funded but privately operated) on school district elections. The analysis indicates that the… more →
Elusive Longer-Run Impacts of Head Start: Replications Within and Across Cohorts
Using an additional decade of CNLSY data, this study replicated and extended Deming’s (2009) evaluation of Head Start’s life-cycle skill formation impacts in three ways. Extending the measurement interval for Deming’s adulthood outcomes, we found no statistically significant impacts on earnings and mixed evidence of impacts on other adult outcomes. Applying Deming’s sibling… more →
A Reanalysis of Impacts of the Tennessee Voluntary Prekindergarten Program
We present a reanalysis of the Tennessee Voluntary Prekindergarten Program (TNVPK), a state-funded program designed to promote the school readiness of 4-year-olds from low-income families. Oversubscribed programs used a lottery to randomly assign prospective enrollees a chance to attend TNVPK. We found that assignment to the program had largely null effects on measures of… more →
Superficially Coupled Systems: The Organizational Production of Inequality in Higher Education
The rise of accountability standards has pressed higher education organizations to oversee the production and publication of data on student outcomes more closely than in the past. However, the most common measure of student outcomes, average bachelor's degree completion rates, potentially provides little information about the direct impacts of colleges and universities on student success.… more →
Policy Implementation, Principal Agency, and Strategic Action: Improving Teaching Effectiveness in New York City Middle Schools
Ten years ago, the reform of teacher evaluation was touted as a mechanism to improve teacher effectiveness. In response, virtually every state redesigned its teacher evaluation system. Recently, a growing narrative suggests these reforms failed and should be abandoned. This response may be overly simplistic. We explore the variability of New York City principals’ implementation of policies… more →
The Educational Gradient in Health among Children in Immigrant Families
Educational inequality in the health of U.S. children—what social scientists refer to as the “educational gradient” in health—is present at birth for virtually every marker of health, and increases throughout childhood. However, a puzzling contradiction to this pattern has been observed among the growing population of youth in immigrant families. Some evidence suggests an… more →
Why Who Marries Whom Matters: Effects of Educational Assortative Mating on Infant Health in the U.S. 1969-1994
Educational assortative mating patterns in the U.S. have changed since the 1960s, but we know little about the effects of these patterns on children, particularly on infant health. Rising educational homogamy may alter prenatal contexts through parental stress and resources, with implications for inequality. Using 1969-1994 NVSS birth data and aggregate cohort-state census measures of… more →
Delayed Benefits: Effects of California School District Bond Elections on Achievement by Socioeconomic Status
Contradictory evidence of the relationship between education funding and student achievement could reflect heterogeneous effects by revenue source or student characteristics. This study examines potential heterogeneous effects of a particular type of local revenue – bond funds for capital investments – on achievement by socioeconomic status. Comparing California school districts within a… more →
The Long-Run Impacts of Same-Race Teachers
We examine the long-run impacts of having a same-race teacher. First, we leverage data from the Tennessee STAR class-size experiment to show that black students randomly assigned to a black teacher in grades K-3 are 5 percentage points (7%) more likely to graduate from high school and 4 percentage points (13%) more likely to enroll in college than their same-school, same-race peers not… more →