EdWorkingPapers
Using a Text-as-Data Approach to Understand Reform Processes: A Deep Exploration of School Improvement Strategies
Although program evaluations using rigorous quasi-experimental or experimental designs can inform decisions about whether to continue or terminate a given program, they often have limited ability to reveal the mechanisms by which complex interventions achieve their effects. To illuminate these mechanisms, this paper analyzes novel text data from thousands of school improvement planning and… more →
Will Mentoring a Student Teacher Harm My Evaluation Scores? Effects of Serving as a Cooperating Teacher on Evaluation Metrics
Growing evidence suggests that preservice candidates receive better coaching and are more instructionally effective when they are mentored by more instructionally effective cooperating teachers (CTs). Yet, teacher education program leaders indicate it can be difficult to recruit instructionally effective teachers to serve as CTs, in part because teachers worry that serving may negatively… more →
General Equilibrium Effects of Recruiting High-Performing Teachers for School Turnaround: Evidence from Tennessee
Many districts and states have begun implementing incentives to attract high-performing teachers to low-performing schools. Previous research has found that these incentives are effective. However, effects on the schools and students these teachers leave behind has not been examined. This study focuses on the general equilibrium effects of recruiting effective teachers to… more →
Beyond tracking and detracking: The dimensions of organizational differentiation in schools
Schools utilize an array of strategies to match curricula and instruction to students’ heterogeneous skills. While generations of scholars have debated “tracking” and its consequences, the literature fails to account for diversity of school-level sorting practices. In this paper we draw upon the work of Sørenson (1970) to articulate and develop empirical measures of five distinct dimensions of… more →
Altered Attitudes and Actions: Social-Emotional Effects of Multiple Arts Field Trips
In recent decades, institutions, teachers, and students report a decline in field trip attendance. The impact of this decline on educational and societal outcomes such as social-emotional skill acquisition is unknown. Social-emotional learning (SEL) are skills thought to be important to life and relationship success and are associated with better long-term student outcomes. This study… more →
The Effect of Increased Funding on Student Achievement: Evidence From Texas's Small District Adjustment
We leverage an obscure set of rules in Texas’s school funding formula granting some districts additional revenue as a function of size and sparsity. We use variation from kinks and discontinuities in this formula to ask how districts spend additional discretionary funds, and whether these improve student outcomes. A $1,000 annual increase in foundation funding, or 10% increase in expenditures… more →
School Principal Race and the Hiring and Retention of Racially Diverse Teachers
Exploiting variation from principal and teacher transitions over long administrative data panels in Missouri and Tennessee, we estimate the effects of principal race on the hiring and turnover of racially diverse teachers. Evidence from the two states is strikingly similar. Black principals increase the probability that a newly hired teacher is Black by 5–7 percentage points. This result… more →
Effect Sizes for Measuring Student and School Growth in Achievement: In Search of Practical Significance
Effect sizes in the Cohen’s d family are often used in education to compare estimates across studies, measures, and sample sizes. For example, effect sizes are used to compare gains in achievement students make over time, either in pre- and post-treatment studies or in the absence of intervention, such as when estimating achievement gaps. However, despite extensive… more →
A comparison of postsecondary outcomes for Army service members, Veterans, and civilians
Despite broad public interest in Veterans' education, there is relatively little evidence documenting the postsecondary trajectories of military service members after they return to civilian life. In the current report we investigate how U.S. Army service member college enrollment and progression trends compare to a similar population of civilians, using Army administrative… more →
The Play’s the Thing: Experimentally Examining the Social and Cognitive Effects of School Field Trips to Live Theater Performances
Field trips to see theater performances are a long-standing educational practice, however, there is little systematic evidence demonstrating educational benefits. This article describes the results of five random assignment experiments spanning two years where school groups were assigned by lottery to attend a live theater performance, or for some groups, watch a movie-version of the same… more →
Making a Match: How Successful High-Poverty Schools Hire Teachers
Effective teacher hiring is fundamental to improving schools and yet few studies investigate this process. In this exploratory study of six successful, high-poverty schools (three charter, three district) in one Massachusetts city, we analyze the policy contexts that influenced hiring and examine the schools’ hiring practices. Through interviews with 142 teachers and administrators, we learned… more →
Push or Pull: School-Level Factors That Influence Teacher Mobility in Turnaround Schools
Recruiting and retaining teachers can be challenging for many schools, especially in low-performing urban schools in which teachers turn over at higher rates. In this study, we examine three types of school-level attributes that may influence teachers’ decisions to enter or transfer schools: malleable school processes, structural features of employment, and school characteristics. Using… more →
A Tale of Two Types of Schools: An Exploration of How School Working Conditions Influence Black Male Teacher Turnover
This phenomenological study draws on semi-structured interviews with 27 Black male teachers across 14 schools in an urban school district—seven schools with three or more Black male teachers and seven schools with one Black male teacher. Consistent with theories about teacher turnover, findings indicate a relationship between organizational characteristics, reasons participants cited for… more →
Do Health Insurance Mandates Spillover to Education? Evidence from Michigan’s Autism Insurance Mandate
Social programs and mandates are usually studied in isolation even though they often interact closely with each other. Given the immense recent changes to health insurance systems, there is much potential for spillover effects to other systems in which health plays a large role. In this study, we examine how health insurance interacts with education, specifically the education of students with… more →
Realizing Your College Potential? Impacts of College Board’s RYCP Campaign on Postsecondary Enrollment
The College Board sought to reduce barriers in the college application process by minimizing information aggregation costs, encouraging a broad application portfolio, and providing an impetus to start the search process. Some students were offered additional encouragements, such as text message reminders or college application fee waivers. In a randomized control trial with 785,000 low- and… more →
The Formalized Processes Districts Use to Evaluate Mathematics Textbooks
Textbooks are a widely used educational intervention that can affect student achievement, and the marginal cost of choosing a more effective textbook is typically small. However, we know little about how textbooks get from the publisher to the classroom. We use a lens of institutional theory and interviews with district leaders in a stratified random sample of 34 California school districts to… more →
Peeking into the Black Box of School Turnaround: A Formal Test of Mediators and Suppressors
A growing body of research evaluates the effects of turnaround on chronically low-performing schools. We extend this research to formally test factors that either mediate or suppress the effects of two turnaround initiatives in Tennessee: the Achievement School District (ASD) and local Innovation Zones (iZones). Using difference-in-differences models within a mediational framework, we… more →
The Unwavering SES Achievement Gap: Trends in U.S. Student Performance
Concerns about the breadth of the U.S. income distribution and limited intergenerational mobility have led to a focus on educational achievement gaps by socio-economic status (SES). Uintertemporally linked assessments from NAEP, TIMSS, and PISA, we trace the achievement of U.S. student cohorts born between 1954 and 2001. Achievement gaps between the top and bottom deciles and the top… more →
Is Education Consumption or Investment? Implications for School Competition
Friedman (1955) argued that giving parents freedom to choose schools would improve education. His argument was simple and compelling because it extended results from markets for consumer goods to education. We review the evidence, which yields surprisingly mixed results on Friedman's prediction. A key reason is that households often seem to choose schools based on their absolute achievement… more →
Government Privatization and Political Participation: The Case of Charter Schools
Governments around the world have privatized public services in the name of efficiency and citizen empowerment, but some argue that privatization could also affect citizen participation in democratic governance. We explore this possibility by estimating the impact of charter schools (which are publicly funded but privately operated) on school district elections. The analysis indicates that the… more →
Elusive Longer-Run Impacts of Head Start: Replications Within and Across Cohorts
Using an additional decade of CNLSY data, this study replicated and extended Deming’s (2009) evaluation of Head Start’s life-cycle skill formation impacts in three ways. Extending the measurement interval for Deming’s adulthood outcomes, we found no statistically significant impacts on earnings and mixed evidence of impacts on other adult outcomes. Applying Deming’s sibling… more →
A Reanalysis of Impacts of the Tennessee Voluntary Prekindergarten Program
We present a reanalysis of the Tennessee Voluntary Prekindergarten Program (TNVPK), a state-funded program designed to promote the school readiness of 4-year-olds from low-income families. Oversubscribed programs used a lottery to randomly assign prospective enrollees a chance to attend TNVPK. We found that assignment to the program had largely null effects on measures of… more →
Superficially Coupled Systems: The Organizational Production of Inequality in Higher Education
The rise of accountability standards has pressed higher education organizations to oversee the production and publication of data on student outcomes more closely than in the past. However, the most common measure of student outcomes, average bachelor's degree completion rates, potentially provides little information about the direct impacts of colleges and universities on student success.… more →
Policy Implementation, Principal Agency, and Strategic Action: Improving Teaching Effectiveness in New York City Middle Schools
Ten years ago, the reform of teacher evaluation was touted as a mechanism to improve teacher effectiveness. In response, virtually every state redesigned its teacher evaluation system. Recently, a growing narrative suggests these reforms failed and should be abandoned. This response may be overly simplistic. We explore the variability of New York City principals’ implementation of policies… more →
The Educational Gradient in Health among Children in Immigrant Families
Educational inequality in the health of U.S. children—what social scientists refer to as the “educational gradient” in health—is present at birth for virtually every marker of health, and increases throughout childhood. However, a puzzling contradiction to this pattern has been observed among the growing population of youth in immigrant families. Some evidence suggests an… more →
Why Who Marries Whom Matters: Effects of Educational Assortative Mating on Infant Health in the U.S. 1969-1994
Educational assortative mating patterns in the U.S. have changed since the 1960s, but we know little about the effects of these patterns on children, particularly on infant health. Rising educational homogamy may alter prenatal contexts through parental stress and resources, with implications for inequality. Using 1969-1994 NVSS birth data and aggregate cohort-state census measures of… more →
Delayed Benefits: Effects of California School District Bond Elections on Achievement by Socioeconomic Status
Contradictory evidence of the relationship between education funding and student achievement could reflect heterogeneous effects by revenue source or student characteristics. This study examines potential heterogeneous effects of a particular type of local revenue – bond funds for capital investments – on achievement by socioeconomic status. Comparing California school districts within a… more →
The Long-Run Impacts of Same-Race Teachers
We examine the long-run impacts of having a same-race teacher. First, we leverage data from the Tennessee STAR class-size experiment to show that black students randomly assigned to a black teacher in grades K-3 are 5 percentage points (7%) more likely to graduate from high school and 4 percentage points (13%) more likely to enroll in college than their same-school, same-race peers not… more →
Can Light-Touch College-Going Interventions Make a Difference? Evidence From a Statewide Experiment in Michigan
I conduct a statewide experiment in Michigan with nearly 50,000 high-achieving high school seniors. Treated students are mailed a letter encouraging them to consider college and providing them with the web address of a college information website. I find that very high-achieving, low-income students, and very high-achieving, minority students are the most likely to navigate to the website.… more →
Take Two! SAT Retaking and College Enrollment Gaps
Only half of SAT-takers retake the exam, with even lower retake rates among low income and underrepresented minority (URM) students. We exploit discontinuous jumps in retake probabilities at multiples of 100, driven by left-digit bias, to estimate retaking’s causal effects. Retaking substantially improves SAT scores and increases four-year college enrollment rates, particularly for low income… more →
Can Successful Schools Replicate? Scaling Up Boston’s Charter School Sector
Can schools that boost student outcomes reproduce their success at new campuses? We study a policy reform that allowed effective charter schools in Boston, Massachusetts to replicate their school models at new locations. Estimates based on randomized admission lotteries show that replication charter schools generate large achievement gains on par with those produced by their parent campuses.… more →
Explaining the Gender Gap in STEM Attainment: Factors from Primary School to STEM Degree Completion
We investigate the determinants of high school completion and college attendance, the likelihood of taking science, technology, engineering or math (STEM) courses in the first year of college and the probability of earning a degree in a STEM field. The focus is on women, who tend to be under-represented in STEM fields. Tracking four cohorts of students throughout Florida, women… more →
Heat and Learning
We demonstrate that heat inhibits learning and that school air-conditioning may mitigate this effect. Student fixed effects models using 10 million PSAT-retakers show hotter school days in years before the test reduce scores, with extreme heat being particularly damaging. Weekend and summer temperature has little impact, suggesting heat directly disrupts learning time. New nationwide, school-… more →
Engaging Teachers: Measuring the Impact of Teachers on Student Attendance in Secondary School
Teachers’ impact on student long-run success is only partially explained by their contributions to students’ short-run academic performance. For this study, we explore a second dimension of teacher effectiveness by creating measures of teachers’ contributions to student class-attendance. We find systematic variation in teacher effectiveness at reducing unexcused class absences at the middle… more →
Strengthening the Research Base that Informs STEM Instructional Improvement Efforts: A Meta-Analysis
We present results from a meta-analysis of 95 experimental and quasi-experimental preK-12 science, technology, engineering, and mathematics (STEM) professional development and curriculum programs, seeking to understand what content, activities and formats relate to stronger student outcomes. Across rigorously conducted studies, we found an average weighted impact estimate of +0.21 standard… more →
Too little or too much? Actionable Advice in an Early-Childhood Text Messaging Experiment
Text-message based parenting programs have proven successful in improving parental engagement and preschoolers’ literacy development. The tested programs have provided a combination of (a) general information about important literacy skills, (b) actionable advice (i.e., specific examples of such activities), and (c) encouragement. The regularity of the texts – each week throughout the school… more →
Quasi-Experimental Evaluation of Alternative Sample Selection Corrections
We use a natural experiment to evaluate sample selection correction methods' performance. In 2007, Michigan began requiring that all students take a college entrance exam, increasing the exam-taking rate from 64 to 99%. We apply different selection correction methods, using different sets of predictors, to the pre-policy exam score data. We then compare the corrected data to the complete post-… more →
School Finance Reforms, Teachers’ Unions, and the Allocation of School Resources
School finance reforms caused some of the most dramatic increases in intergovernmental aid from states to local governments in U.S. history. We examine whether teachers’ unions affected the fraction of reform-induced state aid that passed through to local spending and the allocation of these funds. Districts with strong teachers’ unions increased spending nearly dollar-for-dollar with state… more →