Search for EdWorkingPapers here by author, title, or keywords.
Program and policy effects
We replicate and extend prior work on Florida’s Bright Futures merit aid scholarship to consider its effect on college enrollment and degree completion. We estimate causal impacts using a regression discontinuity design to exploit SAT thresholds that strongly determine eligibility. We find no positive impacts on attendance or attainment, and instrumental variable results generally reject estimates as small as 1-2 percentage points. Across subgroups, we do find that eligibility slightly reduces six-year associate degree attainment for lower-SES students and may induce small enrollment shifts among Hispanic and White students. Our findings of these minimal-at-best impacts contrast those of prior works, attributable in part to methodological improvements and more robust data, and further underscore the importance of study replication. (JEL: H75, I21, I22, I23, I28)
Parental text messaging interventions are growing in popularity to encourage at-home reading, school-attendance, and other educational behaviors. These interventions, which often combine multiple components, frequently demonstrate varying amounts of effectiveness, and researchers often cannot determine how individual components work alone or in combination with one another. Using a 2x2x3 factorial experiment, we investigate the effects of individual and interacted components from three behavioral levers to support summer reading: providing updated, personalized information; emphasizing different reading views; and goal setting. We find that the personalized information condition scored 0.03 SD higher on fall reading assessments. Test score effects were enhanced by messages that emphasized reading being useful for both entertainment and building skills compared to skill building alone or entertainment alone.
The COVID-19 pandemic presents a unique opportunity to examine how local governments respond to a public health crisis amid high levels of partisan polarization and an increasing tendency for local issues to become nationalized. As an arena that has, in recent years, been relatively separate from national partisan divides, public schools provide a useful window into these dynamics. Leveraging the fact that all of the nation’s school districts had to adopt a reopening plan for the fall, we test what factors best predict whether a district chose to return students to the classroom or educate them remotely. Contrary to the conventional understanding of school districts as localized and non-partisan actors, we find evidence that politics, far more than science, shaped school district decision-making. Mass partisanship and teacher union strength best explain how school boards approached reopening. Additionally, we find evidence that districts are sensitive to the threat of private school exit. Districts located in counties with a larger number of Catholic schools were less likely to shut down and more likely to return to in-person learning. These findings have important implications for our understanding of education policy and the functioning of American local governments.
Jackson, Wigger, and Xiong (2020a, JWX) provide evidence that education spending reductions following the Great Recession had widespread negative impacts on student achievement and attainment. This paper describes our process of duplicating JWX and highlights a variety of tests we employ to investigate the nature and robustness of the relationship between school spending reductions and student outcomes. Though per-pupil expenditures undoubtedly shifted downward due to the Great Recession, contrary to JWX, our findings indicate there is not a clear and compelling story about the impact of those reductions on student achievement. Moreover, we find that the relationship between K-12 spending and college-going rates is likely confounded with contemporaneous higher education funding trends. While we believe that K-12 spending reductions may have negative impacts on student outcomes, our results suggest that estimating generalizable causal effects remains a significant challenge.
Credit recovery (CR) refers to online courses that high school students take after previously failing the course. Many have suggested that CR courses are helping students to graduate from high school without corresponding increases in academic skills. This study analyzes administrative data from the state of North Carolina to evaluate these claims using full data from public and private CR providers. Findings indicate that students who fail courses and enroll in CR have lower test scores of up to two tenths of a standard deviation and are about seven percent more likely to graduate high school on time than students who repeat courses traditionally. Test score differences are particularly large for Biology compared to Math I and English II. Hispanic and economically disadvantaged CR students are more likely to graduate high school than their peers.
Nationally, 15% of first-time community college students were high school dual enrollment (DE) students, which raises concerns about how high school peers might influence college enrollees. Using administrative data from a large state community college system, we examine whether being exposed to a higher percentage of DE peers in entry-level (gateway) math and English courses influences non-DE enrollees’ performance. Using a two-way fixed effects model, our results indicate that college enrollees exposed to a higher proportion of DE peers had lower pass rates and grades in gateway courses, and higher course repetition rates. Supplemental student-level analysis suggests that greater exposure to DE peers during a student’s initial semester in college reduces next-term college persistence.
This paper reports math and reading academic achievement and growth in grades 2 to 8 for Hispanic participants and nonparticipants of a Spanish-English dual language program. I apply a piecewise multilevel growth model to administrative data from a large school district that enrolls a substantial English Learner student population. Dual language participants started 2nd grade with lower achievement than nonparticipants. In math, dual language participants grew faster than nonparticipants during each school year in grades 2 to 5 but lost more learning during subsequent summers. Thus, despite growing faster in the beginning, dual language students did not learn more than their peers in the long run, and the gap between dual language students and the national average was not closing. In reading, dual language participants grew slightly more slowly during school years but lost less learning during the summers, closing the gap between themselves and the national average. These findings suggest that programs aimed at addressing achievement gaps need to consider summer as well as school-year learning for historically-underserved student populations.
We study the adoption and implementation of a new mobile communication app among a sample of 132 New York City public schools. The app provides a platform for sharing general announcements and news as well as engaging in personalized two-way communication with individual parents. We provide participating schools with free access to the app and randomize schools to receive intensive support (training, guidance, monitoring, and encouragement) for maximizing the efficacy of the app. Although user supports led to higher levels of communication within the app in the treatment year, overall usage remained low and declined in the following year when treatment schools no longer received intensive supports. We find few subsequent effects on perceptions of communication quality or student outcomes. We leverage rich internal user data to explore how take-up and usage patterns varied across staff and school characteristics. These analyses help to identify early adopters and reluctant users, revealing both opportunities and obstacles to engaging parents through new communication technology.
The evidence that student learning declines sharply (or stagnates) during the summer has motivated a substantial interest in programs that provide intensive academic instruction during the summer. However, the existing literature suggests that such programs, which typically focus on just one or two subjects, have modest effects on students’ achievement and no impact on measures of their engagement in school. In this quasi-experimental study, we present evidence on the educational impact of a unique and mature summer learning program that serves low-income middle school students and features unusual academic breadth and a social emotional curriculum with year-to-year scaffolding. Our results indicate that this program led to substantial reductions in unexcused absences, chronic absenteeism and suspensions and a modest gain in ELA test scores. We find evidence that the gains in behavioral engagement grow over time and with additional summers of participation. Our results also suggest that these effects were particularly concentrated among boys and Latinx students.
The Post-9/11 GI Bill allows service members to transfer generous education benefits to a dependent. We run a large scale experiment that encourages service members to consider the transfer option among a population that includes individuals for whom the transfer benefits are clear and individuals for whom the net-benefits are significantly more ambiguous. We find no impact of a one-time email about benefits transfer among service members for whom we predict considerable ambiguity in the action, but sizeable impacts among service members for whom education benefits transfer is far less ambiguous. Our work contributes to the nascent literature investigating conditions when low-touch nudges at scale may be effective. JEL Classification: D15, D91, H52, I24