Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Kylie L. Anglin.

Traditional public schools in the United States must comply with a variety of regulations on educational inputs like teacher certification, maximum class sizes, and restrictions on staff contracts. Absent regulations, policymakers fear that troubled districts would make inappropriate decisions that would harm students. However, it is also possible that strict regulations hinder schools from optimizing student learning. This paper tests the salience of these two hypotheses within the context of a widespread deregulation effort in Texas which allows traditional public school districts to claim District of Innovation status and opt out of regulations not related to health, safety, and civil rights. Using a novel dataset of administration data merged with implementation information scraped from district websites, I estimate the impact of District of Innovation status with a difference-in-differences strategy where later implementers act as the comparison group for early implementers. I find that, despite the breadth of regulations exempted, regulatory autonomy does not significantly impact either math or reading achievement nor does it impact hiring or class sizes. Together, the results offer strong evidence against the hypothesis that regulation hinders school improvement and suggests that state input regulations play only a limited role in determining school decision-making or student achievement.

More →


Katharina Werner, Ludger Woessmann.

If school closures and social-distancing experiences during the Covid-19 pandemic impeded children’s skill development, they may leave a lasting legacy in human capital. To understand the pandemic’s effects on school children, this paper combines a review of the emerging international literature with new evidence from German longitudinal time-use surveys. Based on the conceptual framework of an education production function, we cover evidence on child, parent, and school inputs and students’ cognitive and socio-emotional development. The German panel evidence shows that children’s learning time decreased severely during the first school closures, particularly for low-achieving students, and increased only slightly one year later. In a value-added model, learning time increases with daily online class instruction, but not with other school activities. The review shows substantial losses in cognitive skills on achievement tests, particularly for students from disadvantaged backgrounds. Socio-emotional wellbeing also declined in the short run. Structural models and reduced-form projections suggest that unless remediated, the school closures will persistently reduce skill development, lifetime income, and economic growth and increase inequality.

More →


Matthew A. Kraft, Manuel Monti-Nussbaum.

Narrative accounts of classroom instruction suggest that external interruptions, such as intercom announcements and visits from staff, are a regular occurrence in U.S. public schools. We study the frequency, nature, and duration of external interruptions in the Providence Public School District (PPSD) using original data from a district-wide survey and classroom observations. We estimate that a typical classroom in PPSD is interrupted over 2,000 times per year, and that these interruptions and the disruptions they cause result in the loss of between 10 to 20 days of instructional time. Administrators appear to systematically underestimate the frequency and negative consequences of these interruptions. We propose several organizational approaches schools might adopt to reduce external interruptions to classroom instruction.

More →


Catherine Armstrong Asher, Ethan Scherer, James S. Kim.

Parental text messaging interventions are growing in popularity to encourage at-home reading, school-attendance, and other educational behaviors. These interventions, which often combine multiple components, frequently demonstrate varying amounts of effectiveness, and researchers often cannot determine how individual components work alone or in combination with one another. Using a 2x2x3 factorial experiment, we investigate the effects of individual and interacted components from three behavioral levers to support summer reading: providing updated, personalized information; emphasizing different reading views; and goal setting. We find that the personalized information condition scored on average 0.03 SD higher on fall reading assessments. Texting effects on test scores were enhanced by messages that emphasized reading being useful for both entertainment and building skills compared to skill building alone or entertainment alone. These results continue to build our understanding that while text message can be an effective tool for parent engagement, the specific content of the message can lead to meaningful differences in the magnitude of the effects.

More →


NaYoung Hwang, Brian Kisida.

Although the majority of elementary school teachers are in self-contained classrooms and teach all major subjects, a growing number of teachers specialize in teaching fewer subjects to higher numbers of students. We use administrative data from Indiana to estimate the effect of teacher specialization on teacher and school effectiveness in elementary schools. We find that teacher specialization leads to lower teaching effectiveness in math and reading, and the negative effects are larger when teaching students who are more likely to experience difficulties in school. Moreover, we find no evidence that increasing the proportion of teacher specialists at the school level generates improvements in indicators of school quality.

More →


Zach Sullivan, Benjamin L. Castleman, Gabrielle Lohner, Eric Bettinger.

In-person college advising programs generate large improvements in college persistence and success for low-income students but face numerous barriers to scale. Remote advising models offer a promising strategy to address informational and assistance barriers facing the substantial majority of low-income students who do not have access to community-based advising, yet the existing evidence base on the efficacy of remote advising is limited. We present a comprehensive, multi-cohort experimental evaluation of CollegePoint, a national remote college advising program for high-achieving low- and moderate-income students. Students assigned to CollegePoint are modestly more likely (1.3 percentage points) to attend higher-quality institutions. Results from mechanism experiments we conducted within CollegePoint indicate that moderate changes to the program model, such as a longer duration of advising and modest expansions of the pool of students academically eligible to participate, do not lead to larger program effects. We also capitalize on across-cohort variation in whether students were affected by COVID-19 to investigate whether social distancing required by the pandemic increased the value of remote advising. CollegePoint increased attendance at higher-quality institutions by 3.2 percentage points for the COVID-19-affected cohort. Acknowledgements.

More →


Umut Özek.

High school graduation rates in the United States are at an all-time high, yet many of these graduates are deemed not ready for postsecondary coursework when they enter college. This study examines the short-, medium-, and long-term effects of remedial courses in middle school using a regression discontinuity design. While the short-term test score benefits of taking a remedial course in English language arts in middle school fade quickly, I find significant positive effects on the likelihood of taking college credit-bearing courses in high school, college enrollment, enrolling in more selective colleges, persistence in college, and degree attainment.

More →


Sarah R. Cohodes, James J. Feigenbaum.

In the United States, people with more education vote more. But, we know little about why education increases political participation or whether higher-quality education increases civic participation. We study applicants to Boston charter schools, using school lotteries to estimate charter attendance impacts for academic and voting outcomes. First, we confirm large academic gains for students in the sample of charter schools and cohorts investigated here. Second, we find that charter attendance boosts voter participation. Voting in the first presidential election after a student turns 18 increased substantially, by six percentage points from a base of 35 percent. The voting effect is driven entirely by girls and there is no increase in voter registration. Rich data and the differential effects by gender enable exploration of multiple potential channels for the voting impact. We find evidence consistent with two mechanisms: charter schools increase voting by increasing students’ noncognitive skills and by politicizing families who participate in charter school education.

More →


Stacey L. Brockman.

This paper presents results from a randomized trial of a nudge intervention designed to encourage and enhance virtual student support. During the 2019-20 school year, randomly selected mentors in a school-based mentoring program received monthly reminders with tips for communicating with youth via text, email, and phone. Unexpectedly, the results showed that although the informational reminders did not impact the frequency of mentors’ outreach, they reduced the rate at which students reached out and responded to their mentors. Moreover, and possibly as a consequence, mentors who received the intervention felt less connected to students and less satisfied with their mentoring relationships, and treated students gained less from the mentoring program as a whole in terms of their personal and attitudinal growth. This study’s findings add an important nuance to the evidence on how behavioral interventions in educational contexts operate. Although past studies find that reminder nudges can support individuals’ engagement in discrete tasks, this evidence suggests that prescribing relational practices may be less effective. Thus, mentor supports must be carefully designed in order to yield the intended benefits for students.

More →


Tareena Musaddiq, Kevin Stange, Andrew Bacher-Hicks, Joshua Goodman.

The Covid-19 pandemic drastically disrupted the functioning of U.S. public schools, potentially changing the relative appeal of alternatives such as homeschooling and private schools. Using longitudinal student-level administrative data from Michigan and nationally representative data from the Census Household Pulse Survey, we show how the pandemic affected families’ choices of school sector. We document four central facts. First, public school enrollment declined noticeably in fall 2020, with about 3 percent of Michigan students and 10 percent of kindergartners using other options. Second, most of this was driven by homeschooling rates jumping substantially, driven largely by families with children in elementary school. Third, homeschooling increased more where schools provided in-person instruction while private schooling increased more where instruction was remote, suggesting heterogeneity in parental concerns about children’s physical health and instructional quality. Fourth, kindergarten declines were highest among low income and Black families while declines in other grades were highest among higher income and White families, highlighting important heterogeneity by students’ existing attachment to public schools. Our results shed light on how families make schooling decisions and imply potential longer-run disruptions to public schools in the form of decreased enrollment and funding, changed composition of the student body, and increased size of the next kindergarten cohort.

More →