Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

Program and policy effects

Michela Carlana, Eliana La Ferrara.

In response to the COVID-19 outbreak, the governments of most countries ordered the closure of schools, potentially exacerbating existing learning gaps. This paper evaluates the effectiveness of an intervention implemented in Italian middle schools that provides free individual tutoring online to disadvantaged students during lock-down. Tutors are university students who volunteer for 3 to 6 hours per week. They were randomly assigned to middle school students, from a list of potential beneficiaries compiled by school principals. Using original survey data collected from students, parents, teachers and tutors, we find that the program substantially increased students’ academic performance (by 0.26 SD on average) and that it significantly improved their socio-emotional skills, aspirations, and psychological well-being. Effects are stronger for children from lower socioeconomic status and, in the case of psychological well-being, for immigrant children.

More →

Diana Leyva, Christina Weiland, Anna Shapiro, Gloria Yeomans-Maldonado, Angela Febles.

Food routines play a special role in Latino families. Using a cluster randomized trial with 248 children (M age = 67 months) from 13 schools, this study investigated the impact of a four-week family program designed to capitalize on food routines in improving Latino kindergarteners’ outcomes in the U.S. There were moderate-to-large impacts on child vocabulary (especially food-related) at end-of-treatment and the five-month follow-up, and suggestive evidence of moderate impacts on approaches to learning (including approaches to learning math) and executive function at the five-month follow-up. There were no statistically significant impacts on children’s math or literacy skills. A strengths-based, culturally responsive family intervention that is integrated into Latino family life can improve critical skills needed to succeed in school.

More →

Appendix298.65 KB

Sarah Guthery, Lauren P. Bailes.

This study investigates the influence of principal tenure on the retention rates of the teachers they hire over time. We analyzed the hiring practices and teacher retention rates of 11,717 Texas principals from 1999 to 2017 employing both individual and year fixed effects. Main findings indicate that a principal who stays in the same school for at least three years begins to hire teachers who stay to both three- and five-year benchmarks at increasingly higher rates. However, the average Texas principal leaves a school after four years and while we do find small positive gains in the initial retention rates of teachers at the next school, the majority of principal improvement in teacher retention does not appear to be portable.

More →

Josh B. McGee, Jonathan Mills, Jessica Goldstein.

School district consolidation is one of the most widespread education reforms of the last century, but surprisingly little research has directly investigated its effectiveness. To examine the impact of consolidation on student achievement, this study takes advantage of a policy that requires the consolidation of all Arkansas school districts with enrollment of fewer than 350 students for two consecutive school years. Using a regression discontinuity model, we find that consolidation has either null or small positive impacts on student achievement in math and English Language Arts (ELA). We do not find evidence that consolidation in Arkansas results in positive economies of scale, either by reducing overall cost or allowing for a greater share of resources to be spent in the classroom.

More →

Matthew A. Kraft, Grace Falken.

In this thought experiment, we explore how tutoring could be scaled nationally to address COVID-19 learning loss and become a permanent feature of the U.S. public education system. We outline a blueprint centered on ten core principles and a federal architecture to support adoption, while providing for local ownership over key implementation features. High school students would tutor in elementary schools via an elective class, college students in middle schools via federal work-study, and full time 2- and 4-year college graduates in high schools via AmeriCorps. We envision an incremental, demand-driven expansion process with priority given to high-needs schools. Our blueprint highlights a range of design tradeoffs and implementation challenges as well as estimates of program costs. Our estimates suggest that targeted approaches to scaling school-wide tutoring nationally, such as focusing on K-8 Title I schools, would cost between $5 and $15 billion annually.

More →

Kalena E. Cortes, Daniel Klasik.

The Top 10% Plan admissions policy has now been in place in Texas for over two decades. We analyze 18 years of post-Top 10% Plan data to look for evidence of increased access to the selective Texas flagship campuses among all Texas high schools. We provide a detailed description of changes in enrollment patterns at the flagship campuses from Texas high schools after the implementation of the Top 10% Plan, focusing on whether the policy resulted in new sending patterns from high schools that did not have a history of sending students to the flagship campuses. Our analysis reveals an increase in the likelihood that high schools in non-suburban areas sent students to the flagship campuses, but ultimately little to no equity-producing effects of the Top 10% Plan over this 18-year period. In fact, the representation of traditional, always-sending, feeder high schools on the flagship campuses continued to dwarf the population of students from other high schools. Thus, the purported high school representation benefits of the policy appear to be overstated and may not go as far as advocates might have hoped in terms of generating equity of access to the flagship campuses in the state.

More →

James D. Paul, Patrick J. Wolf.

Virtual charter schools provide full-time, tuition-free K-12 education through internet-based instruction. Although virtual schools offer a personalized learning experience, most research suggests these schools are negatively associated with achievement. Few studies account for differential rates of student mobility, which may produce biased estimates if mobility is jointly associated with virtual school enrollment and subsequent test scores. We evaluate the effects of a single, large, anonymous virtual charter school on student achievement using a hybrid of exact and nearest-neighbor propensity score matching. Relative to their matched peers, we estimate that virtual students produce marginally worse ELA scores and significantly worse math scores after one year. When controlling for student mobility during the outcome year, estimates of virtual schooling are slightly less negative. These findings may be more reliable indicators of the independent effect of virtual schooling if matching on mobility proxies for otherwise unobservable negative selection factors.

More →

Dylan Conger, Mark C. Long, Raymond McGhee Jr..

To evaluate how Advanced Placement courses affect college-going, we randomly assigned the offer of enrollment into an AP science course to over 1,800 students in 23 schools that had not previously offered the course. We find no substantial AP course effects on students’ plans to enroll in college or on their college entrance exam scores. Yet AP course-takers enroll in less selective colleges than their control group counterparts. Negative treatment effects on college selectivity appear to be driven more by low student preparation than teacher inexperience and by students’ matriculation decisions rather than institutional admissions decisions. 

More →

Beth Glenn, Douglas N. Harris.

Multiple studies have documented the positive effect of school choice on college attendance. We focus instead on the quality of colleges, which is linked to higher graduation rates and later-in-life wages, especially for Black and Hispanic students. We examine the effect of the New Orleans school reforms, a district-wide reform creating an almost all-charter school district, on the quality of colleges that students attended. Using difference-in-differences analysis of statewide microdata, we find that the reforms led students to attend four-year colleges, and higher-quality ones, at higher rates. The reforms also increased the share of college-goers who were well matched to their colleges and this had little effect on transfer or persistence rates. Overall, these results reinforce that the reforms led students to attend higher-quality colleges that will improve long-term life outcomes.

More →

Kari Dalane, Dave E. Marcotte.

Over the past three decades, children from low-income families and those from more affluent families have increasingly been attending different public schools. While recent work has helped us understand patterns of income segregation between districts and schools within districts, we know very little about segregation of students as they experience school: in the classroom. In this paper, we attempt to advance knowledge of trends in the segregation of students by income at the classroom level. We make use of detailed, student-level administrative data from North Carolina which provides a measure of a student’s free/reduced price lunch eligibility, which we refer to as economically disadvantaged (ED) status, along with information on classroom assignments. Since we know the ED status of each student in each classroom, we assess whether ED students are assigned to classes in the same pattern as other students or if are clustered/segregated into different classrooms. We know very little about the magnitude of income-based segregation, and almost nothing about whether this has changed over time, so we provide novel evidence on the question of whether segregation of students by socioeconomic status has increased within schools. We find that within-school segregation has risen by about 10 percent between 2007 and 2014 in elementary and middle schools we study. Further, we find that segregation of ED students within schools is correlated with the level of segregation between schools in districts, and this relationship grew stronger over our panel.

More →