Search EdWorkingPapers
Search EdWorkingPapers by author, title, or keywords.
Search
Program and policy effects
This paper presents results of a multi-visit, longitudinal experiment on the academic and social-emotional effects of arts-based field trips. We randomly assign fourth and fifth grade students to receive arts-based field trips throughout the school year or to serve as a control. Treatment students express greater tolerance for people with different opinions and a desire to consume arts. Additionally, treatment students have fewer behavioral infractions, attend school more frequently, score higher on their end-of-grade exams, and receive higher course grades. Effects are strongest when students enter middle school. We find no effect on students’ desire to participate in the arts, empathy, or social perspective taking.
Numerous studies have considered the important role of cognition in estimating the returns to schooling. How cognitive abilities affect schooling may have important policy implications, especially in developing countries during periods of increasing educational attainment. Using two longitudinal labor surveys that collect direct proxy measures of cognitive skills, we study the importance of specific cognitive domains for the returns to schooling in two samples. We instrument for schooling levels and we find that each additional year of schooling leads to an increase in earnings by approximately 18-20 percent. The estimated effect sizes—based on the two-stage least squares estimates—are above the corresponding ordinary least squares estimates. Furthermore, we estimate and demonstrate the importance of specific cognitive domains in the classical Mincer equation. We find that executive functioning skills (i.e., memory and orientation) are important drivers of earnings in the rural sample, whereas higher-order cognitive skills (i.e., numeracy) are more important for determining earnings in the urban sample. Although numeracy is tested in both samples, it is only a statistically significant predictor of earnings in the urban sample. (JEL I21, F63, F66, N37)
Classroom teachers in the US are absent on average approximately six percent of a school year. Despite the prevalence of teacher absences, surprisingly little research has assessed the key source of replacement instruction: substitute teachers. Using detailed administrative and survey data from a large urban school district, we document the prevalence, predictors, and variation of substitute coverage across schools. Less advantaged schools systematically exhibit lower rates of substitute coverage compared with peer institutions. Observed school, teacher, and absence characteristics account for only part of this school variation. In contrast, substitute teachers’ preferences for specific schools, mainly driven by student behavior and support from teachers and school administrators, explain a sizable share of the unequal distribution of coverage rates above and beyond standard measures in administrative data.
A recent literature provides new evidence that school resources are important for student outcomes. In this paper, we show that school finance reform-induced increases in student performance are driven by those states that had test-based accountability policies in place at the time. By incentivizing school improvement, accountability systems (such as the federal No Child Left Behind act) may raise the efficiency with which additional school funding gets spent. Our empirical approach leverages the timing of school finance reforms to compare funding impacts on student test scores between states that had accountability in place at the time of the reform with states that did not. The results indicate that finance reforms are three times more productive in low-income school districts when also accompanied by test-based accountability. These findings shed new light on the role of accountability incentives in education production and the mechanisms supporting the effectiveness of school resources.
We examine the effect of air pollution from power production on students' cognitive outcomes by leveraging year-to-year production variation, wind patterns, and plant closures. We find that every one million megawatt hours of coal-fired power production decreases student performance in schools within ten kilometers by 0.02 standard deviations. Gas-fired plants exhibit no such relationship. Extrapolating our results nationwide indicates that the decline in coal use over the last decade raises test scores by 0.008 standard deviations and reduces the black-white test score gap by 0.006 standard deviations. The nationwide effect obscures substantial spatial variation: The respective numbers for the Midwest are 0.016 and 0.023.
The public narrative surrounding efforts to improve low-performing K-12 schools in the U.S. has been notably gloomy. Observers argue that either nothing works or we don’t know what works. At the same time, the federal government is asking localities to implement evidence-based interventions. But what is known empirically about whether school improvement works, how long it takes, which policies are most effective, and which contexts respond best to intervention? We meta-analyze 141 estimates from 67 studies of turnaround policies implemented post-NCLB. On average, these policies have had a moderate positive effect on math but no effect on ELA achievement as measured by high-stakes exams. We find evidence of positive impacts on low-stakes exams in STEM and humanities subjects and no evidence of harm on non-test outcomes. Some elements of reform, namely extended learning time and teacher replacements, predict greater effects. Contexts serving majority-Latinx populations have seen the largest improvements.
Growing reliance on student loans and repayment difficulties have raised concerns of a student debt crisis in the United States. However, little is known about the effects of student borrowing on human capital and long-run financial well-being. We use variation induced by recent expansions in federal loan limits, together with administrative schooling, earnings, and credit records, to identify the effects of increased student borrowing on credit-constrained students’ educational attainment, earnings, debt, and loan repayment. Increased student loan availability raises student debt and improves degree completion, later-life earnings, and student loan repayment while having no effect on homeownership or other types of debt.
A common rationale for offering online courses in K-12 schools is that they allow students to take courses not offered at their schools; however, there has been little research on how online courses are used to expand curricular options when operating at scale. We assess the extent to which students and schools use online courses for this purpose by analyzing statewide, student-course level data from high school students in Florida, which has the largest virtual sector in the nation. We introduce a “novel course” framework to address this question. We define a virtual course as “novel” if it is only available to a student virtually, not face-to-face through their own home high school. We find that 7% of high school students in 2013-14 enroll in novel online courses. Novel courses were more commonly used by higher-achieving students, in rural schools, and in schools with relatively few Advanced Placement/International Baccalaureate offerings.
A growing body of evidence suggests that vocationally focused programs of study substantially improve high-school completion and longer-run economic success. However, the corresponding recommendations to expand vocational programs may have unintended, negative consequences for low-income, academically successful students (i.e., the “missing one offs”) who have the capacity and motivation to attend highly selective universities. This study contributes to our understanding of these issues by examining an innovative, college-preparatory program targeted to academically successful Chilean students attending vocational high schools serving lower-income communities. This program (Escuela Desarrollo de Talentos or EDT) provides academic and social-emotional supports aligned with admission to selective universities. We examine the educational effects of EDT participation using a fuzzy regression-discontinuity design based on its eligibility rules. We find that the EDT program did not increase the probability of graduating from high school but did increase performance in math courses. We also find corresponding evidence suggesting that EDT participation increased math performance on college entrance exams and shifted students away from further postsecondary vocational training and towards matriculation at elite universities.
Tutoring—defined here as one-on-one or small-group instructional programming by teachers, paraprofessionals, volunteers, or parents—is one of the most versatile and potentially transformative educational tools in use today. Within the past decade, dozens of preK-12 tutoring experiments have been conducted, varying widely in their approach, context, and cost. Our study represents the first systematic review and meta-analysis of these and earlier studies. We develop a framework for considering different types of programs to not only examine overall effects, but also explore how these effects vary by program characteristics and intervention context. We find that tutoring programs yield consistent and substantial positive impacts on learning outcomes, with an overall pooled effect size estimate of 0.37 SD. Effects are stronger, on average, for teacher and paraprofessional tutoring programs than for nonprofessional and parent tutoring. Effects also tend to be strongest among the earlier grades. While overall effects for reading and math interventions are similar, reading tutoring tends to yield higher effect sizes in earlier grades, while math tutoring tends to yield higher effect sizes in later grades. Tutoring programs conducted during school tend to have larger impacts than those conducted after school.