Search for EdWorkingPapers here by author, title, or keywords.
Multiple outcomes of education
Many states mandate districts or schools notify parents when students have missed multiple unexcused days of school. We report a randomized experiment (N = 131,312) evaluating the impact of sending parents truancy notifications modified to target behavioral barriers that can hinder effective parental engagement. Modified truancy notifications that used simplified language, emphasized parental efficacy, and highlighted the negative incremental effects of missing school reduced absences by 0.07 days compared to the standard, legalistic, and punitively-worded notification—an estimated 40% improvement over the standard truancy notification. This work illustrates how behavioral insights and randomized experiments can be used to improve administrative communications in education.
Growing reliance on student loans and repayment difficulties have raised concerns of a student debt crisis in the United States. However, little is known about the effects of student borrowing on human capital and long-run financial well-being. We use variation induced by recent expansions in federal loan limits, together with administrative schooling, earnings, and credit records, to identify the effects of increased student borrowing on credit-constrained students’ educational attainment, earnings, debt, and loan repayment. Increased student loan availability raises student debt and improves degree completion, later-life earnings, and student loan repayment while having no effect on homeownership or other types of debt.
A growing body of evidence suggests that vocationally focused programs of study substantially improve high-school completion and longer-run economic success. However, the corresponding recommendations to expand vocational programs may have unintended, negative consequences for low-income, academically successful students (i.e., the “missing one offs”) who have the capacity and motivation to attend highly selective universities. This study contributes to our understanding of these issues by examining an innovative, college-preparatory program targeted to academically successful Chilean students attending vocational high schools serving lower-income communities. This program (Escuela Desarrollo de Talentos or EDT) provides academic and social-emotional supports aligned with admission to selective universities. We examine the educational effects of EDT participation using a fuzzy regression-discontinuity design based on its eligibility rules. We find that the EDT program did not increase the probability of graduating from high school but did increase performance in math courses. We also find corresponding evidence suggesting that EDT participation increased math performance on college entrance exams and shifted students away from further postsecondary vocational training and towards matriculation at elite universities.
In March 2020, most schools in the United States closed their doors and transitioned to distance learning in an effort to contain COVID-19. During the transition a significant number of students did not fully engage in these learning opportunities due to resource or other constraints. An urgent question for schools around the nation is how much did the pandemic impact student academic and social-emotional development. This paper uses administrative panel data from California to approximate the impact of the pandemic by analyzing how absenteeism affects student outcomes. We show wide variation in absenteeism impacts on cognitive and social-emotional outcomes by grade and subgroup, as well as the cumulative effect of different degrees of absence. Student outcomes generally suffer more from absenteeism in mathematics than in ELA. Negative effects are larger in middle and high school. Absences also negatively affect social-emotional development, with slight differences across constructs. Our results add to the emerging literature on the impact of COVID-19 and highlight the need for student academic and social-emotional support to make up for lost gains.
The COVID-19 pandemic has put virtual schooling at the forefront of policy concerns, as millions of children worldwide shift to virtual schooling with hopes of “slowing the spread”. Given the emergency shift to online education coupled with the large increase in demand for virtual education over the last decade it is imperative to explore the impacts of virtual education on student outcomes. This paper estimates the causal effect of full-time virtual school attendance on student outcomes with important implications for school choice, online education, and education policy. Despite the increasing demand for K-12 virtual schools over the past decade little is known about the impact of full-time virtual schools on students’ cognitive and behavioral outcomes. The existing evidence on the impact of online education on students’ outcomes is mixed. I use a longitudinal data set composed of individual-level information on all public-school students and teachers throughout Georgia from 2007 to 2016 to investigate how attending virtual schools influences student outcomes. I implement a variety of econometric specifications to account for the issue of potential self-selection into full-time virtual schools. I find that attending a virtual school leads to a reduction of 0.1 to 0.4 standard deviations in English Language Arts, Mathematics, Science, and Social Studies achievement test scores for students in elementary and middle school. I also find that ever attending a virtual school is associated with a 10-percentage point reduction in the probability of ever graduating from high school. This is early evidence that full-time virtual schools as a type of school choice could be harmful to students’ learning and future economic opportunities, as well as a sub-optimal use of taxpayer money.
Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers, but conventional classroom observations are costly, prone to rater bias, and hard to implement at scale. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel text-as-data methods to develop automated, objective measures of teaching to complement classroom observations. This approach is free of rater bias and enables the detection of three instructional factors that are well aligned with commonly used observation protocols: classroom management, interactive instruction, and teacher-centered instruction. The teacher-centered instruction factor is a consistent negative predictor of value-added scores, even after controlling for teachers’ average classroom observation scores. The interactive instruction factor predicts positive value-added scores.
We provide the first estimated economic impacts of students’ access to an entire sector of public higher education in the U.S. Approximately half of Georgia high school graduates who enroll in college do so in the state’s public four-year sector, which requires minimum SAT scores for admission. Regression discontinuity estimates show enrollment in public four-year institutions boosts students’ household income around age 30 by 20 percent, and has even larger impacts for those from low income high schools. Access to this sector has little clear impact on student loan balances or other measures of financial health. For the marginal student, enrollment in such institutions has large private returns even in the short run and positive returns to state budgets in the long run.
Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen’s standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In this paper, I present five broad guidelines for interpreting effect sizes that are applicable across the social sciences. I then propose a more structured schema with new empirical benchmarks for interpreting a specific class of studies: causal research on education interventions with standardized achievement outcomes. Together, these tools provide a practical approach for incorporating study features, cost, and scalability into the process of interpreting the policy importance of effect sizes.
After increasing in the 1970s and 1980s, time to bachelor’s degree has declined since the 1990s. We document this fact using data from three nationally representative surveys. We show that this pattern is occurring across school types and for all student types. Using administrative student records from 11 large universities, we confirm the finding and show that it is robust to alternative sample definitions. We discuss what might explain the decline in time to bachelor’s degree by considering trends in student preparation, state funding, student enrollment, study time, and student employment during college.
Nationwide, school principals are given wide discretion to use disciplinary tools like suspension and expulsion to create a safe learning environment. There is legitimate concern that this power can have negative consequences, particularly for the people who are excluded. This study uses linked disciplinary, education, and criminal justice records from 2008 to 2016 in North Carolina to examine the impact of principal-driven disciplinary decisions on middle school student outcomes. We find that principals who are more likely to remove students do appear to create safer schools through a reduction in minor student misconduct. However, this deterrence comes at a high cost – these harsher principals generate more juvenile justice complaints and reduce high school graduation rates for all students in their schools. Students who committed minor disciplinary infractions in a school with a harsh principal suffer declines in attendance and test scores. Revealed racial bias in principal disciplinary decisions incurs additional negative consequences specific to Black and Hispanic students.