Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

Multiple outcomes of education

Sandra E. Black, Jeffrey T. Denning, Lisa J. Dettling, Sarena Goodman, Lesley J. Turner.

Growing reliance on student loans and repayment difficulties have raised concerns of a student debt crisis in the United States. However, little is known about the effects of student borrowing on human capital and long-run financial well-being. We use variation induced by recent expansions in federal loan limits, together with administrative schooling, earnings, and credit records, to identify the effects of increased student borrowing on credit-constrained students’ educational attainment, earnings, debt, and loan repayment. Increased student loan availability raises student debt and improves degree completion, later-life earnings, and student loan repayment while having no effect on homeownership or other types of debt.

More →

Jessica Lasky-Fink, Carly D. Robinson, Hedy Chang, Todd Rogers.

Many states mandate districts or schools notify parents when students have missed multiple unexcused days of school. We report a  randomized experiment (N = 131,312) evaluating the impact of sending parents truancy notifications modified to target behavioral barriers that can hinder effective parental engagement. Modified truancy notifications that used simplified language, emphasized parental efficacy, and highlighted the negative incremental effects of missing school reduced absences by 0.07 days compared to the standard, legalistic, and punitively-worded notification—an estimated 40% improvement over the standard truancy notification. This work illustrates how behavioral insights and randomized experiments can be used to improve administrative communications in education.

More →

Thomas S. Dee, Graciela Perez-Nunez.

A growing body of evidence suggests that vocationally focused programs of study substantially improve high-school completion and longer-run economic success. However, the corresponding recommendations to expand vocational programs may have unintended, negative consequences for low-income, academically successful students (i.e., the “missing one offs”) who have the capacity and motivation to attend highly selective universities. This study contributes to our understanding of these issues by examining an innovative, college-preparatory program targeted to academically successful Chilean students attending vocational high schools serving lower-income communities. This program (Escuela Desarrollo de Talentos or EDT) provides academic and social-emotional supports aligned with admission to selective universities. We examine the educational effects of EDT participation using a fuzzy regression-discontinuity design based on its eligibility rules. We find that the EDT program did not increase the probability of graduating from high school but did increase performance in math courses. We also find corresponding evidence suggesting that EDT participation increased math performance on college entrance exams and shifted students away from further postsecondary vocational training and towards matriculation at elite universities.

More →

Carycruz Bueno.

The COVID-19 pandemic has put virtual schooling at the forefront of policy concerns, as millions of children worldwide shift to virtual schooling with hopes of “slowing the spread”. Given the emergency shift to online education coupled with the large increase in demand for virtual education over the last decade it is imperative to explore the impacts of virtual education on student outcomes. This paper estimates the causal effect of full-time virtual school attendance on student outcomes with important implications for school choice, online education, and education policy. Despite the increasing demand for K-12 virtual schools over the past decade little is known about the impact of full-time virtual schools on students’ cognitive and behavioral outcomes. The existing evidence on the impact of online education on students’ outcomes is mixed. I use a longitudinal data set composed of individual-level information on all public-school students and teachers throughout Georgia from 2007 to 2016 to investigate how attending virtual schools influences student outcomes. I implement a variety of econometric specifications to account for the issue of potential self-selection into full-time virtual schools. I find that attending a virtual school leads to a reduction of 0.1 to 0.4 standard deviations in English Language Arts, Mathematics, Science, and Social Studies achievement test scores for students in elementary and middle school. I also find that ever attending a virtual school is associated with a 10-percentage point reduction in the probability of ever graduating from high school. This is early evidence that full-time virtual schools as a type of school choice could be harmful to students’ learning and future economic opportunities, as well as a sub-optimal use of taxpayer money.

More →

Jing Liu, Julie Cohen.

Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers, but conventional classroom observations are costly, prone to rater bias, and hard to implement at scale. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel text-as-data methods to develop automated, objective measures of teaching to complement classroom observations. This approach is free of rater bias and enables the detection of three instructional factors that are well aligned with commonly used observation protocols: classroom management, interactive instruction, and teacher-centered instruction. The teacher-centered instruction factor is a consistent negative predictor of value-added scores, even after controlling for teachers’ average classroom observation scores. The interactive instruction factor predicts positive value-added scores.

More →

Jonathan Smith, Joshua Goodman, Michael Hurwitz.

We provide the first estimated economic impacts of students’ access to an entire sector of public higher education in the U.S. Approximately half of Georgia high school graduates who enroll in college do so in the state’s public four-year sector, which requires minimum SAT scores for admission. Regression discontinuity estimates show enrollment in public four-year institutions boosts students’ household income around age 30 by 20 percent, and has even larger impacts for those from low income high schools. Access to this sector has little clear impact on student loan balances or other measures of financial health. For the marginal student, enrollment in such institutions has large private returns even in the short run and positive returns to state budgets in the long run.

More →

Matthew A. Kraft.

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen’s standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In this paper, I present five broad guidelines for interpreting effect sizes that are applicable across the social sciences. I then propose a more structured schema with new empirical benchmarks for interpreting a specific class of studies: causal research on education interventions with standardized achievement outcomes. Together, these tools provide a practical approach for incorporating study features, cost, and scalability into the process of interpreting the policy importance of effect sizes.

More →

Download PDF808.62 KB

Jeffrey T. Denning, Eric R. Eide, Kevin J. Mumford, Daniel Sabey.

After increasing in the 1970s and 1980s, time to bachelor’s degree has declined since the 1990s. We document this fact using data from three nationally representative surveys. We show that this pattern is occurring across school types and for all student types. Using administrative student records from 11 large universities, we confirm the finding and show that it is robust to alternative sample definitions. We discuss what might explain the decline in time to bachelor’s degree by considering trends in student preparation, state funding, student enrollment, study time, and student employment during college.

More →

Lucy C. Sorensen, Shawn D. Bushway, Elizabeth J. Gifford.

Nationwide, school principals are given wide discretion to use disciplinary tools like suspension and expulsion to create a safe learning environment. There is legitimate concern that this power can have negative consequences, particularly for the people who are excluded. This study uses linked disciplinary, education, and criminal justice records from 2008 to 2016 in North Carolina to examine the impact of principal-driven disciplinary decisions on middle school student outcomes. We find that principals who are more likely to remove students do appear to create safer schools through a reduction in minor student misconduct. However, this deterrence comes at a high cost – these harsher principals generate more juvenile justice complaints and reduce high school graduation rates for all students in their schools. Students who committed minor disciplinary infractions in a school with a harsh principal suffer declines in attendance and test scores. Revealed racial bias in principal disciplinary decisions incurs additional negative consequences specific to Black and Hispanic students.

More →

Joshua Bleiberg.

Policymakers have sought to increase the rigor of content standards since the 1990s. However, the literature examining the effects of reforms to content standards on student outcomes is still developing. This study examines the extent to which the Common Core State Content Standards (CC) affected student achievement and the size of achievement gaps. To identify the effect of CC I compare early implementors of the CC to late implementors of the CC in a Difference-in-Differences framework. I conducted a document analysis to measure preparation for and implementation of the CC standards, which I merge together with the National Assessment of Educational Progress student-level data. I then exploit variation in the timing of state implementation of the CC to identify its effect on students overall and academically vulnerable groups. I find that the CC has a positive effect on math scores in 4th and 8th grade, but not in reading. The CC had a large positive effect on economically advantaged students, but a null effect for economically disadvantaged students. Demanding better results without addressing the structural issues burdening economically disadvantaged students may result in unintended consequences.

More →