Search EdWorkingPapers by author, title, or keywords.
Multiple outcomes of education
This paper considers an unavoidable feature of the school environment, class rank. What are the long-run effects of a student’s ordinal rank in elementary school? Using administrative data on all public-school students in Texas, we show that students with a higher third-grade academic rank, conditional on achievement and classroom fixed effects, have higher subsequent test scores, are more likely to take AP classes, graduate from high school, enroll in and graduate from college, and ultimately have higher earnings 19 years later. We also discuss the necessary assumptions for the identification of rank effects and propose new solutions to identification challenges. The paper concludes by exploring the tradeoff between higher quality schools and higher rank in the presence of these rank-based peer effects.
Past research extensively documents inequalities in educational opportunity and achievement by students’ race/ethnicity or socioeconomic status (SES). Less scholarship focuses on how race/ethnicity and SES interact and jointly contribute to educational inequalities. We advance this burgeoning line of scholarship by charting math achievement trajectories and school socioeconomic composition by both student race/ethnicity and SES in California from 2014-15 through 2017-18. Linked administrative data allow us to operationalize student SES more richly than point-in-time free meal eligibility, a measure commonly used in education research. We find evidence of considerable racial/ethnic disparities in math achievement and school socioeconomic composition among same-SES students. White and Asian students score substantially higher on math achievement tests and attend higher-SES schools than same-SES Hispanic and Black students. Achievement and contextual inequalities are related: differential exposure to school SES by student race/ethnicity is associated with within-SES racial/ethnic achievement disparities. Our findings show that SES does not translate into the same contextual or achievement advantages for students of all racial/ethnic groups, demonstrating the importance of jointly considering student race/ethnicity and SES in future research and policy development.
Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel text-as-data methods to develop automated measures of teaching to complement classroom observations traditionally done by human raters. This approach is free of rater bias and enables the detection of three instructional factors that are well aligned with commonly used observation protocols: classroom management, interactive instruction, and teacher-centered instruction. The teacher-centered instruction factor is a consistent negative predictor of value-added scores, even after controlling for teachers’ average classroom observation scores. The interactive instruction factor predicts positive value-added scores. Our results suggest that the text-as-data approach has the potential to enhance existing classroom observation systems through collecting far more data on teaching with a lower cost, higher speed, and the detection of multifaceted classroom practices.
Many states mandate districts or schools notify parents when students have missed multiple unexcused days of school. We report a randomized experiment (N = 131,312) evaluating the impact of sending parents truancy notifications modified to target behavioral barriers that can hinder effective parental engagement. Modified truancy notifications that used simplified language, emphasized parental efficacy, and highlighted the negative incremental effects of missing school reduced absences by 0.07 days compared to the standard, legalistic, and punitively-worded notification—an estimated 40% improvement over the standard truancy notification. This work illustrates how behavioral insights and randomized experiments can be used to improve administrative communications in education.
Jackson, Wigger, and Xiong (2020a, JWX) provide evidence that education spending reductions following the Great Recession had widespread negative impacts on student achievement and attainment. This paper describes our process of duplicating JWX and highlights a variety of tests we employ to investigate the nature and robustness of the relationship between school spending reductions and student outcomes. Though per-pupil expenditures undoubtedly shifted downward due to the Great Recession, contrary to JWX, our findings indicate there is not a clear and compelling story about the impact of those reductions on student achievement. Moreover, we find that the relationship between K-12 spending and college-going rates is likely confounded with contemporaneous higher education funding trends. While we believe that K-12 spending reductions may have negative impacts on student outcomes, our results suggest that estimating generalizable causal effects remains a significant challenge.
Nationwide, school principals are given wide discretion to use disciplinary tools like suspension and expulsion to create a safe learning environment. There is legitimate concern that this power can have negative consequences, particularly for the students who are excluded. This study uses linked disciplinary, education, and criminal justice records from 2008 to 2016 in North Carolina to examine the impact of principal driven disciplinary decisions on middle school student outcomes. We find that principals who are more likely to remove students lead to reductions in reported rates of minor student misconduct. However, this deterrence comes at a high cost – these harsher principals generate more juvenile justice complaints and reduce high school graduation rates for all students in their schools. Students who committed minor disciplinary infractions in a school with a harsh principal suffer additional declines in attendance and test scores. Finally, principals exhibiting racial bias in their disciplinary decisions also widen educational gaps between White and Black students.
Test-based accountability pressures have been shown to result in transferring less effective teachers into untested early grades and more effective teachers to tested grades. In this paper, we evaluate whether a state initiative to turnaround its lowest performing schools reproduced a similar pattern of assigning teachers and unintended, negative effects on the outcomes of younger students in untested grades. Using a sharp regression discontinuity design, we find consistent evidence of increased chronic absenteeism and grade retention in the first year. Also, the findings suggest negative effects on early literacy and reading comprehension in the first year of the reform that rebounded somewhat in the second year. Schools labeled low performing reassigned low effectiveness teachers from tested grades into untested early grades, though these assignment practices were no more prevalent in reform than control schools. Our results suggest that accountability-driven school reform can yield negative consequences for younger students that may undermine the success and sustainability of school turnaround efforts.
In response to the COVID-19 outbreak, the governments of most countries ordered the closure of schools, potentially exacerbating existing learning gaps. This paper evaluates the effectiveness of an intervention implemented in Italian middle schools that provides free individual tutoring online to disadvantaged students during lock-down. Tutors are university students who volunteer for 3 to 6 hours per week. They were randomly assigned to middle school students, from a list of potential beneficiaries compiled by school principals. Using original survey data collected from students, parents, teachers and tutors, we find that the program substantially increased students’ academic performance (by 0.26 SD on average) and that it significantly improved their socio-emotional skills, aspirations, and psychological well-being. Effects are stronger for children from lower socioeconomic status and, in the case of psychological well-being, for immigrant children.
To evaluate how Advanced Placement courses affect college-going, we randomly assigned the offer of enrollment into an AP science course to over 1,800 students in 23 schools that had not previously offered the course. We find no substantial AP course effects on students’ plans to enroll in college or on their college entrance exam scores. Yet AP course-takers enroll in less selective colleges than their control group counterparts. Negative treatment effects on college selectivity appear to be driven more by low student preparation than teacher inexperience and by students’ matriculation decisions rather than institutional admissions decisions.