Search for EdWorkingPapers here by author, title, or keywords.
The COVID-19 pandemic led to an abrupt shift from in-person to virtual instruction in Spring 2020. Using a difference-in-differences framework that leverages within-course variation on whether students started their Spring 2020 courses in person or online, we estimate the impact of this shift on the academic performance of Virginia’s community college students. We find that the shift to virtual instruction resulted in a 6.7 percentage point decrease in course completion, driven by increases in both course withdrawal and failure. Faculty experience teaching a course online did not mitigate the negative effects of moving to virtual instruction.
The Community Eligibility Provision (CEP) is a policy change to the federally-administered National School Lunch Program that allows schools serving low-income populations to classify all students as eligible for free meals, regardless of individual circumstances. This has implications for the use of free and reduced-price meal (FRM) data to proxy for student disadvantage in education research and policy applications, which is a common practice. We document empirically how the CEP has affected the value of FRM eligibility as a proxy for student disadvantage. At the individual student level, we show that there is essentially no effect of the CEP. However, the CEP does meaningfully change the information conveyed by the share of FRM-eligible students in a school. It is this latter measure that is most relevant for policy uses of FRM data.
Note: Portions of this paper were previously circulated under the title “Using Free Meal and Direct Certification Data to Proxy for Student Disadvantage in the Era of the Community Eligibility Provision.” We have since split the original paper into two parts. This is the first part.
The Post-9/11 GI Bill allows service members to transfer generous education benefits to a dependent. We run a large scale experiment that encourages service members to consider the transfer option among a population that includes individuals for whom the transfer benefits are clear and individuals for whom the net-benefits are significantly more ambiguous. We find no impact of a one-time email about benefits transfer among service members for whom we predict considerable ambiguity in the action, but sizeable impacts among service members for whom education benefits transfer is far less ambiguous. Our work contributes to the nascent literature investigating conditions when low-touch nudges at scale may be effective. JEL Classification: D15, D91, H52, I24
The evidence that student learning declines sharply (or stagnates) during the summer has motivated a substantial interest in programs that provide intensive academic instruction during the summer. However, the existing literature suggests that such programs, which typically focus on just one or two subjects, have modest effects on students’ achievement and no impact on measures of their engagement in school. In this quasi-experimental study, we present evidence on the educational impact of a unique and mature summer learning program that serves low-income middle school students and features unusual academic breadth and a social emotional curriculum with year-to-year scaffolding. Our results indicate that this program led to substantial reductions in unexcused absences, chronic absenteeism and suspensions and a modest gain in ELA test scores. We find evidence that the gains in behavioral engagement grow over time and with additional summers of participation. Our results also suggest that these effects were particularly concentrated among boys and Latinx students.
State testing programs regularly release previously administered test items to the public. We provide an open-source recipe for state, district, and school assessment coordinators to combine these items flexibly to produce scores linked to established state score scales. These would enable estimation of student score distributions and achievement levels. We discuss how educators can use resulting scores to estimate achievement distributions at the classroom and school level. We emphasize that any use of such tests should be tertiary, with no stakes for students, educators, and schools, particularly in the context of a crisis like the COVID-19 pandemic. These tests and their results should also be lower in priority than assessments of physical, mental, and social–emotional health, and lower in priority than classroom and district assessments that may already be in place. We encourage state testing programs to release all the ingredients for this recipe to support low-stakes, aggregate-level assessments. This is particularly urgent during a crisis where scores may be declining and gaps increasing at unknown rates.
Evidence on educational returns and the factors that determine the demand for schooling in developing countries is extremely scarce. We use two surveys from Tanzania to estimate both the actual and perceived schooling returns and subsequently examine what factors drive individual misperceptions regarding actual returns. Using ordinary least squares and instrumental variable methods, we find that each additional year of schooling in Tanzania increases earnings, on average, by 9 to 11 percent. We find that on average, individuals underestimate returns to schooling by 74 to 79 percent, and three factors are associated with these misperceptions: income, asset poverty, and educational attainment. Shedding light on what factors relate to individual beliefs about educational returns can inform policy on how to structure effective interventions to correct individuals' misperceptions.
Classroom teachers in the US are absent on average approximately six percent of a school year. Despite the prevalence of teacher absences, surprisingly little research has assessed the key source of replacement instruction: substitute teachers. Using detailed administrative and survey data from a large urban school district, we document the prevalence, predictors, and variation of substitute coverage across schools. Less advantaged schools systematically exhibit lower rates of substitute coverage compared with peer institutions. Observed school, teacher, and absence characteristics account for only part of this school variation. In contrast, substitute teachers’ preferences for specific schools, mainly driven by student behavior and support from teachers and school administrators, explain a sizable share of the unequal distribution of coverage rates above and beyond standard measures in administrative data.
Performance-based funding models for higher education, which tie state support for institutions to performance on student outcomes, have proliferated in recent decades. Some states have designed these policies to also address educational attainment gaps by including bonus payments for traditionally low-performing groups. Using a Synthetic Control Method research design, we examine the impact of these funding regimes on race-based completion gaps in Tennessee and Ohio. We find no evidence that performance-based funding narrowed race-based completion gaps. In fact, contrary to their intended purpose, we find that performance-based funding widened existing gaps in certificate completion in Tennessee. Across both states, the estimated impacts on associate degree outcomes are also directionally consistent with performance-based funding exacerbating racial inequities in associate degree attainment.
COVID-19 has forced essentially all schools in the country to close their doors to inperson activities. In this study, we provide new evidence about variation in school responses across school types. We focus on five main constructs of school activity during COVID-19: personalization and engagement in instruction, personalization and engagement in other school communication with students, progress monitoring (especially assignment grading), breadth of services (e.g., counseling and meals), and equitable access (to technology and services for students with special needs). We find that the strongest predictor of the extent of school activities was the education level of parents and other adults in schools’ neighborhoods. Internet access also predicts school responses. Race, parent/adult income, and school spending do not predict school responses. Private schools shifted to remote learning several days faster than traditional public schools, though others eventually caught up. On some measures, charter schools exceeded the responses of other schools; in other cases, traditional public schools had the highest overall measures. States in the Midwest responded more aggressively than those in other regions, especially the South, even after controlling for the full set of additional covariates. Learning management systems were reported by a large majority of schools, followed by video communication tools and tutorial/assessment programs. Several methods are proposed and implemented to address differential website use. We discuss potential implications of these findings for policy and effects on student outcomes.