Search for EdWorkingPapers here by author, title, or keywords.
Program and policy effects
Research consistently demonstrates that tutoring interventions have substantial positive effects on student learning. As a result, tutoring has emerged as a promising strategy for addressing COVID-related learning loss and affording greater educational opportunities for students living in poverty. The effectiveness of tutoring programs, however, varies greatly, and these variations may drive differential gains in student learning. Therefore, determining the program characteristics that do and do not drive positive student outcomes will be key to providing guidance for policymakers and practitioners who want to implement high-impact tutoring at scale. Our goal is to highlight the programs, characteristics, and conditions that evidence suggests make for effective tutoring and to create an evidence-based framework for delivering and evaluating tutoring interventions. In addition, we identify promising questions for future research.
In this paper, I review the economics literature on for-profit college education in the United States, assessing what we know about institutional behavior and student outcomes after two decades of research. The many studies reviewed here reveal some consistent patterns. It is clear that for-profits compete with institutions in other sectors, yet they behave differently than their public and nonprofit counterparts. The literature is mixed on the responsiveness of the sector to labor market demands, but any responsiveness does not appear to translate to better student outcomes. The vast majority of studies on employment and earnings gains for students in for-profits find worse outcomes for for-profit students relative to similar students in other sectors. These disappointing results suggest that additional accountability measures may be warranted to protect students and taxpayers.
Despite the growing evidence of informational interventions on college and major choices, we know little about how such light-touch interventions affect the gender gap in STEM majors. Linking survey data to administrative records of Chinese college applicants, we conducted a large-scale randomized experiment to examine the STEM gender gap in the major preference beliefs, application behaviors, and admissions outcomes. We find that female students are less likely to prefer, apply to, and enroll in STEM majors, particularly Engineering majors. In a school-level cluster randomized controlled trial, we provided treated students with major-specific wage information. Students’ major preferences are easily malleable that 39% of treated students updated their preferences after receiving the wage informational intervention. The wage informational intervention has no statistically significant impacts on female students’ STEM-related major applications and admissions. In contrast, those male students in rural areas who likely lack such information are largely shifted into STEM majors as a result of the intervention. We provide supporting evidence of heterogeneous major preferences for extrinsic incentives: even among those students who are most likely to be affected by the wage information (prefer high paying majors and lack the wage information), female students are less responsive to the informational intervention.
We provide novel evidence on the causal impacts of student absences in middle and high school on state test scores, course grades, and educational attainment using a rich administrative dataset that tracks the date and class period of each absence. We use two similar but distinct identification strategies that address potential endogeneity due to time-varying student-level shocks by exploiting within-student, between-subject variation in class-specific absences. We also leverage information on the timing of absences to show that absences that occur after the annual window for state standardized testing do not affect test scores, providing a further check of our identification strategy. Both approaches yield similar results. We nd that absences in middle and high school harm contemporaneous student achievement and longer-term educational attainment: On average, missing 10 classes reduces math or English Language Arts test scores by 3-4% of a standard deviation and course grades by 17-18% of a standard deviation. 10 total absences across all subjects in 9th grade reduce both the probability of on-time graduation and ever enrolling in college by 2%. Learning loss due to school absences can have profound economic and social consequences.
We provide theory and evidence about how the design of college financial aid programs affects a variety of high school, college, and life outcomes. The evidence comes from an eight-year randomized trial where 2,587 high school ninth graders received a $12,000 merit-based grant offer. During high school, the program increased their college expectations and non-merit effort but had no effect on merit-related effort (e.g., GPA). After high school, the program increased graduation from two-year colleges only, apparently because of the free college design/framing in only that sector. But we see no effects on incarceration or teen pregnancy. Overall, the results suggest that free college affects student outcomes in ways similar to what advocates of free college suggest and making aid commitments early, well before college starts, increases some forms of high school effort. But we see no evidence that merit requirements are effective. Both the standard human capital model and behavioral economics are required to explain these results.
Principals (policy makers) have debated the progress in U. S. student performance for a half century or more. Informing these conversations, survey agents have administered seven million psychometrically linked tests in math and reading in 160 waves to national probability samples of selected cohorts born between 1954 and 2007. This study is the first to assess consistency of results by agency. We find results vary by agent, but consistent with Flynn effects, gains are larger in math than reading, except for the most recent period. Non-whites progress at a faster pace. Socio-economically disadvantaged white, black, and Hispanic students make greater progress when tested in elementary school, but that advantage attenuates and reverses itself as students age. We discuss potential moderators.
Education has faced unprecedented disruption during the COVID-19 pandemic; evidence about the subsequent effect on children is of crucial importance. We use data from an oral reading fluency (ORF) assessment—a rapid assessment taking only a few minutes that measures a fundamental reading skill—to examine COVID’s effects on children’s reading ability during the pandemic in more than 100 U.S. school districts. Effects were pronounced, especially for Grades 2–3, but distinct across spring and fall 2020. While many students were not assessed in spring 2020, those who were seemed to have experienced relatively limited or no growth in ORF relative to gains observed in other years. In fall 2020, a far more representative set of students was observed. For those students, growth was more pronounced and seemed to approach levels observed in previous years. Worryingly, there were also signs of stratification such that students in lower-achieving districts may be falling further behind. However, at the level of individual students, those who were struggling with reading prior to the pandemic were not disproportionately impacted in terms of ORF growth. This data offers an important window onto how a foundational skill is being affected by COVID-19 and this approach can be used in the future to examine how student abilities recover as education enters a post-COVID paradigm.
Graduate student teaching assistants from underrepresented groups may provide salient role models and enhanced instruction to minority students in STEM fields. We explore minority student-TA interactions in an important course in the sciences and STEM – introductory chemistry labs – at a large public university. The uncommon assignment method of students to TA instructors in these chemistry labs overcomes selection problems, and the small and active learning classroom setting with required attendance provides frequent interactions with the TA. We find evidence that underrepresented minority students are less likely to drop courses and are more likely to pass courses when assigned to minority TAs, but we do not find evidence of effects for grades and medium-term outcomes. The effects for the first-order outcomes are large with a decrease in the drop rate by 5.5 percentage points on a base of 6 percent, and an increase in the pass rate of 4.8 percentage points on a base of 93.6 percent. The findings are similar when we focus on Latinx student - Latinx TA interactions. The findings are robust to first-time vs. multiple enrollments in labs, specifications with different levels of fixed effects, limited choice of TA race, limited information of TAs, and low registration priority students. The findings have implications for debates over increasing diversity among PhD students in STEM fields because of spillovers to minority undergraduates.
Many state governments impose tuition regulations on universities in pursuit of college affordability. How effective are these regulations? We study how universities' "sticker price'' and institutional financial aid change during and after tuition caps and freezes by leveraging temporal and geographic variation in the United States from 1990 to 2013. We find that listed tuition is lower than it would have been in the absence of the regulation by 6.3 (9.3) percentage points at four-year (two-year) colleges during the regulation. Meanwhile, the negative impact on institutional aid at four-year colleges during a tuition cap/freeze is nearly double (-11.3 percentage points) the impact on listed tuition, implying that universities adjust institutional aid in order to recoup some of their losses from the tuition cap/freeze. Effects are long-lasting at four-year institutions; two years after the regulation is lifted, tuition is 7.3 percentage points lower and institutional aid is 19.5 percentage points lower than it would have been without the regulation. Meanwhile at two-year colleges, tuition "catches up" so that by three years after the end of the regulation tuition is not statistically different from what it would have been in the absence of the regulation. Universities that are not research-intensive and universities that have a greater dependency on tuition revenue exhibit larger negative impacts on institutional aid with smaller impacts on "sticker price''. Our estimates suggest that tuition caps and freezes do not simply lower the prices that students pay for college and that the benefit of tuition regulations is unequally spread across types of universities and students.
We present results from a meta-analysis of 37 experimental and quasi-experimental studies of summer programs in mathematics for children in grades pre-K-12, examining what resources and characteristics relate to stronger student achievement, attainment, and social-emotional and behavioral outcomes. Compared to control group children, children who participated in summer programs that included mathematics lessons and activities enjoyed significant improvements in mathematics learning as well as social-behavioral outcomes. We find an average weighted impact estimate of +0.09 standard deviations on mathematics achievement outcomes. In a parallel meta-analysis, we found similar positive impacts of summer programs on socialemotional and behavioral outcomes, Programs conducted in both high- and lower-poverty settings saw similar positive impacts. The results highlight the potential for summer programs to strengthen children’s mathematical ability and improve learning outcomes in both mixed-poverty and high-poverty settings.