Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.


Megan Kuhfeld, James Soland, Beth Tarasawa, Angela Johnson, Erik Ruzek, Jing Liu.

With 55 million students in the United States out of school due to the COVID-19 pandemic, education systems are scrambling to meet the needs of schools and families, including planning how best to approach instruction in the fall given students may be farther behind than in a typical year. Yet, education leaders have little data on how much learning has been impacted by school closures. While the COVID-19 learning interruptions are unprecedented in modern times, existing research on the impacts of missing school (due to absenteeism, regular summer breaks, and school closures) on learning can nonetheless inform projections of potential learning loss due to the pandemic. In this study, we produce a series of projections of COVID-19-related learning loss and its potential effect on test scores in the 2020-21 school year based on (a) estimates from prior literature and (b) analyses of typical summer learning patterns of five million students. Under these projections, students are likely to return in fall 2020 with approximately 63-68% of the learning gains in reading relative to a typical school year and with 37-50% of the learning gains in math. However, we estimate that losing ground during the COVID-19 school closures would not be universal, with the top third of students potentially making gains in reading. Thus, in preparing for fall 2020, educators will likely need to consider ways to support students who are academically behind and further differentiate instruction.

More →

Mingyu Chen, Jessica Howell, Jonathan Smith.

The F-1 student visa program brings more educated migrants to the US than any other immigration program, yet student visa applicants face an approximately 27 percent visa refusal rate that varies by time and region. Using data on the universe of SAT takers between 2004 and 2015 matched with college enrollment records, we examine how the anticipated F-1 visa restrictiveness influences US undergraduate enrollment outcomes of international students. Using an instrumental variables approach, we find that a higher anticipated F-1 student visa refusal rate decreases the number of international SAT takers, decreases the probability of sending SAT scores to US colleges, and decreases international student enrollment in the US. The decreases are larger among international students with higher measured academic achievement. We also document the academic achievement of international students and show that over 40 percent of high-scoring international SAT takers do not pursue a US college education. 

More →

Matthew Kraft.

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen’s standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In this paper, I present five broad guidelines for interpreting effect sizes that are applicable across the social sciences. I then propose a more structured schema with new empirical benchmarks for interpreting a specific class of studies: causal research on education interventions with standardized achievement outcomes. Together, these tools provide a practical approach for incorporating study features, cost, and scalability into the process of interpreting the policy importance of effect sizes.

More →

Download PDF808.62 KB

Charles T. Clotfelter, Helen F. Ladd, Calen R. Clifton, Mavzuna Turaeva.

Using detailed administrative data for public schools, we document racial and ethnic segregation at the classroom level in North Carolina, a state that has experienced a sharp increase in Hispanic enrollment. We decompose classroom-level segregation in counties into within-school and between-school components. We find that the within-school component accounted for a sizable share of total segregation in middle schools and high schools. Recognizing its importance could temper the praise for school assignment policies that reduce racial disparities between schools but allow large disparities within them. More generally, we observe between the two components a complementary relationship, with one component tending to be large when the other one is small. Comparing the degree of segregation for the state’s two largest racial/ethnic minority groups, we find that White/Hispanic segregation was more severe than White/Black segregation, particularly within schools. Analyzed as separate administrative units, schools with large shares of Black students tended to have more White/Black segregation across classrooms than schools with smaller shares. Finally, we examine enrollment patterns by course and show that school segregation brings with it differences by race and ethnicity in the courses that students take, with White students more likely to be enrolled in advanced classes.

More →

Allison Atteberry, Andrew McEachin.
The field is generally aware of summer learning loss (SLL)—that student learning slows during the summer. Yet surprisingly little consensus exists on basic questions about SLL, especially given recent concerns about measurement artifacts in foundational SLL studies. Nearly all prior SLL work examines how summers contribute to racial/ethnic or socioeconomic gaps. However, these factors only account for about 4 percent of the variance in summer learning rates. We use a unique dataset with millions of students across eight grades to document the full spread of SLL and examine how differential SLL contributes to where students end up in the 8th grade achievement distribution. We find dramatic variability in SLL, with decrements accruing to the same students over time.

More →

Matthew P. Steinberg, Haisheng Yang.

Principals shape the academic setting of schools. Yet, there is limited evidence on whether principal professional development improves schooling outcomes. In 2008-09, Pennsylvania’s Inspired Leadership (PIL) induction program required that newly hired principals complete targeted in-service professional development tied to newly established state leadership standards within five years of employment. Using panel data on all Pennsylvania students, teachers, and principals, we employ difference-in-differences and event study strategies to estimate the impact of PIL induction on teacher and student outcomes. We find that PIL induction improved teacher effectiveness (in math) and student math achievement, and that the effects of PIL induction on teacher effectiveness were concentrated among the most economically and academically disadvantaged schools in Pennsylvania. Principal professional development had the greatest impact on teacher effectiveness when principals completed PIL induction during their first two years in the principalship. We also find evidence that teacher turnover declined in the years following the completion of PIL induction. We discuss the implications of our findings for principal induction efforts.

More →

Brendan Bartanen, Andrew Kwok.

Using rich longitudinal data from one of the largest teacher education programs in Texas, we examine the measurement of pre-service teacher (PST) quality and its relationship with entry into the K–12 public school teacher workforce. Drawing on rubric-based observations of PSTs during clinical teaching, we find that little of the variation in observation scores is attributable to actual differences between PSTs. Instead, differences in scores largely reflect differences in the rating standards of field supervisors. We also find that men and PSTs of color receive systematically lower scores. Finally, higher-scoring PSTs are slightly more likely to enter the teacher workforce and substantially more likely to be hired at the same school as their clinical teaching placement.

More →

Quynh Tien Le, Morgan Polikoff.

Castañeda v. Pickard (1981) mandated that educational programs for emergent bilinguals be tested for program efficacy. Since English language development (ELD) curricular materials are one part of an instructional program, we assess this mandate by examining the effectiveness of ELD materials in Texas. Using local linear matching, we find that schools that do not purchase any ELD curricula have significantly lower English language proficiency scores relative to schools that purchase state-adopted ELD materials. These results are robust across various matching models—inverse probability weights with regression adjustment, kernel matching, and nearest neighbor matching--and a comparative interrupted time series design. There is no significant difference between schools that adopt the two most popular ELD curricula—Rigby On Our Way to English and National Geographic Reach. This study suggests that emergent bilinguals (EBs) who attend schools that have instructional materials that explicitly foreground English language proficiency standards outperform those in schools that do not have such materials.

More →

Jeffrey T. Denning, Eric R. Eide, Kevin J. Mumford, Daniel Sabey.

After increasing in the 1970s and 1980s, time to bachelor’s degree has declined since the 1990s. We document this fact using data from three nationally representative surveys. We show that this pattern is occurring across school types and for all student types. Using administrative student records from 11 large universities, we confirm the finding and show that it is robust to alternative sample definitions. We discuss what might explain the decline in time to bachelor’s degree by considering trends in student preparation, state funding, student enrollment, study time, and student employment during college.

More →