Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

EdWorkingPapers

Justin B. Doromal, Daphna Bassok, Laura Bellows, Anna J. Markowitz.

High rates of teacher turnover in child care settings have negative implications for young children’s learning experiences and for efforts to improve child care quality. Prior research has explored the prevalence and predictors of turnover at the individual teacher level, but less is known about turnover at the center level – specifically, how turnover varies across child care centers or whether staffing challenges persist year after year for some centers. This study tracks annual turnover rates for all publicly funded child care centers that were continuously operating in Louisiana from the 2015-16 to 2018-19 school years (n=575 centers). We document high and variable turnover rates across centers throughout the state: The annual mean turnover rate was 40%, and each year nearly one-third of centers experienced high turnover, that is, lost more than half of their teachers. About 27% of centers experienced high turnover for multiple years in our panel, while 44% of centers did not experience high turnover in any year. Our findings underscore concerns that sustained staffing challenges may hinder efforts to provide high-quality child care.

More →


Peter M. Steiner, Patrick Sheehan, Vivian C. Wong.

Given recent evidence challenging the replicability of results in the social and behavioral sciences, critical questions have been raised about appropriate measures for determining replication success in comparing effect estimates across studies. At issue is the fact that conclusions about replication success often depend on the measure used for evaluating correspondence in results. Despite the importance of choosing an appropriate measure, there is still no wide-spread agreement about which measures should be used. This paper addresses these questions by describing formally the most commonly used measures for assessing replication success, and by comparing their performance in different contexts according to their replication probabilities – that is, the probability of obtaining replication success given study-specific settings. The measures may be characterized broadly as conclusion-based approaches, which assess the congruence of two independent studies’ conclusions about the presence of an effect, and distance-based approaches, which test for a significant difference or equivalence of two effect estimates. We also introduce a new measure for assessing replication success called the correspondence test, which combines a difference and equivalence test in the same framework. To help researchers plan prospective replication efforts, we provide closed formulas for power calculations that can be used to determine the minimum detectable effect size (and thus, sample sizes) for each study so that a predetermined minimum replication probability can be achieved. Finally, we use a replication dataset from the Open Science Collaboration (2015) to demonstrate the extent to which conclusions about replication success depend on the correspondence measure selected.

More →


Kathleen Lynch, Lily An, Zid Mancenido.
We present results from a meta-analysis of 37 contemporary experimental and quasi-experimental studies of summer programs in mathematics for children in Grades pre-K-12, examining what resources and characteristics predict stronger student achievement. Children who participated in summer programs that included mathematics activities experienced significantly better mathematics achievement outcomes, compared to their control group counterparts. We find an average weighted impact estimate of +0.10 standard deviations on mathematics achievement outcomes. We find similar effects for programs conducted in higher- and lower-poverty settings. We undertook a secondary analysis exploring the effect of summer programs on non-cognitive outcomes and found positive mean impacts. The results indicate that summer programs are a promising tool to strengthen children’s mathematical proficiency outside of school time.

More →


Mark J. Chin.

In this paper I study how school desegregation by race following Brown v. Board of Education affected White individuals’ racial attitudes and politics in adulthood. I use geocoded nationwide data from the General Social Survey and differences-in-differences to identify causal impacts. Integration significantly reduced White individuals’ political conservatism as adults in the U.S. South but not elsewhere. I observe similar geographic impact heterogeneity for individuals’ attitudes towards Blacks and policies promoting racial equity, but positive effects emerge less consistently across specifications. Results suggest that this heterogeneity may depend on the effectiveness of integration policies. In the south, Black-White exposure was greater following desegregation, and White disenrollment was lower. My study provides the first causal evidence on how different theories concerning intergroup contact and racial attitudes (i.e., the contact and racial threat hypotheses) may have applied to school contexts following historic court mandates to desegregate.

More →


Sarah R. Cohodes, Helen Ho, Silvia C. Robles.

The federal government and many individual organizations have invested in programs to support diversity in the STEM pipeline, including STEM summer programs for high school students, but there is little rigorous evidence of their efficacy. We fielded a randomized controlled trial to study a suite of such programs targeted to underrepresented high school students at an elite, technical institution. The STEM summer programs differ in their length (one week, six weeks, or six months) and modality (on-site or online). Students offered seats in the STEM summer programs are more likely to enroll in, persist through, and graduate from college, with gains in institutional quality coming from both the host institution and other elite universities. The programs also increase the likelihood that students graduate with a degree in a STEM field, with the most intensive program increasing four-year graduation with a STEM degree attainment by 33 percent. The shift to STEM degrees increases potential earnings by 2 to 6 percent. Program-induced gains in college quality fully account for the gains in graduation, but gains in STEM degree attainment are larger than predicted based on institutional differences.

More →


Jackie Eunjung Relyea, James S. Kim, Patrick Rich.

The current study replicated and extended the previous findings of content-integrated literacy intervention focusing on its effectiveness on first- and second-grade English learners’ (N = 1,314) reading comprehension, writing, vocabulary knowledge, and oral proficiency. Statistically significant findings were replicated on science and social studies vocabulary knowledge (ES = .51 and .53, respectively) and argumentative writing (ES = .27 and .41, respectively). Furthermore, treatment group outperformed control group on reading (ES = .08) and listening comprehension (ES = .14). Vocabulary knowledge and oral proficiency mediated treatment effects on reading comprehension, whereas only oral proficiency mediated effects on writing. Findings replicate main effects on vocabulary knowledge and writing, while also extending previous research by highlighting mechanisms underlying improved reading comprehension and writing.

More →


Stephanie Owen.

Beliefs about relative academic performance may shape field specialization and explain gender gaps in STEM enrollment, but little causal evidence exists. To test whether these beliefs are malleable and salient enough to change behavior, I run a randomized controlled trial with 5,700 undergraduates across seven introductory STEM courses. Providing relative performance information shrinks gender gaps in biased beliefs substantially and closes ten percent of the gender gap in subsequent STEM course-taking. The gap closes due to men taking fewer STEM credits; women’s behavior is unchanged, implying that male overconfidence rather than female underconfidence contributes to gaps in specialization. Beliefs matter, but may not be a useful target for facilitating female STEM participation.

More →


Angel H. Harris, Darryl V. Hill, Matthew A. Lenard.

Disparities in gifted representation across demographic subgroups represents a large and persistent challenge in U.S. public schools. In this paper, we measure the impacts of a school-wide curricular intervention designed to address such disparities. We implemented Nurturing for a Bright Tomorrow (NBT) as a cluster randomized trial across elementary schools with the low gifted identification rates in one of the nation’s largest school systems. NBT did not boost formal gifted identification or math achievement in the early elementary grades. It did increase reading achievement in select cohorts and broadly improved performance on a gifted identification measure that assesses nonverbal abilities distinct from those captured by more commonly used screeners. These impacts were driven by Hispanic and female students. Results suggest that policymakers consider a more diverse battery of qualifying exams to narrow disparity gaps in gifted representation and carefully weigh tradeoffs between universal interventions like NBT and more targeted approaches.

More →


Robert W. Fairlie, George Bulman.

This paper examines how the pandemic impacted the enrollment patterns, fields of study, and academic outcomes of students in the California Community College System, the largest higher-education system in the country. Enrollment dropped precipitously during the pandemic – the total number of enrolled students fell by 11 percent from fall 2019 to fall 2020 and by another 7 percent from fall 2020 to fall 2021. The California Community College system lost nearly 300,000 students over this period. Our analysis reveals that enrollment reductions were largest among Black/African-American and Latinx students, and were larger among continuing students than first-time students. We find no evidence that having a large online presence prior to the pandemic protected colleges from these negative effects. Enrollment changes were substantial across a wide range of fields and were large for both vocational courses and academic courses that can be transferred to four-year institutions. In terms of course performance, changes in completion rates, withdrawal rates, and grades primarily occurred in the spring of 2020. These findings of the effects of the pandemic at community colleges have implications for policy, impending budgetary pressures, and future research.

More →


Claire McMorris, David S. Knight.

The Coronavirus Aid, Relief and Economic Security (CARES) Act passed by Congress in 2020 included significant aid to state education systems. These included direct aid to K-12 districts and higher education institutions, and funds to be used at the discretion of Governors through the Governor’s Emergency Education Relief Fund (GEER). We examine the factors influencing where and how GEER funding was distributed across state K-12 systems and what inequities were introduced in its spending. Using a mixed methods analysis of state GEER spending plans and district-level finance data, we focus specifically on how governors sought to target schools serving disadvantaged student groups. We find that several state leaders decided to send their GEER funds to school districts via funding formulas, and that some Governors made decisions to direct their GEER funds towards certain student groups. State spending patterns were not strongly related to governor political ideology or the states’ existing funding formulas or inter-district resource allocation patterns. We discuss the implications of this policy related to two state case examples, California and New York, and provide insight for future education stimulus funding proposals.

More →