Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

EdWorkingPapers

Qing Zhang, Maria Sauval, Jade M. Jenkins.

COVID-19 has created acute challenges for the child care sector, potentially leading to a shortage of supply and a shrinking sector as the economy recovers. This study provides the first comprehensive, census-level evaluation of the medium-term impacts of COVID-19 on the county child care market in a large and diverse state, North Carolina. We also document the disproportionate impacts of COVID-19 on different types of providers and disadvantaged communities. We use data from two time points (February and December) from 2018 to 2020 and a difference-in-differences design to isolate the effects of COVID-19. We find that COVID- 19 reduced county-level child care enrollment by 40%, and reduced the number of providers by 2%. Heterogeneity analyses reveal that family child care providers experienced not only less severe reductions in enrollment and closures than center providers, but a small growth in the number of family providers. Declines in enrollment were most substantial for preschool-aged children. COVID-19 did not appear to further exacerbate inequities in terms of enrollment amongst low-income communities, communities with a larger share of Black residents, or rural communities, although communities with a larger share of Hispanic residents had more provider closures. Our findings underscore the importance of family child care providers in the child care sector and providing continuing and targeted support to help the sector through this crisis. Implications for future policies are discussed.

More →


Ann Owens, Thalia Tom.

Past research extensively documents inequalities in educational opportunity and achievement by students’ race/ethnicity or socioeconomic status (SES). Less scholarship focuses on how race/ethnicity and SES interact and jointly contribute to educational inequalities. We advance this burgeoning line of scholarship by charting math achievement trajectories and school socioeconomic composition by both student race/ethnicity and SES in California from 2014-15 through 2017-18. Linked administrative data allow us to operationalize student SES more richly than point-in-time free meal eligibility, a measure commonly used in education research. We find evidence of considerable racial/ethnic disparities in math achievement and school socioeconomic composition among same-SES students. White and Asian students score substantially higher on math achievement tests and attend higher-SES schools than same-SES Hispanic and Black students. Achievement and contextual inequalities are related: differential exposure to school SES by student race/ethnicity is associated with within-SES racial/ethnic achievement disparities. Our findings show that SES does not translate into the same contextual or achievement advantages for students of all racial/ethnic groups, demonstrating the importance of jointly considering student race/ethnicity and SES in future research and policy development.

More →


Vivian C. Wong, Kylie L. Anglin, Peter M. Steiner.

Recent interest to promote and support replication efforts assume that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our general approach is derived from the Causal Replication Framework (CRF), which formalizes the assumptions under which replication success can be expected. The assumptions may be understood broadly as replication design requirements and individual study design requirements. Replication failure occurs when one or more CRF assumptions are violated. In design-based approaches to replication, CRF assumptions are systematically tested to evaluate the replicability of effects, as well as to identify sources of effect variation when replication failure is observed. In direct replication designs, replication failure is evidence of bias or incorrect reporting in individual study estimates, while in conceptual replication designs, replication failure occurs because of effect variation due to differences in treatments, outcomes, settings, and participant characteristics. The paper demonstrates how multiple research designs may be combined in systematic replication studies, as well as how diagnostic measures may be used to assess the extent to which CRF assumptions are met in field settings.    

More →

10/2020476.4 KB

Drew H. Bailey, Greg J. Duncan, Richard J. Murnane, Natalie Au Yeung.

A survey targeting education researchers conducted in November, 2020 provides both short- and longer-term predictions of how much achievement gaps between low- and high-income students in U.S elementary schools will change as a result of COVID-related disruptions to schooling and family life. Relative to a pre-COVID achievement gap of 1.00 SD, respondents’ median forecasts for increases in achievement gaps in elementary school by spring, 2021 were very large – from 1.00 to 1.30 and 1.25 SD, respectively, for math and reading. Researchers forecast only small reductions in gaps between spring 2021 and 2022. Although forecasts were heterogeneous, almost all respondents predicted that gaps would grow during the pandemic and would not return to pre-pandemic levels in the following school year. We discuss some implications of these predictions for strategies to reduce learning gaps exacerbated by the pandemic as well as the mental models researchers appear to employ in making their predictions.

More →


Matt S. Giani, Allison Martin.

Developmental education, in which college students deemed unprepared for college-level coursework enroll in non-credit bearing courses, is widespread in American higher education. The current study evaluates the effect of mobile app courseware on the college outcomes of developmental education students, using a research design which randomly assigned course sections to receive access to the apps or not. The results show that access to the apps significantly improved student performance in developmental education outcomes, marginally improved medium-term college persistence and performance, but did not effect credential attainment in the study timeframe. Despite a number of barriers to implementation, the results suggest the intervention has the potential to improve the short-term outcomes of developmental education students in addition to being low-cost and scalable.

More →


Jing Liu, Julie Cohen.

Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel text-as-data methods to develop automated measures of teaching to complement classroom observations traditionally done by human raters. This approach is free of rater bias and enables the detection of three instructional factors that are well aligned with commonly used observation protocols: classroom management, interactive instruction, and teacher-centered instruction. The teacher-centered instruction factor is a consistent negative predictor of value-added scores, even after controlling for teachers’ average classroom observation scores. The interactive instruction factor predicts positive value-added scores. Our results suggest that the text-as-data approach has the potential to enhance existing classroom observation systems through collecting far more data on teaching with a lower cost, higher speed, and the detection of multifaceted classroom practices.

More →


Sarah Komisarow, Emily Pakhtigian.

In this paper we study the effects of three large, nearly-simultaneous coal-fired power plant closures on school absences in Chicago. We find that the closures resulted in a 7 percent reduction in absenteeism in nearby schools relative to those farther away following the closures. For the typical elementary school in our sample, this translates into around 372 fewer absence-days per year in the aggregate, or around 0.71 fewer annual absences per student. We find that reductions in absences were larger in schools where pre-closure exposure to coal-fired power plants was more intense: namely, schools with low levels of air conditioning, schools more frequently in the wind path of the plants, and non-magnet (i.e., neighborhood) schools where students were more likely to live nearby. To explore potential mechanisms responsible for these absence reductions we investigate the effects of the closures on housing values and children’s respiratory health. We do not find statistical evidence of endogenous migration into neighborhoods near the coal-fired power plants following the closures but do find declines in emergency department visits for asthma-related conditions among school-age children.

More →


David Figlio, Paola Giuliano, Riccardo Marchingiglio, Umut Özek, Paola Sapienza.

We study the effect of exposure to immigrants on the educational outcomes of US-born students, using a unique dataset combining population-level birth and school records from Florida. This research question is complicated by substantial school selection of US-born students, especially among White and comparatively affluent students, in response to the presence of immigrant students in the school. We propose a new identification strategy to partial out the unobserved non-random selection into schools, and find that the presence of immigrant students has a positive effect on the academic achievement of US-born students, especially for students from disadvantaged backgrounds. Moreover, the presence of immigrants does not affect negatively the performance of affluent US-born students, who typically show a higher academic achievement compared to immigrant students. We provide suggestive evidence on potential channels.

More →


Heather C. Hill, Zid Mancenido, Susanna Loeb.

Despite calls for more evidence regarding the effectiveness of teacher education practices, causal research in the field remains rare. One reason is that we lack designs and measurement approaches that appropriately meet the challenges of causal inference in the context of teacher education programs. This article provides a framework for how to fill this gap. We first outline the difficulties of doing causal research in teacher education. We then describe a set of replicable practices for developing measures of key teaching outcomes, and propose causal research designs suited to the needs of the field. Finally, we identify community-wide initiatives that are necessary to advance effectiveness research in teacher education at scale.

More →


Edward Kim, Joshua Goodman, Martin R. West.

The growing phenomenon of private tutoring has received minimal scholarly attention in the United States. We use 20 years of geocoded data on the universe of U.S. private tutoring centers to estimate the size and growth of this industry and to identify predictors of tutoring center locations. We document four important facts. First, from 1997-2016, the number of private tutoring centers grew steadily and rapidly, more than tripling from about 3,000 to nearly 10,000. Second, the number and growth of private tutoring centers is heavily concentrated in geographic areas with high income and parental education. Nearly half of tutoring centers are in areas in the top quintile of income. Third, even conditional on income and parental education, private tutoring centers tend to locate in areas with many immigrant and Asian-American families, suggesting important differences by nationality and ethnicity in demand for such services. Fourth, we see little evidence that prevalence of private tutoring centers is related to the structure of K-12 school markets, including the prevalence of private schools and charter or magnet school options. The rapid rise in high-income families’ demand for this form of private educational investment mimics phenomena observed in other spheres of education and family life, with potentially important implications for inequality in student outcomes.

More →