EdWorkingPapers
Effectiveness of Structured Teacher Adaptations to an Online Content Literacy Intervention for Third Graders: A Randomized Controlled Trial During COVID-19
Scaling up evidence-based educational interventions to improve student outcomes presents challenges, especially when adapting to new contexts while maintaining fidelity. Structured teacher adaptations that integrate the strengths of experimental science (high fidelity) and improvement science (high adaptation) offer a viable solution to bridge the research-practice divide. This preregistered… more →
Improving College Readiness in Mathematics in the Context of a Comprehensive High School Reform
This mixed methods experimental study examined the impacts of the Early College High School model on students’ college readiness in mathematics measured by their success in college preparatory mathematics courses in the 9th through 11th grades, and disaggregated for academically prepared and underprepared students. This study looked at the longitudinal sample of students who moved from the 9th… more →
State Intervention and Racialized Policy Aversion in Michigan's Black School Districts
For the past thirty years, Michigan has used Emergency Management (EM) and receiverships to solve city and school finance issues. The impact of these state intervention policies has been highly publicized and has led to institutional distrust among black citizens in urban communities —with the Flint water crisis standing out as the most infamous and high-profile example. A possible outcome of… more →
Curricular-Credential Decoupling: How Schools Respond to Career and Technical Education Policy
This study examines College and Career Readiness (CCR) policy implementation through the lens of decoupling. We investigate how high schools have jointly implemented Career and Technical Education (CTE) and Industry-Based Certifications (IBCs), and whether there is evidence of curricular-credential decoupling via misalignment between the subject-areas of students’ CTE course and IBC completion… more →
Framework for Evaluating & Reforming Education Finance Systems
This paper presents a comprehensive framework for evaluating and reforming education finance systems to ensure equity, adequacy, and equal opportunity in publicly funded education. We summarize decades conceptual work, explaining our evolving understanding of the role and purpose of school finance systems, leading to our current framing that the purpose of these systems is to deliver the… more →
Beyond School Police Officers: Racial/Ethnic Disparities in Exposure to a Fuller Range of School Disciplinary Personnel
Using data from the 2017–18 and 2020–21 Civil Rights Data Collection, we document dis-parities in exposure to disciplinary staff across US high schools and geographic levels. Black and Hispanic students are exposed to 1.1 and 0.8 more disciplinary personnel than White students, respectively, which is equivalent to roughly twice the total average expo-sure to disciplinary personnel in high… more →
On-the-Job Learning: How Peers and Experience Drive Productivity among Teachers
Workers learn on the job from both repetition and peers. Less understood is how specific types of experience and peer characteristics affect on-the-job learning. This likely differs by context (e.g., occupation, tasks, or roles). Absent such knowledge, it is unclear how to optimally assign workers to tasks and peers. We examine on-the-job learning among elementary school teachers. We… more →
Results from NCME Survey on Revisions to the Standards for Educational and Psychological Testing
The Standards for Educational and Psychological Testing have served as a cornerstone for best practices in assessment. As the field evolves, so must these standards, with regular revisions ensuring they reflect current knowledge and practice. The National Council on Measurement in Education (NCME) conducted a survey to gather feedback from its members regarding potential updates to the 2014… more →
In the Wake of Dobbs: The Effect of State Abortion Bans on Women's College Choices
This paper studies the impact of state reproductive rights laws on women’s human capital decisions after the U.S. Supreme Court eliminated the constitutional right to abortion in Dobbs v. Jackson Women’s Health Organization (2022). Using data from the Common App, the undergraduate college admission application, I implement a difference-in-differences design that compares high-achieving women’s… more →
Inequities and Impacts of Investments in New School Facilities
There is growing evidence that investment in school facilities, and new school construction in particular, can improve K-12 student outcomes, particularly for low-income students. Funding for school infrastructure, however, is inequitably distributed. Moreover, given a lack of national data on school facilities, researchers have focused on specific states or districts, leaving contextual… more →
Pinpointing Persistence in Alternative STEM Pipelines: Evidence from a Novel Coding and Apprenticeship Program
The shortage of STEM workers, particularly in computer science, is compounded by the underrepresentation of women and certain minoritized racial/ethnic groups in these fields. Efforts to address worker shortages and broaden participation include improving traditional STEM education pathways and creating alternative pathways. While persistence has been examined in traditional STEM pathways,… more →
The Prevalence of LGBTQ+ Teachers in the U.S.
Due to limited data, we know little about the prevalence of lesbian, gay, bisexual, transgender, and queer (LGBTQ+) educators. Using the American Community Survey and Census Pulse, we examine the representation of LGBTQ+ individuals in PK-12 teaching. We find that 3.3-3.5 percent of LGBTQ+ individuals are teachers; in contrast, 4.4-4.9 percent of non-LGBTQ+ individuals are teachers. This new… more →
How Not to Fool Ourselves About Heterogeneity of Treatment Effects
Researchers across many fields have called for greater attention to heterogeneity of treatment effects—shifting focus from the average effect to variation in effects between different treatments, studies, or subgroups. True heterogeneity is important, but many reports of heterogeneity have proved to be false, non-replicable, or inflated. In this review, we catalog ways that past… more →
The Achievement Effects of Scaling Early Literacy Reforms
While legislators have implemented many “science of reading” initiatives in the last two decades, the evidence on the impact of these reforms at scale is limited. In this pre-registered, quasi-experimental study, we examine California’s recent initiative to improve early literacy across the state’s lowest-performing schools. The Early Literacy Support Block Grant (ELSBG) provided teacher… more →
School Calendars and Student Obesity
Ample evidence documents rising student obesity in summer months and falling student obesity during the school year. One theory for this pattern is that out-of-school days lack some of the structure and health-promoting behaviors that schools provide. Given this observed seasonal pattern, a natural question is whether there is room for policies that alter the summer vacation to serve as an… more →
The Correlated Proxy Problem: Why Control Variables can Obscure the Contribution of Selection Processes to Group-Level Inequality
Whether selection processes contribute to group-level disparities or merely reflect pre-existing inequalities is an important societal question. In the context of observational data, researchers, concerned about omitted-variable bias, assess selection-contributing inequality via a kitchen-sink approach, comparing selection outcomes of different-group individuals net of various characteristics… more →
Addressing Threats to Validity in Supervised Machine Learning: A Framework and Best Practices for Education Researchers
Given the rapid adoption of machine learning methods by education researchers, and growing acknowledgement of their inherent risks, there is an urgent need for tailored methodological guidance on how to improve and evaluate the validity of inferences drawn from these methods. Drawing upon an integrative literature review and extending a well-known framework for theorizing validity in the… more →
Who’s Matched Up? Access to Same-Race Instructors in Higher Education
Despite consistent evidence on the benefits of same-race instructor matching in K-12 settings and developing work in higher education, research has yet to conceptualize and document the incidence of same-race matching. That is, even if same-race matching produces positive effects, how likely are racially minoritized students to ever experience an instructor of the same race? Using… more →
The (Conference) Room Where it Happens: Explaining Disproportional Representation in Gifted and Talented Education
The current study leveraged comprehensive data from a large school district to better understand the degree to which disproportional representation in gifted education can be explained by mean assessment score differences across racial and socioeconomic groups. The findings indicate that after controlling for nonverbal ability, cognitive ability, math achievement, reading achievement, and… more →
GenAI-101: What Undergraduate Students Need to Know and Actually Know About Generative AI
In November 2022, OpenAI released ChatGPT, a groundbreaking generative AI chatbot backed by large language models (LLMs). Since then, these models have seen various applications in education, from Socratic tutoring and writing assistance to teacher training and essay scoring. Despite their widespread use among high school and college students in the United States, there is limited research on… more →
A Global Regression Discontinuity Design: Theory and Application to Grade Retention Policies
We use a marginal treatment effect (MTE) representation of a fuzzy regression discontinuity setting to propose a novel estimation approach. The estimator can be thought of as extrapolating a traditional fuzzy regression discontinuity estimate or as an observational study that adjusts for endogenous selection into treatment using information at the discontinuity. We show in a frequentist… more →
Do Human Capital Adjustments Protect Youths from Structural Change?
Structural changes to labor demand can have lasting consequences on the employment and earnings of workers in affected industries and geographies. However, individuals coming of age may avoid similar fates if they internalize salient changes to the returns to education and adjust their human capital investments. This paper studies the effects of exposure to structural labor demand shocks… more →
How are Institutions Positioned on the Brink of the Enrollment Cliff?: Evidence from Ohio
Since 2018, institutions of higher education have been aware of the "enrollment cliff" which refers to expected declines in future enrollment. This paper attempts to describe how prepared institutions in Ohio are for this future by looking at trends leading up to the anticipated decline. Using IPEDS data from 2012-2022, we analyze trends in enrollment, revenues, debt and staffing across Ohio's… more →
Effects of High-Impact Tutoring on Student Attendance: Evidence from the OSSE HIT Initiative in the District of Columbia
Student absenteeism, which skyrocketed during and after the COVID-19 pandemic, has negative consequences for student engagement and achievement. This study examines the impact of the High-Impact Tutoring (HIT) Initiative, implemented by the Office of the State Superintendent of Education in Washington DC, on reducing absenteeism. The HIT initiative was designed to mitigate learning loss by… more →
Understanding Variation in Post-College Earnings: Evidence from the U.S. Department of Education’s College Scorecard
Using the detailed college level data from the College Scorecard on students’ post-college earnings from the near universe of four-year colleges, we assess the usefulness of going beyond comparing colleges based only on median earnings and analyze the descriptive relationship between college selectivity and earnings outcomes and how this relationship may differ by student sex and field of… more →
The Differential Sorting of Disadvantaged Students in the Competitive K-12 Market
School choice options offer potential educational gains for disadvantaged students, but do they take advantage of such options? I study the sorting patterns of students with prior child welfare reports (12 percent of incoming kindergartners) across traditional public, magnet, charter, and private schools in a mid-sized city. These students are significantly less likely to opt out of… more →
Funding the Digital Divide? How School District Financing for Educational Technology Changed During the COVID-19 Pandemic
School finance inequities are a key driver of disparities in educational outcomes. Higher per-pupil funding levels allow schools to provide more qualified educators, smaller class sizes, and high-quality physical resources such as modern instructional technology. We study how Washington state school districts generate and allocate funding for instructional technology, and how that changed… more →
Inequality Beyond Standardized Tests: Trends in Extracurricular Activity Reporting in College Applications Across Race and Class
For years, discussions on inequality in college admissions have addressed standardized tests, but less is known about inequality in non-standardized components of applications. We analyzed extracurricular activity descriptions in 6,054,104 applications submitted through the Common Application using natural language processing methods. Overall, White, Asian American, wealthier, and private… more →
Making the Grade: Accounting for Course Selection in High School Transcripts with Item Response Theory
We use student-level administrative data from Delaware for 43,767 high school students across five 12th grade cohorts from 2017 to 2021. We apply Item Response Theory (IRT) to high school transcript data, treating courses as items and grades as ordered responses, to estimate both student transcript strength (𝜃̂) and course difficulty. We prove, via construct and predictive validation and… more →
Empty Plates, Empty Seats: Food Insecurity and Student Absence in the US and Across the Globe
Since the onset of COVID-19 pandemic, there has been a significant rise in student absenteeism in the US and elsewhere. Meanwhile, food insecurity remains a persistent issue across the globe, including in the US. Food insecurity shapes students’ immediate and wider contexts and may worsen school attendance. Applying ecological systems theory, we examined the relationship between food… more →
The Architecture of Expected Wage Gaps: Between- and Within-School Sources of Career Education Inequality
Using administrative data from Delaware and aggregate occupational wage data from the Bureau of Labor Statistics, this paper examines expected wage inequality in Career and Technical Education (CTE) by analyzing how student demographics relate to selection into programs of study (POS) with different expected wages. Through multilevel mixed-effects modeling, we find substantial gaps in expected… more →
What Happens When We Pay Our Teachers More? Evidence from New Jersey Public Schools
This paper examines the impact of increasing teacher salaries on student outcomes by exploiting variation from the “50K The First Day” campaign that established a $50K salary floor for new teachers across New Jersey school districts. Using school-level data from 2003 to 2019, we employ a staggered difference-in-differences (DiD) approach and first show that the campaign raised salaries for all… more →
Transitional Kindergarten: The New Kid on the Early Learning Block
In recent years, several states have expanded a new publicly funded learning option: Transitional Kindergarten (TK). TK programs bridge prekindergarten and kindergarten in their eligibility, requirements, and design. We use Michigan’s TK program as a case study on the fit of this new entrant in the early learning landscape. Michigan’s program is well suited for this purpose because it contains… more →
Variations in Pre-Primary Education Infrastructure Within and Across Administrative Sectors in Rwanda
This study investigates disparities in the quality of pre-primary education settings in Rwanda, focusing on differences across setting types—centre-based, community-based, and home-based—and examining the influence of socioeconomic status (SES) at the sector level. Using a dataset of 4,875 settings across 91 administrative sectors within seven districts, multilevel modeling estimates within-… more →
Experimental Effects of “Opportunity Gap” and “Achievement Gap” Frames
Racial equity in education is often framed around “closing the achievement gap,” but many scholars argue this frame perpetuates deficit mindsets. The “opportunity gap” (OG) frame has been offered as an alternative to focus attention on structural injustices. In a preregistered survey experiment, I estimate the effects of framing racial equity in education around “achievement gaps” (AGs) vs OGs… more →
What happened to adult education in the United States?
In 2000, federally funded public adult education programs provided basic skills training and English language instruction to over 2.6 million students, or about 1.5% of the U.S. adult population. By 2021, enrollment had plummeted to under 900,000, or less than 0.4% of adults. What explains these declines? This policy brief describes the evolution of federally supported U.S. adult education… more →
Measuring Conflict in Local Politics
Many of the most tangible and immediate political conflicts in American's lives occur at the local level. Yet, we lack large-scale evidence on how, why, and where conflict occurs in local governments. In this paper, we present a new dataset of nearly 100,000 videos of school board meetings, and a new measure of local political conflict. We use and validate this new approach using sentiment… more →
Does Early Childhood Education mitigate the birthdate effect? A regression discontinuity analysis of administrative data
This article examines the impact of within-class age differences on educational outcomes, using students' birth months in Madrid's primary schools as a natural experiment. Employing a regression discontinuity design, we analyze third-grade students to investigate these age-related effects. Additionally, we explore whether early childhood education attendance works as a mitigating factor.… more →
Early Childhood Education and Maltreated Children’s Behavioral and Cognitive Outcomes: Quasi-experimental Evidence from the National Survey of Childhood and Adolescent Well-Being II
Prior evidence shows that early childhood education (ECE) can serve as a protective factor that boosts maltreated children’s school readiness outcomes. Yet, less is known about ECE’s relationship to other developmental domains critical to their wellbeing including their adaptive behaviors and cognitive development. Focusing on a broader range of outcomes allows for a more holistic picture of… more →
Reconstructing PhD Admissions Through Organizational Learning
The goal of this study was to assess the outcomes of a grant-funded intervention designed to provide comprehensive training and support for holistic admissions in 26 STEM PhD programs at five California research universities. This pilot intervention combined a flexible, research-based model of holistic review, training for faculty involved with admissions, and informal coaching in how to… more →
Integrating Open Science Principles into Quasi-Experimental Social Science Research
Quasi-experimental methods are a cornerstone of applied social science, providing critical answers to causal questions that inform policy and practice. Although open science principles have influenced experimental research norms across the social sciences, these practices are rarely implemented in quasi-experimental research. In this paper, we explore how open science practices can enhance… more →
The Valence of Teacher Performance Feedback and Its Consequences: Examining a Critical Mechanism of Reformed Teacher Evaluation Systems
Districts nationwide have increased the frequency of teacher evaluations. Yet, we know little about the role of evaluator feedback for teacher improvement. Using unique classroom observation-level data, we use evaluator ratings and teacher self-assessments of teacher performance to rigorously examine (positive and negative) feedback valence from the teacher’s perspective and its consequences.… more →
The Effects of School Building HVAC System Conditions on Student Academic and Behavioral Outcomes
There is growing awareness of the importance of school building environments for student health, well-being, and even educational outcomes. We ask in this study what role school building heating, ventilation, and air conditioning (HVAC) systems play in shaping student attendance, behavior, and learning. In particular, we extract information from school building inspection reports and link them… more →
Entering and Exiting the Foster Care System: Implications for Absenteeism Among Child Welfare Involved Youth
While foster youth miss more school versus their non-foster counterparts, their status as a foster youth is not static, with many of them entering and exiting the foster care system over time. These dynamics of entry and exit can represent particularly crucial transition periods of stability and instability that may differentially influence absenteeism. Yet, there is a dearth of studies that… more →
Let’s Chat: Leveraging Chatbot Outreach for Improved Course Performance
This study reports on the causal effects of using a non-generative artificial intelligence (AI) chatbot to provide course-specific, proactive outreach and support to students in large-enrollment undergraduate courses. Across both an American Government and Microeconomics course, students randomly assigned to receive chatbot messaging were four percentage points more likely to earn an A or B in… more →
A Bibliometric Review of Research on Inequality of Educational Achievement, 1934 to 2023
In this bibliometric review of the research landscape on achievement gaps, we analyze temporal trends and geographic distributions, identify key scholars and publications, and uncover the intellectual structure and thematic focus of achievement gap research. By examining 1,607 achievement gap studies between 1937 and 2023, we find that the scholarship has evolved through four distinct stages:… more →
Measuring the Affective Language of Principals' Evaluation Feedback and Investigating Differences by Principal Gender and Race
Over the past decade, reforms to principal evaluation systems have sought to incorporate formal feedback structures as a lever for principal improvement. However, we know little about the feedback that principals receive. Using statewide administrative data from Tennessee, including principals’ written feedback from evaluators, we use sentiment analysis to uncover the affective language, or… more →
Socioeconomic and Racial Discrepancies in Algebra Access, Teacher, and Learning Experiences: Findings from the American Mathematics Educator Study
In this study, we highlight the differences in classroom-, teacher-, and school-level factors in 8th and 9th grade algebra experiences along socioeconomic and racial/ethnic lines using nationally representative survey data from the American Mathematics Educator Study. Several takeaways emerge from our analysis. First, we show that highest-poverty schools (i.e., schools in the top poverty… more →
On the Margin: Who Receives a Juvenile Referral in School and What Effect Does It Have?
Involvement with the juvenile justice system carries immense consequences both to detained youth and to society more broadly. Extant research on the “school-to-prison pipeline” often focuses on school disciplinary practices such as suspension with less attention on understanding the impact of school referrals to the juvenile justice system on students. Using novel administrative data from… more →
Policy Impacts of Reimbursement Rate Reform: Evidence from the Child Care and Development Fund
The Child Care and Development Fund (CCDF) subsidizes child care costs to help low- income families afford care. Reimbursements for cost-subsidized care are paid to child care providers; however, per-child reimbursements are extremely low compared with market rates and actual cost of care. We examine how the 2014 CCDF reauthorization, which recommended states increase subsidy reimbursement… more →