EdWorkingPapers
Early Childhood Education and Maltreated Children’s Behavioral and Cognitive Outcomes: Quasi-experimental Evidence from the National Survey of Childhood and Adolescent Well-Being II
Prior evidence shows that early childhood education (ECE) can serve as a protective factor that boosts maltreated children’s school readiness outcomes. Yet, less is known about ECE’s relationship to other developmental domains critical to their wellbeing including their adaptive behaviors and cognitive development. Focusing on a broader range of outcomes allows for a more holistic picture of… more →
Does Early Childhood Education mitigate the birthdate effect? A regression discontinuity analysis of administrative data
This article examines the impact of within-class age differences on educational outcomes, using students' birth months in Madrid's primary schools as a natural experiment. Employing a regression discontinuity design, we analyze third-grade students to investigate these age-related effects. Additionally, we explore whether early childhood education attendance works as a mitigating factor.… more →
Reconstructing PhD Admissions Through Organizational Learning
The goal of this study was to assess the outcomes of a grant-funded intervention designed to provide comprehensive training and support for holistic admissions in 26 STEM PhD programs at five California research universities. This pilot intervention combined a flexible, research-based model of holistic review, training for faculty involved with admissions, and informal coaching in how to… more →
Integrating Open Science Principles into Quasi-Experimental Social Science Research
Quasi-experimental methods are a cornerstone of applied social science, providing critical answers to causal questions that inform policy and practice. Although open science principles have influenced experimental research norms across the social sciences, these practices are rarely implemented in quasi-experimental research. In this paper, we explore how open science practices can enhance… more →
The Valence of Teacher Performance Feedback and Its Consequences: Examining a Critical Mechanism of Reformed Teacher Evaluation Systems
Districts nationwide have increased the frequency of teacher evaluations. Yet, we know little about the role of evaluator feedback for teacher improvement. Using unique classroom observation-level data, we use evaluator ratings and teacher self-assessments of teacher performance to rigorously examine (positive and negative) feedback valence from the teacher’s perspective and its consequences.… more →
The Effects of School Building HVAC System Conditions on Student Academic and Behavioral Outcomes
There is growing awareness of the importance of school building environments for student health, well-being, and even educational outcomes. We ask in this study what role school building heating, ventilation, and air conditioning (HVAC) systems play in shaping student attendance, behavior, and learning. In particular, we extract information from school building inspection reports and link them… more →
Entering and Exiting the Foster Care System: Implications for Absenteeism Among Child Welfare Involved Youth
While foster youth miss more school versus their non-foster counterparts, their status as a foster youth is not static, with many of them entering and exiting the foster care system over time. These dynamics of entry and exit can represent particularly crucial transition periods of stability and instability that may differentially influence absenteeism. Yet, there is a dearth of studies that… more →
Let’s Chat: Leveraging Chatbot Outreach for Improved Course Performance
This study reports on the causal effects of using a non-generative artificial intelligence (AI) chatbot to provide course-specific, proactive outreach and support to students in large-enrollment undergraduate courses. Across both an American Government and Microeconomics course, students randomly assigned to receive chatbot messaging were four percentage points more likely to earn an A or B in… more →
The Decline in Teacher Working Conditions During and After the COVID Pandemic
We study changes to teacher working conditions from 2016-17 to 2022-23, covering school years before, during, and after the COVID pandemic. We show working conditions were improving leading into the pandemic but declined when the pandemic arrived. Perhaps more surprisingly, the pandemic was not a low point: teacher working conditions have continued to decline during the post-pandemic period.… more →
More Money for Less Time? Examining the Relative and Heterogenous Financial Returns to Non-Degree Credentials and Degree Programs
There is a large and growing number of non-degree credential offerings between a high school diploma and a bachelor's degree, as well as degree programs beyond a bachelor’s degree. Nevertheless, research on the financial returns to non-degree credentials and degree-granting programs is often narrow and siloed. To fill this gap, we leverage a national sample of individuals across nine MSAs and… more →
Socioeconomic and Racial Discrepancies in Algebra Access, Teacher, and Learning Experiences: Findings from the American Mathematics Educator Study
In this study, we highlight the differences in classroom-, teacher-, and school-level factors in 8th and 9th grade algebra experiences along socioeconomic and racial/ethnic lines using nationally representative survey data from the American Mathematics Educator Study. Several takeaways emerge from our analysis. First, we show that highest-poverty schools (i.e., schools in the top poverty… more →
A Bibliometric Review of Research on Inequality of Educational Achievement, 1934 to 2023
In this bibliometric review of the research landscape on achievement gaps, we analyze temporal trends and geographic distributions, identify key scholars and publications, and uncover the intellectual structure and thematic focus of achievement gap research. By examining 1,607 achievement gap studies between 1937 and 2023, we find that the scholarship has evolved through four distinct stages:… more →
Measuring the Affective Language of Principals' Evaluation Feedback and Investigating Differences by Principal Gender and Race
Over the past decade, reforms to principal evaluation systems have sought to incorporate formal feedback structures as a lever for principal improvement. However, we know little about the feedback that principals receive. Using statewide administrative data from Tennessee, including principals’ written feedback from evaluators, we use sentiment analysis to uncover the affective language, or… more →
On the Margin: Who Receives a Juvenile Referral in School and What Effect Does It Have?
Involvement with the juvenile justice system carries immense consequences both to detained youth and to society more broadly. Extant research on the “school-to-prison pipeline” often focuses on school disciplinary practices such as suspension with less attention on understanding the impact of school referrals to the juvenile justice system on students. Using novel administrative data from… more →
Pathways to the Teaching Profession: Teaching Assistants’ and Substitute Teachers’ Transitions into the Teacher Workforce
Teacher shortages and lack of teacher diversity have led to growing efforts nationally to recruit teaching assistants (TAs) to be classroom teachers. Substitute teachers are not typically considered in these efforts. We pair longitudinal administrative data from a mid-sized urban district with survey follow-up to address how TAs and substitute teachers contribute to filling staffing shortages… more →
Causal Mechanisms of Relative Age Effects on Adolescent Risky Behaviours
We investigate the mechanisms by which a student’s age relative to classmates (i.e., relative age) influences risky health behaviors among European adolescents. Using a two-stage least squares approach, we show that relatively young students are more prone to engage in risky behaviors. These results hold after controlling for absolute age, country fixed effects, and birth season effects. In… more →
Policy Impacts of Reimbursement Rate Reform: Evidence from the Child Care and Development Fund
The Child Care and Development Fund (CCDF) subsidizes child care costs to help low- income families afford care. Reimbursements for cost-subsidized care are paid to child care providers; however, per-child reimbursements are extremely low compared with market rates and actual cost of care. We examine how the 2014 CCDF reauthorization, which recommended states increase subsidy reimbursement… more →
Exploring the Move Away from ‘Zero -Tolerance’ Policies: Evidence from Restorative Justice Practices in Texas and Michigan Schools
This study examines the impact of statewide Restorative Justice (RJ) policy reforms in Michigan and Texas on student disciplinary outcomes and behavior, in light of increasing concerns over the negative effects of zero-tolerance policies. As schools move away from exclusionary discipline practices, this research focuses on three primary questions: (1) Are these policies effectively implemented… more →
Who Scars the Easiest? College Quality and the Effects of Graduating into a Recession
Graduating from college into a recession is associated with earnings losses, but less is known about how these effects vary across colleges. Using restricted-use data from the National Survey of College Graduates, we study how the effects of graduating into worse economic conditions vary over college quality in the context of the Great Recession. We find that earnings losses are concentrated… more →
The relationship between student attendance and achievement, pre- and post-COVID
We examine the relationship between absenteeism and achievement since the onset of COVID-19. Applying first-differences models to North Carolina administrative data, we estimate that each absence was associated with a 0.0032 standard deviation (SD) decline in math achievement in 2022-23. As students averaged 3.3 more absences in 2022-23 than 2018-19, these results imply that returning absence… more →
Unlocking College Potential: The Role of Student Expectations and Non-Cognitive Skills in College Success
Attending college is a significant human capital investment but only about 60% of those who start college will have a completed degree six years later. This makes identifying the skills associated with college success an important policy concern. We surveyed over 1,100 entering college freshmen, majoring in business and engineering at a public university in the US, and combined this… more →
Examining the Relationship Between Randomization Strategies and Control Group Crossover in Higher Education Interventions
This article examines the risk of crossover contamination in individual-level randomization, a common concern in experimental research, in the context of a large-enrollment college course. While individual-level randomization is more efficient for assessing program effectiveness, it also increases the potential for control group students to cross over into the treatment group, thus biasing… more →
Leveling the Playing Field: Default Policy and its Effects on English Learner Reclassification
Reclassification, the process by which English learner (EL) students exit EL classification, often determines ELs’ access to mainstream academic coursework. While existing research finds that many students who demonstrate English proficiency do not reclassify, few studies evaluate policies that effectively reclassify eligible students. This study examines the impact of shifting… more →
Project Lead the Way: Impacts of a High School Applied STEM Program on Early Post-Secondary Outcomes
Project Lead the Way (PLTW) is an applied STEM program first introduced nearly three decades ago to enhance the STEM content of Career Technical Education (CTE). Currently, more than 12,000 US high schools offer the program. Using data from three cohorts of public high school freshmen in Missouri, we investigate the impact of PLTW program offer (ITT), participation impacts on participants (TOT… more →
Automated Feedback Improves Teachers’ Questioning Quality in Brick-and-Mortar Classrooms: Opportunities for Further Enhancement
AI-powered professional learning tools that provide teachers with individualized feedback on their instruction have proven effective at improving instruction and student engagement in virtual learning contexts. Despite the need for consistent, personalized professional learning in K-12 settings, the effectiveness of automated feedback tools in traditional classrooms remains unexplored. We… more →
Effects of Early College on Educational Attainment for All in Massachusetts
Evaluations of Early College, a type of intervention that enables simultaneous enrollment in secondary and post-secondary courses in the United States, consistently find positive effects on educational attainment across racial and socioeconomic groups. Unlike Early College initiatives in other states, Massachusetts launched Early College in Fall 2018, enabling a within-school as well as a… more →
Do Innovative Career Pathways in Massachusetts High Schools Promote Equitable Access to Higher Education?
Two persistent shortcomings of the American labor market are the wage gaps and unequal unemployment rates that exist between racial groups. More specifically, Black and Latinx high school graduates earn less and are more likely to be unemployed than their White counterparts, on average. Likewise, students from low-income families are much more likely to be low-income themselves in adulthood.… more →
The Effects of Virtual Tutoring on Young Readers: Results from a Randomized Controlled Trial
In-person tutoring has been shown to improve academic achievement. Though less well-researched, virtual tutoring has also shown a positive effect on achievement but has only been studied in grade five or above. We present findings from the first randomized controlled trial of virtual tutoring for young children (grades K-2). Students were assigned to 1:1 tutoring, 2:1 tutoring, or a control… more →
Mechanisms of Effect Size Differences Between Researcher Developed and Independently Developed Outcomes: A Meta-Analysis of Item-Level Data
Differences in effect sizes between researcher developed (RD) and independently developed (ID) outcome measures are widely documented but poorly understood in education research. We conduct a meta-analysis using item-level outcome data to test potential mechanisms that explain differences in effects by RD or ID outcome type. Our analysis of 45 effect sizes from 30 studies shows that both… more →
A Scalable Approach to High-Impact Tutoring for Young Readers: Results of a Randomized Controlled Trial
This paper presents the results from a randomized controlled trial of Chapter One, an early elementary reading tutoring program that embeds part-time tutors into the classroom to provide short bursts of 1:1 instruction. Eligible kindergarten students were randomly assigned to receive supplementary tutoring during the 2021-22 school year (N=818). The study occurred in a large Southeastern… more →
IncreasED: How Court Rulings Impact Special Education Identification
Healthcare services outside of school impact the likelihood of receiving a school-based special education classification and services. Using Massachusetts administrative data on public school students, this paper employs difference-in-differences to examine the impacts of expanded Medicaid coverage for mental and behavioral healthcare brought by the Rosie D. lawsuit of… more →
Leveraging Modern Machine Learning to Improve Early Warning Systems and Reduce Chronic Absenteeism in Early Childhood
Chronic absenteeism is a critical issue that has been linked to many adverse student outcomes. The current study focuses on improving a key system already in place in many school districts—early warning systems (EWSs)—in order to decrease chronic absenteeism in students’ earliest schooling years. Using a demographically diverse population of students followed from PreK to third grade in Boston… more →
Teacher-colleague race congruence and mobility: Do colleague demographics impact teacher retention?
Teacher turnover is especially pronounced among teachers of color who play critically important roles in the success of students of color. A growing literature points to racial isolation as one factor that is associated with Black teacher job satisfaction in particular, which in turn could play a role in a teacher’s decision to remain in a school. However, little is known about whether having… more →
Technology Apprenticeships and Labor Market Outcomes: Mixed-Methods Evidence from the LaunchCode Program
We leverage employment and earnings data from a large credit bureau, program data from LaunchCode—a free technology education, and in-depth interviews with applicants and instructors to examine if the LaunchCode program leads to economic benefits, who is most likely to experience these benefits, and how this program produces these benefits. We first conduct an intent-to-treat analysis by… more →
Did Mathematics Achievement Gaps for Students with Disabilities Widen after the Introduction of the Common Core and its Aligned Assessments?
This study addresses the important yet underexplored question of whether the Common Core State Standards in Mathematics, which emphasize critical thinking and problem-solving, as well as the computer-based assessments aligned with the Common Core, have facilitated or hindered learning for students with disabilities. By analyzing administrative data from a large county in California, we track… more →
Staffing Interventions to Support Students Experiencing Homelessness: Evidence from New York City
There is limited empirical evidence about educational interventions for students experiencing homelessness, who experience distinct disadvantages compared to their low-income peers. We explore how two school staffing interventions in New York City shaped attendance outcomes of students experiencing homelessness using administrative records from 2013-2022 and a difference-in-differences… more →
Skills and Earnings: A Multidimensional Perspective on Human Capital
The multitude of tasks performed in the labor market requires skills in many dimensions. Traditionally, human capital has been proxied primarily by educational attainment. However, an expanding body of literature highlights the importance of various skill dimensions for success in the labor market. This paper examines the returns to cognitive, personality, and social skills as three important… more →
The Effects of Losing Pell Grant Eligibility on Student Outcomes
This paper examines the effects of Pell Grant eligibility on student outcomes. Using a regression discontinuity (RD) design and a partial identification approach, the study provides bounds on the treatment effects that account for selection bias arising from the loss of grant eligibility. While initial eligibility is determined by financial need alone, students must achieve Satisfactory… more →
Overcoming the Protestor’s Dilemma: How Teacher Strikes Demobilize Opponents
The “Protestor’s Dilemma” refers to the paradox faced by protestors where their disruptive actions, while necessary to gain public attention and support, could potentially provoke backlash and weaken the very support they seek to gain. How can protestors overcome this dilemma? Teacher strikes point toward a potential path forward. To examine how strikes impact political behavior, we use an… more →
High School Career and Technical Education Finance: Impact of State-Level Policy Changes
States are increasingly adopting changes to K-12 funding systems in order to promote and encourage student engagement in secondary-level career and technical education (CTE). Two of the most prevalent reforms include: a) establishing tiered weights for CTE in school funding formulas based on the connection between a program of study and workforce needs and b) incentive grant programs that… more →
Does Course Structure Increase STEM Employment for Women and Underrepresented Minorities in Technology Training Programs? Evidence from LaunchCode
We examine three coding bootcamps offered by LaunchCode (LC101, Women+, and CodeCamp) to understand if tailored structures within coding bootcamp programs—designed for underrepresented groups in Science, Technology, Engineering, and Math (STEM)—lead to increased program persistence for women, underrepresented minorities, and low-income individuals. We also examine if these tailored structures… more →
Leading Indicators of Long-Term Success in Community Schools: Evidence from New York City
Community schools offer supports such as health and social services, extended school days, and family education, to improve the performance of students whose learning may be disrupted by challenges related to poverty. In 2015, the New York City Community Schools Initiative was implemented in conjunction with the NYC Renewal Schools program to turnaround the city’s lowest performing schools.… more →
Distance to Opportunity: Higher Education Deserts and College Enrollment Choices
We study how geographic access to public postsecondary institutions is associated with students’ college enrollment decisions across race and socioeconomic status. Leveraging rich administrative data, we first document substantial differences in students’ local college options, with White, Hispanic, and rural students having, on average, many fewer nearby options than their Black, Asian,… more →
Teacher Effectiveness in Remote Instruction
The effect of remote learning on student performance has been a frequent topic of research and discussion in the aftermath of the COVID-19 pandemic, yet little is known about the impact of remote instruction on the performance of teachers. This study documents how relative effectiveness of teachers changed when moving from in-person to remote instruction and analyzes the characteristics of… more →
What Impacts Should We Expect from Tutoring at Scale? Exploring Meta-Analytic Generalizability
U.S. public schools are engaged in an unprecedented effort to expand tutoring in the wake of the pandemic. Broad-based support for scaling tutoring emerged, in part, because of the large effects on student achievement found in prior meta-analyses. We conduct an expanded meta-analysis of 282 randomized control trials and explore how estimates change when we better align our sample with a policy… more →
Using Meta-Analytic Data to Examine Fadeout and Persistence of Intervention Impacts on Constrained and Unconstrained Skills
Recent reviews of the educational intervention literature have noted patterns of intervention impact fadeout on cognitive skills, whereby skill trajectories between children in the intervention and control group converge in the years following the end of the intervention. Some early childhood education (ECE) researchers have suggested that skill type, specifically whether a skill is “… more →
Differential Responses to Teacher Evaluation Incentives: Expectancy, Race, Experience, and Task
Teacher evaluation systems and their associated incentives have produced fairly mixed results. Our analyses are motivated by theory and descriptive evidence that accountability systems are highly racialized, and that individuals are less likely to respond to incentives when they have low expectations of success (and vice versa). Using a regression discontinuity design, we find that Black… more →
The Long-Run Impacts of Universal Pre-K with Equilibrium Considerations
Since 1995, publicly funded pre-K with universal eligibility has proliferated across the U.S. Universal pre-K (UPK) operates at great scale and serves children with a wide range of alternative childcare options. Because these programs are relatively young, very little is known about their long-run impacts on children. In this paper, I use a difference-in-differences (DiD) design to estimate… more →
The Role of Comprehensive Student Support Interventions during School Turnaround
The persistence of underperformance in schools within large urban districts remains a significant challenge in the U.S. K-12 education system. Education policymakers have enacted legislation aiming at improving these schools through ``turnaround'' initiatives. However, students attending underperforming schools face multifaceted challenges that extend beyond the classroom. Therefore,… more →
I know my rights? Iowa Senate File 496, book bans, and the First and Fourteenth Amendments
This instrumental case study explores 31 Iowan educators’ and board of education members’ perceptions of the ways the state’s book ban law, Senate File 496 influenced school information systems. Mathisen’s (2015) informational justice conceptual framework guided data analysis. The three key findings of this study were Senate File 496 was imprudently discriminatory in implementation,… more →