EdWorkingPapers
Can Computer-Assisted Instruction Help Schools to Close the Achievement Gap: Evaluation of a District-Wide Reading Intervention
A concerning number of middle and high school students lack fundamental reading skills in the United States. One common way schools address this issue is by supporting those students with computer-assisted instruction. This study evaluates the causal effect of one such computer-assisted instruction intervention on English Language Arts achievement for middle and high school students in a large… more →
The Prevalence and Policy Implications of Between-School Heterogeneity in Learning Outcomes: Evidence from Six Public Education Systems
While learning outcomes in low- and middle-income countries are generally at low levels, the degree to which students and schools more broadly within education systems lag behind grade-level proficiency can vary significantly. A substantial portion of existing literature advocates for aligning curricula closer to the proficiency level of the “median child” within each system. Yet, amidst… more →
Sustained Effects of Small-Group Instruction in Mathematics
Recent research suggests that using additional teachers to provide small-group instruction or tutoring substantially improves student learning. However, treatment effects on test scores can fade over time, and less is known about the lasting effects of such interventions. We leverage data from a Norwegian large-scale field experiment to examine the effects of small-group instruction in… more →
The Effect of Early Childhood Programs on Third-Grade Test Scores: Evidence from Transitional Kindergarten in Michigan
Transitional Kindergarten (TK) is a relatively recent entrant into the U.S. early education landscape, combining features of public pre-K and regular kindergarten. We provide the first estimates of the impact of Michigan’s TK program on 3rd grade test scores. Using an augmented regression discontinuity design, we find that TK improves 3rd grade math scores by 0.29 standard deviations relative… more →
Local Political Party Voting Context Moderates Public School Principals’ Levels of Racial/Ethnic Discrimination
Correspondence audits document causal evidence of racial/ethnic discrimination in many contexts. However, few studies have examined whether local political party voting context influences individuals to engage in “stakeholder-centric” discrimination on behalf of or in response to expectations of others. We examine heterogeneity in racial/ethnic discrimination by the county-level Republican… more →
Next-Generation Teacher Evaluation in Rural Missouri: Main and Moderated Effects on Student Achievement and Effects-to-Expenditure Ratios
We extend teacher evaluation research by estimating a reformed evaluation system's plausibly causal average effects on rural student achievement, identifying the settings where evaluation works, and incorporating evaluation expenditures. That the literature omits these contributions is concerning as research implies it hinders evidence-based teacher evaluation policymaking for rural districts… more →
College Course Shutouts
What happens when college students are not able to enroll in the courses they want? We use a natural experiment at Purdue University in which first-year students are conditionally randomly assigned to oversubscribed courses. Compared to students who are assigned a requested course, those who are shut out are 40% less likely to ever take the oversubscribed course and 30% less likely to ever… more →
Do Financial Incentives Increase the Impact of National-Scale Educational Programs? Experimental Evidence from a National College Advising Initiative
Recent work highlights the challenge of scaling evidence-based educational programs. We report on a randomized controlled trial of a financial incentive program designed to increase the efficacy of a national remote college advising initiative for high-achieving students. We find substantial positive effects of the program on student engagement with college advisors; applications to well-… more →
Attendance Practices in High-Absenteeism Districts
Educational policymakers, leaders, and researchers are paying increasing attention to student attendance and chronic absenteeism, especially in the wake of the COVID-19 pandemic. Though researchers have documented the consequences and causes of absenteeism, there is limited empirical evidence about what schools and districts are actually doing to improve attendance. This study presents… more →
Public Good Perceptions and Polarization: Evidence from Higher Education Appropriations
To understand the causes and consequences of polarized demand for government expenditure, we conduct three field experiments in the context of public higher education. The first two experiments study polarization in taxpayer demand. We provide information to shape beliefs about social returns on investment. Our treatments narrow the political partisan gap in ideal policies---a reduction in… more →
Does Corequisite Remediation Work for Everyone? An Exploration of Heterogeneous Effects and Mechanisms
The landscape of developmental education has experienced significant shifts over the last decade nationwide, as more than 20 states and higher education systems have transitioned from the traditional prerequisite model to corequisite remediation. Drawing on administrative data from Tennessee community colleges from 2010 to 2020, this study examined the heterogeneous effects of corequisite… more →
Does One Plus One Always Equal Two? Examining Complementarities in Educational Interventions
Public policies targeting individuals based on need often impose disproportionate burden on communities that lack the resources to implement these policies effectively. In an elementary school setting, I examine whether community-level interventions focusing on similar needs and providing resources to build capacity in these communities could improve outcomes by improving the effectiveness of… more →
Why Black Teachers Matter
Black teachers are critical resources for our children and schools. Pairing experimental data with rich measures of teacher mindsets and practices and varied student outcomes, I document that: (1) Black teachers in upper-elementary grades have large effects on the self-efficacy and classroom engagement of their Black students (0.7 and 0.8 SD) but not for non-Black students, potentially driven… more →
Multiply by 37 (or Divide by 0.023): A Surprisingly Accurate Rule of Thumb for Converting Effect Sizes from Standard Deviations to Percentile Points
Educational researchers often report effect sizes in standard deviation units (SD), but SD effects are hard to interpret. Effects are easier to interpret in percentile points, but converting SDs to percentile points involves a calculation that is not transparent to educational stakeholders. We show that if the outcome variable is normally distributed, we can approximate the percentile-point… more →
Constrained Agency and the Architecture of Educational Choice: Evidence from New York City
Many school districts consider family preferences in allocating students to schools. In theory, this approach provides traditionally disadvantaged families greater access to high-quality schools by weakening the link between residential location and school assignment. We leverage data on the school choices made by over 233,000 New York City families to examine the extent to which the city’s… more →
Challenges and opportunity: An examination of barriers to postsecondary academic success
Community colleges are a critical component of the U.S. higher education system, providing access to students from traditionally underserved communities. However, enduring challenges to completion stemming from educational, economic, and social inequities persist. Building on prior work that examines barriers to student success and their relationship to student outcomes, this descriptive study… more →
Exploring Multidimensional Approaches to Learning During Early Childhood in Ghana
Children's approaches to learning (AtL) are widely recognized as a critical predictor of educational outcomes, especially in early childhood. Nevertheless, there remains a dearth of understanding regarding the dimensionality of AtL, the reciprocal dynamics between AtL and learning outcomes, and how AtL operates in non-Western contexts. This paper aims to extend the existing AtL literature by… more →
Scaling High-impact tutoring: School Level Perspectives on Implementation Challenges and Strategies
High-impact tutoring has emerged as a primary school district investment for addressing learning loss that occurred during the COVID-19 pandemic. While existing research shows that high-impact tutoring is effective for accelerating student learning, this study examined the school-level facilitators and barriers to scaling high-impact tutoring. Situated in an urban traditional school district… more →
Of DEI and Denials: A Critical Discourse Analysis of Texas’ 88th Legislative Session
Emerging literature on anti-CRT, anti-DEI efforts in education suggest that these attacks represent a rearticulation of racial ideologies which seek to contain racial progress. Although crafting anti-CRT and anti-DEI policies is primarily conducted through discourse, few studies explore the specific discursive mechanisms used to justify these efforts as racially neutral. Using critical… more →
How the Engagement of High-Profile Partisan Officials Affects Education Politics, Public Opinion, and Polarization
What happens to public opinion when prominent partisan officials intervene in education policy debates? We analyzed the results of 18 survey experiments conducted between 2009 and 2021 with nationally representative samples of U.S. adults. Each experiment explored the effect of an endorsement of a specific education policy by a high-profile partisan official on the public’s attitudes toward… more →
Do Students Respond to Sticker-Price Reductions?: Evidence from the North Carolina Promise
The North Carolina Promise is a state-level policy that reduced the cost of tuition for all students who attended one of three campuses in the University of North Carolina System starting in fall of 2018. We use IPEDS data and a synthetic control approach to examine how this tuition reduction affected enrollment and persistence at these campuses. We find that NC Promise did not increase… more →
ESSER-ting Preferences: Examining School District Preferences for Using Federal Pandemic Relief Fundings
We analyzed the proposed spending data for the American Recovery Plan’s Elementary and Secondary Emergency Relief III (ESSER III) fund from the spring of 2021 of nearly 3,000 traditional public-school districts in the United States to (1) identify trends in the strategies adopted and (2) to test whether spending strategies were observably heterogeneous across district characteristics. We found… more →
The Notorious SBG: Administrators’ Perceptions of Standards-Based Grading Practices
This mixed-methods study synthesizes Standards-Based Grading (SBG) literature, analyzes 249 Arkansas administrators' survey responses using OLS regressions, and identifies themes through in-vivo coding of qualitative feedback. Results show more SBG support among liberal, elementary-level administrators in larger, economically diverse districts. Qualitative insights highlight structural… more →
High School Preparation and Post-Secondary Educational Attainment: An Analysis of Racial/Ethnic and Gender Differences for Missouri Public High School Students
This paper investigates patterns of racial/ethnic and gender gaps in post-secondary degree attainment trajectories by the levels of students’ pre-college academic preparation. We follow four cohorts of Missouri public high school freshmen for five years beyond on-time graduation among White, Black, and Hispanic male and female students. A composite measure of pre-college academic preparation… more →
Which Colleges Increase Voting Rates?
We study how colleges shape their students' voting habits by linking millions of SAT takers to their college-enrollment and voting histories. To begin, we show that the fraction of students from a particular college who vote varies systematically by the college's attributes (e.g. increasing with selectivity) but also that seemingly similar colleges can have markedly different voting rates.… more →
Taking Teacher Evaluation to Scale: The Effect of State Reforms on Achievement and Attainment
Federal incentives and requirements under the Obama administration spurred states to adopt major reforms to their teacher evaluation systems. We examine the effects of these reforms on student achievement and attainment at a national scale by exploiting their staggered implementation across states. We find precisely estimated null effects, on average, that rule out impacts as small as 0.017… more →
Time in School: A Conceptual Framework, Synthesis of the Causal Research, and Empirical Exploration
We examine the fundamental and complex role that time plays in the learning process. We begin by developing a conceptual framework to elucidate the multiple obstacles schools face in converting total time in school into active learning time. We then synthesize the causal research and document a clear positive effect of additional time on student achievement typically of small to medium… more →
GED® College Readiness Benchmarks and Post-Secondary Success
In 2016, the GED® introduced college readiness benchmarks designed to identify testers who are academically prepared for credit-bearing college coursework. The benchmarks are promoted as awarding college credits or exempting “college-ready” GED® graduates from remedial coursework. I show descriptive evidence that those identified as college-ready by these benchmarks enroll and persist in… more →
Under the Weather? The Effects of Temperature on Student Test Performance
As students are exposed to extreme temperatures with ever-increasing frequency, it is important to understand how such exposure affects student learning. In this paper we draw upon detailed student achievement data, combined with high-resolution weather records, to paint a clear portrait of the effect of temperature on student learning across a six-year period for students in Tulsa, Oklahoma.… more →
How Measurement Affects Causal Inference: Attenuation Bias is (Usually) More Important Than Scoring Weights
When analyzing treatment effects on test scores, researchers face many choices and competing guidance for scoring tests and modeling results. This study examines the impact of scoring choices through simulation and an empirical application. Results show that estimates from multiple methods applied to the same data will vary because two-step models using sum or factor scores provide attenuated… more →
How Did the COVID-19 Pandemic Influence School Board Elections?
Media reports suggest that parent frustration with COVID school policies and the growing politicization of education have increased community engagement with local public schools. However, there is no evidence to date on whether these factors have translated into greater engagement at the ballot box. This paper uses a novel data set to explore how school board elections changed following the… more →
An Investigation of Head Start Preschool Children’s Executive Function, Early Literacy, and Numeracy Learning in the Midst of the COVID-19 Pandemic
The COVID-19 pandemic’s impact on preschool children’s school readiness skills remains understudied. This research investigates Head Start preschool children’s early numeracy, literacy, and executive function outcomes during a pandemic-affected school year. Study children (N = 336 assessed at fall baseline; N = 237-250 assessed in spring depending on outcome; fall baseline sample: mean age =… more →
Racialized Reactivity: How Metrics-Formation Contributed to a Racialized Organizational Order in Medical Education
A common point of contention across education policy debates is whether and how facially race-neutral metrics of quality produce or maintain racialized inequities. Medical education is a useful site for interrogating this relationship, as many scholars point to the 1910, Carnegie-funded Flexner Report—which proposed standardized quality metrics—as a main driver of the closure of five of the… more →
Disentangling Person-Dependent and Item-Dependent Causal Effects: Applications of Item Response Theory to the Estimation of Treatment Effect Heterogeneity
Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment. This study demonstrates that identical patterns of… more →
Competitive Effects of Charter Schools
Using a rich dataset that merges student-level school records with birth records, and leveraging three alternative identification strategies, we explore how increase in access to charter schools in twelve districts in Florida affects students remaining in traditional public schools (TPS). We consistently find that competition stemming from the opening of new charter schools improves reading—… more →
Racial/Ethnic Discrimination and Heterogeneity Across Schools in the U.S. Public Education System: A Correspondence Audit of Principals
Although numerous studies document different forms of discrimination in the U.S. public education system, very few provide plausibly causal estimates. Thus, it is unclear to what extent public school principals discriminate against racial and ethnic minorities. Moreover, no studies test for heterogeneity in racial/ethnic discrimination by individual-level resource needs and school-level… more →
Subtraction by Addition: Do Private Scholarship Awards Lead to Financial Aid Displacement?
Award displacement occurs when one type of financial aid award directly contributes to the change in the quantity of another award. We explore whether postsecondary institutions displaced awards in response to the Pittsburgh Promise scholarship by capitalizing on the doubling of the maximum Promise amount in 2012. We use de-identified student-level data on each Promise recipient’s actual cost… more →
Computer Science for All? The Impact of High School Computer Science Courses on College Majors and Earnings
This study provides the first causal analysis of the impact of expanding Computer Science (CS) education in U.S. K-12 schools on students’ choice of college major and early career outcomes. Utilizing rich longitudinal data from Maryland, we exploit variation from the staggered rollout of CS course offerings across high schools. Our findings suggest that taking a CS course increases students’… more →
The Benefits of Math Corequisite Support for Academic Outcomes for Students in Texas
An increasing body of robust evidence concludes that corequisite remediation in math and English is a cost-effective alternative to traditional developmental education, offering improved immediate course progression and potentially better persistence and completion. This is the first study to disentangle the impacts of the two main elements of the corequisite model: accelerated college course… more →
What matters and for whom? Exploring characteristics of teacher residency programs and their relationship to participant perceptions
This concurrent mixed methods study descriptively explores teacher residency programs (TRPs) across the nation. We examine program and participant survey data from the National Center for Teacher Residencies (NCTR) to identify important TRP structures for resident support. Latent class analysis of program-level data reveals three types of TRPs (locally-funded low tuition, multi-funded… more →
COVID-19, Online Learning, and Absenteeism in Detroit
How much school students attend is a powerful indicator of their well-being and a strong predictor of their future success in school. Prior research has documented the myriad in-school and out-of-school factors that contribute to high levels of student absenteeism, many emerging from the root causes of poverty and disengagement. The shift to online learning during the COVID-19 pandemic likely… more →
The Ups and Downs of Classroom Quality Over the Preschool Year and Relations to Children’s School Readiness
Despite considerable evidence on the links between average classroom quality and children’s learning, the importance of variation in quality is not well understood. We examined whether three measures of variation in observed classroom quality over the school year – overall variation in quality, teacher-specific trends in quality, and instability in quality – were associated with children’s… more →
What Works and For Whom? Effectiveness and Efficiency of School Capital Investments Across the U.S.
This paper identifies which investments in school facilities help students and are valued by homeowners. Using novel data on school district bonds, test scores, and house prices for 29 U.S. states and a research design that exploits close elections with staggered timing, we show that increased school capital spending raises test scores and house prices on average. However, impacts differ… more →
COVID-19, School Closures, and Student Learning Outcomes: New Global Evidence from PISA
The COVID-19 pandemic resulted in significant disruption in schooling worldwide. This paper uses global test score data to estimate learning losses. It models the effect of school closures on achievement by predicting the deviation of the most recent results from a linear trend using data from all rounds of the Programme for International Student Assessment. Scores declined by an average of 14… more →
Understanding Heterogeneous Patterns of Family Engagement with Educational Technology to Inform School-Family Communication in Linguistically Diverse Communities
We leverage log data from an educational app and two-way text message records from over 3,500 students during the summers of 2019 and 2020, along with in-depth interviews in Spanish and English, to identify patterns of family engagement with educational technology. Based on the type and timing of technology use, we identify several distinct profiles of engagement, which we group into two… more →
The Effects of Teacher-Student Demographic Matching on Social-Emotional Learning
A growing body of research shows that students benefit when they demographically match their teachers. However, little is known about how matching affects social-emotional development. We use student-fixed effects to exploit changes over time in the proportion of teachers within a school grade who demographically match a student to estimate matching's effect on social-emotional measures, test… more →
Clinical teaching learning trajectory: Exploring field supervisor written feedback on clinical teacher pedagogy
Field supervisors are central to clinical teaching, but little is known about how their feedback informs preservice teachers (PSTs) development. This sequential mixed methods study examines over 3,000 supervisor observation evaluations. We qualitatively code supervisor written feedback, which indicates 2 broad pedagogical categories and 9 separate skills. We then quantize these feedback codes… more →
Grow Your Own: An Umbrella Term for Very Different Localized Teacher Pipeline Programs
“Grow Your Own” (GYO) programs have recently emerged as a promising approach to expand teacher supply, address localized teacher shortages, and diversify the profession. However, little is known about the scale and design of GYO programs, which recruit and support individuals from the local community to become teachers. We conduct a quantitative content analysis to describe 94 GYO initiatives… more →
Making Moves: The Role of Demotion in School Leadership
This study examines the experience of demotion from a principalship to an assistant principalship and how race and gender can differentially impact career trajectories. Using administrative state dataset of 10,946 observations at the principal level, we used probit regression to determine the overall probability of demotion and Kaplan Meier survival analysis to estimate the differences in… more →
Misclassification of Career and Technical Education Concentrators: Analysis and Policy Recommendations
Career and Technical Education (CTE) prepares students for life beyond high school by providing practical labor skills, workforce credentials, and early post-secondary credits. States are required to report the number of CTE concentrators to receive federal Perkins funding, but systems of identifying students as concentrators vary among states. We analyzed two distinct concentrator… more →