EdWorkingPapers
Heterogeneity of item-treatment interactions masks complexity and generalizability in randomized controlled trials
Researchers use test outcomes to evaluate the effectiveness of education interventions across numerous randomized controlled trials (RCTs). Aggregate test data—for example, simple measures like the sum of correct responses—are compared across treatment and control groups to determine whether an intervention has had a positive impact on student achievement. We show that item-level data and… more →
What we teach about race and gender: Representation in images and text of children’s books
Books shape how children learn about society and norms, in part through representation of different characters. We introduce new artificial intelligence methods for systematically converting images into data and apply them, along with text analysis methods, to measure the representation of skin color, race, gender, and age in award-winning children’s books widely read in homes, classrooms, and… more →
Structured Choice: School Segregation at the Intersection of Policy and Preferences
This paper conceptualizes segregation as a phenomenon that emerges from the intersection of public policy and individual decision-making. Contemporary scholarship on complex decision-making describes a two-step process—1) Editing and 2) Selection— and has emphasized the individual decision-maker’s agency in both steps. We build on this work by exploring, both theoretically and empirically, how… more →
How and Why Do Estimates of US Education Finance Progressivity Change with School-Level Finance Data?
How progressive is school spending when spending is measured at the school-level, instead of the district-level? We use the first dataset on school-level spending across schools throughout the United States to ask to what extent progressivity patterns previously examined across districts are amplified, nullified, or reversed, upon disaggregation to schools. We find that progressivity is… more →
Democracy and the Politicization of Education
Challenging the conventional wisdom that the spread of democracy was a leading driver of the expansion of primary schooling, recent studies show that democratization in fact did not lead to an average increase in primary school enrollment rates. One reason for this null effect is that there was already considerable provision of primary education before democratization. Still, it is possible… more →
Funding Shocks and University Behavior: A synthetic control evaluation of Colorado's College Opportunity Fund
Discussion of the rising price of higher education and associated student debt in America has been a key feature of political discourse in recent memory, with renewed interest sparked by the announcement of the student loan forgiveness plan. Federal student debt has increased by 756% since 1995, and total student debt tripled from 2007 to 2022. Concurrently, state support for public… more →
Out of Sight, Out of Mind? The Gap between Students’ Test Performance and Teachers’ Estimations in India and Bangladesh
This is one of the first studies of the mismatch between students’ test scores and teachers’ estimations of those scores in low- and middle-income countries. Prior studies in high-income countries have found strong correlations between these metrics. We leverage data on actual and estimated scores in math and language from India and Bangladesh and find that teachers misestimate their students… more →
Ahead of the Game? Course-Taking Patterns under a Math Pathways Reform
A controversial, equity-focused mathematics reform in the San Francisco Unified School District (SFUSD) featured delaying Algebra I until ninth grade for all students. This descriptive study examines student-level longitudinal data on mathematics course-taking across successive cohorts of SFUSD students who spanned the reform’s implementation. We observe large changes in ninth and tenth grades… more →
In School, Engaged, On-track? The Effect of the Pandemic on Student Attendance, Course Grades, and Grade Retention in North Carolina
The effects of the COVID-19 pandemic on students’ experiences in school were widespread. Early research show reductions in test scores across grade levels and student groups. This study extends research evidence to additional student outcomes – absences, course grades, and grad retention – and to examine how pandemic effects are distributed across students. Using a combination of descriptive… more →
Could shifting the margin between community college and university enrollment expand and diversify university degree production in STEM fields?
We examine the potential to expand and diversify the production of university STEM degrees by shifting the margin of initial enrollment between community colleges and 4-year universities. Our analysis is based on statewide administrative microdata from the Missouri Department of Higher Education and Workforce Development covering enrollees in all public postsecondary institutions statewide. We… more →
Forging a path to college persistence: An experimental evaluation of the Detroit Promise Path program
Detroit students who obtain a college degree overcome many obstacles to do so. This paper reports the results of a randomized evaluation of a program meant to provide support to low-income community college students. The Detroit Promise Path (DPP) program was designed to complement an existing College Promise scholarship, providing students with coaching, summer engagement, and financial… more →
Where are the Gifted English Learners and Students with Disabilities?
Prior research has documented substantial inequity across, racial, ethnic, and socioeconomic lines within the population of students identified as gifted. Less attention has paid to the equity of gifted identification for student learning English or those with disabilities and what effect state policies toward gifted education might have on these rates. This paper attempted to fill that void… more →
Online tutoring works: Experimental evidence from a program with vulnerable children
We provide evidence from a randomized controlled trial on the effectiveness of a novel, 100-percent online math tutoring program, targeted at secondary school students from highly disadvantaged neighborhoods. The intensive, eight-week-long program was delivered by qualified math teachers in groups of two students during after-school hours. The intervention significantly increased standardized… more →
How Context Shapes the Relationship between School Autonomy and Test-Scores: An Explanatory Analysis using PISA 2015
School autonomy has been and continues to be one of the most important education reform strategies around the world despite ambiguity about its theoretical and empirical effects on students learning. We use international data from PISA to test three country-level factors that might account for inconsistent results in prior literature: (1) the selective implementation of school autonomy based… more →
Comparing the School Readiness Skills of Public Pre-Kindergarten and Head Start Participants: A Systematic Review and Meta-Analysis
A systematic review of the literature (1965–2022) and meta-analysis were undertaken to compare the school readiness skills of children participating in public pre-kindergarten (pre-K) or Head Start. Seven quasi-experimental studies met the inclusion criteria for the meta-analysis and 38 effect sizes were analyzed. Results indicated no reliable meta-analytic effect in relation to children’s… more →
Uncovering the sources of gender wage gaps among teachers: The role of compensation off the salary schedule
Public teacher compensation is largely determined by fixed salary schedules that were designed to avoid payment inequalities based on demographic characteristics. Yet, recent research shows female teachers earn less than their male peers after controlling for experience, education, and school characteristics. Building on this literature, this paper examines teacher salaries to provide… more →
Does School Funding Matter In a Pandemic? COVID-19 Instructional Models and School Funding Adequacy
The factors that influenced school districts’ decisions to offer virtual, hybrid, or in-person instruction during the 2020-21 school year—the first full school year after the emergence of the COVID-19 pandemic—have been the focus of a large body of research in recent years. Some of this research examines the influence of school spending, among other factors; however, these studies do not… more →
The Advanced Placement Program and Educational Inequality
The Advanced Placement (AP) program is nearly ubiquitous in American high schools and is often touted as a way to close racial and socioeconomic gaps in educational outcomes. Using administrative data from Michigan, I exploit variation within high schools across time in AP course offerings to identify the causal effect of AP course availability on college choice and degree attainment. I find… more →
Student Demand For Relative Performance Feedback: Evidence from a Field Experiment
We administer a survey to study students' preferences for relative performance feedback in an introductory economics class. To do so, we elicit students' willingness to pay for/avoid learning their rank on a midterm exam. Our results show that 10% of students are willing to pay to avoid learning their rank. We also find that female students are willing to pay $1 more than male students. We… more →
Educational Consequences of a Sibling’s Disability: Evidence from type 1 diabetes
While there is a growing literature on family health spillovers, questions remain about how sibling disability status impacts educational outcomes. As disability is not randomly assigned this is an empirical challenge. In this paper we use Danish administrative data and variation in the onset of type 1 diabetes to compare education outcomes of focal children with a disabled sibling to outcomes… more →
Revisiting Ethnic Differences in In-Person Learning During 2021-2022
During the 2020-21 school year, Black and Hispanic students were less likely to attend school in-person than white students. Prior research indicated multiple factors helped explain this gap. In this study, we revise these observed racial gaps in in-person learning to examine whether the relationship between these gaps and explanatory factors observed earlier in the pandemic changed during the… more →
Measuring grading standards at high schools: a methodology and an example
At schools with low grading standards, students receive higher school-awarded grades across multiple courses than students with the same skills receive at schools with high grading standards. A new methodology shows grading standards vary substantially, certainly enough to affect post-secondary opportunities, across high schools in Alberta. Schools with low grading standards are more likely to… more →
Understanding High Schools’ Effects on Longer-Term Outcomes
Improving education and labor market outcomes for low-income students is critical for advancing socioeconomic mobility in the United States. We explore how Massachusetts public high schools affect the longer-term outcomes of low-income students, using detailed longitudinal data. We estimate school value-added impacts on four-year college graduation and earnings. Similar students who attend… more →
Going the Distance: Exploring Variation in Access to High-Quality PreK by Geographic Proximity, Race/Ethnicity, Family Income, and Home Language
This study leverages six years of public prekindergarten (PreK) and kindergarten data (N = 22,469) from the Boston Public Schools (BPS) to examine enrollment in BPS PreK from 2012–2017 for students from different racial/ethnic, socioeconomic, and linguistic groups. The largest differences in enrollment emerged with respect to race and ethnicity—and for enrollment in programs in higher-quality… more →
The Impact of Armed Conflict on College Students
Given the spike of homicides in conflict zones of Colombia after the 2016 peace agreement, I study the causal effect of violence on college test scores. Using a difference-in-difference design with heterogeneous effects, I show how this increase in violence had a negative effect on college learning, and how this negative effect is mediated by factors such as poverty, college major, degree type… more →
Beginning Teachers & Strategies for Asset-Based Pedagogy
Our study examines roughly 2,000 novice teachers’ responses about how they account for students’ cultural, ethnic/racial, and linguistic diversity. We qualitatively analyze robust open-ended survey responses to explore teachers’ reported strategies for how they integrate asset-based pedagogy (ABP). We identify codes related to these strategies and then investigate them by participant… more →
Are Four-Year Public Colleges Engines for Economic Mobility? Evidence from Statewide Admissions Thresholds
Four-year public colleges may play an important role in supporting intergenerational mobility by providing an accessible path to a bachelor’s degree and increasing students' earnings. Leveraging a midsize state’s GPA- and SAT-based admissions thresholds for the four-year public sector, I use a regression discontinuity design to estimate the effect of four-year public college admissions on… more →
Troublemakers? The Role of Frequent Teacher Referrers in Expanding Racial Disciplinary Disproportionalities
Teachers’ sense-making of student behavior determines whether students get in trouble and are formally disciplined. Status categories, such as race, can influence perceptions of student culpability, but the degree to which teachers’ initial identification of student misbehavior exacerbates racial disproportionality in discipline receipt is unknown.This study provides the first systematic… more →
Lottery-Based Evaluations of Early Education Programs: Opportunities and Challenges for Building the Next Generation of Evidence
Lottery-based identification strategies offer potential for generating the next generation of evidence on U.S. early education programs. Our collaborative network of five research teams applying this design in early education and methods experts has identified six challenges that need to be carefully considered in this next context: 1) available baseline covariates may not be very rich;… more →
What We Can Learn About Latin American Educational Systems from International Tests: A Brief Foray
The Revista del Centro de Estudios Educativos, numero 3, 1971 included an early Carnoy article on the economics of education: “Un enfoque de sistemas para evaluar la educación, ilustrado con datos de Puerto Rico.” The article used a unique data set that had student test scores, students’ family background characteristics, and information about teachers and other school inputs for about one-… more →
Returns to School Spending in Rural America: Evidence from Wisconsin’s Sparsity Aid Program
We study the effects of increased school spending in rural American school districts by leveraging the introduction and subsequent expansion of Wisconsin’s Sparsity Aid Program. We find that the program, which provides additional state funding to small and isolated school districts, increased spending in eligible districts by 2% annually and that districts primarily allocated funds to areas… more →
Discipline Reform, School Culture, and Student Achievement
Does relaxing strict school discipline improve student achievement, or lead to classroom disorder? We study a 2012 reform in New York City public middle schools that eliminated suspensions for non-violent, disorderly behavior, replacing them with less disruptive interventions. Using a difference-in-differences framework, we exploit the sharp timing of the reform and natural variation in its… more →
Capturing the Educational and Economic Impacts of School Closures in Poland
The effect of school closures in the spring of 2020 on the math, science, and reading skills of secondary school students in Poland is estimated. The COVID-19-induced school closures lasted 26 weeks in Poland, one of Europe's longest periods of shutdown. Comparison of the learning outcomes with pre- and post-COVID-19 samples shows that the learning loss was equal to more than one year of study… more →
The Cobb Teaching & Learning System: An Initiative that Advances Educator Collaboration, Transformative Technology, and Real-Time Data Utilization
The Cobb Teaching & Learning System (CTLS) is a digital learning initiative developed for and by the Cobb County School District (CCSD) in Georgia. CTLS became a crucial initiative used by the district to maintain student academic progress during the COVID-19 pandemic. Adopting a mixed-methods approach, this case study seeks to analyze CTLS’s design and implementation, focusing on digital… more →
Driving, Dropouts, and Drive-Throughs: Mobility Restrictions and Teen Human Capital
We provide evidence that graduated driver licensing (GDL) laws, originally intended to improve public safety, impact human capital accumulation. Many teens use automobiles to access both school and employment. Because school and work decisions are interrelated, the effects of automobile-specific mobility restrictions are ambiguous. Using a novel triple-difference research design, we find that… more →
Affirmative Action and Its Race-Neutral Alternatives
As affirmative action loses political feasibility, many universities have implemented race-neutral alternatives like top percent policies and holistic review to increase enrollment among disadvantaged students. I study these policies’ application, admission, and enrollment effects using University of California administrative data. UC’s affirmative action and top percent policies increased… more →
How Do Homeowners, Teachers, and Students Respond to a Four-Day School Week?
Faced with decreasing funds and increasing costs, a growing number of school districts across the United States are switching to four-day school weeks (4DSWs). Although previously used only by rural districts, the policy has begun to gain traction in metropolitan districts. We examine homeowner, teacher, and student outcomes in one of the first metropolitan school districts to adopt the 4DSW.… more →
Measuring returns to experience using supervisor ratings of observed performance: The case of classroom teachers
We study the returns to experience in teaching, estimated using supervisor ratings from classroom observations. We describe the assumptions required to interpret changes in observation ratings over time as the causal effect of experience on performance. We compare two difference-in-differences strategies: the two-way fixed effects estimator common in the literature, and an alternative which… more →
The contribution of short-cycle programs to student outcomes: Evidence from Colombia
Short-cycle higher education programs (SCPs), lasting two or three years, capture about a quarter of higher education enrollment in the world and can play a key role enhancing workforce skills. In this paper, we estimate the program-level contribution of SCPs to student academic and labor market outcomes, and study how and why these contributions vary across programs. We exploit unique… more →
The Dynamic Market for Short-Cycle Higher Education Programs
Short-cycle higher education programs (SCPs) form skilled human capital in two or three years and could be key to upskilling and reskilling the workforce, provided their supply responds fast and nimbly to local labor market needs. We study determinants of SCP entry and exit in Colombia for markets defined by geographic location and field of study. We show greater dynamism in the market for… more →
Labor Market Effects of Short-Cycle Higher Education Programs: Lessons from Colombia
This paper estimates the heterogeneous labor market effects of enrolling in higher education short-cycle (SC) programs. Expanding access to these programs might affect the behavior of some students (compliers) in two margins: the expansion margin (students who would not have enrolled in higher education otherwise) and the diversion margin (students who would have enrolled in bachelor’s… more →
Cows Don't Give Milk: An Effort Model of College Graduation
This paper estimates a dynamic model of college enrollment, progression, and graduation. A central feature of the model is student effort, which has a direct effect on class completion and an indirect effect mitigating risks on class completion and college persistence. The estimated model matches rich administrative data for a representative cohort of college students in Colombia. Estimates… more →
What makes a program good? Evidence from short-cycle higher education programs in five developing countries
Short-cycle higher education programs (SCPs) can play a central role in skill development and higher education expansion, yet their quality varies greatly within and among countries. In this paper we explore the relationship between programs’ practices and inputs (quality determinants) and student academic and labor market outcomes. We design and conduct a novel survey to collect program-level… more →
The Limited Impact of Free College Policies
Despite the growing popularity of free college proposals, countries with higher college subsidies tend to have higher enrollment rates but not higher graduation rates. To capture this evidence and evaluate potential free college policies, we rely on a dynamic model of college enrollment, performance, and graduation estimated using rich student-level data from Colombia. In the model, student… more →
Integrated Student Support and Student Achievement: A Replication Study
Growing up in poverty presents numerous nonacademic barriers that impede academic progress for economically disadvantaged students (Duncan and Murnane, 2016). Because schools alone have limited capacity to address the systemic nature of economic inequalities that directly affects student outcomes, policymakers and researchers in recent years have increased calls for the use of comprehensive,… more →
When Girls Outperform Boys: The Gender Gap in High School Math Grades
Across an array of educational outcomes, evidence suggests that girls outperform boys on average. For example, in Chicago, ninth-grade girls earn math GPAs that are 0.29 points higher than boys on average. This paper examines explanations for this gap, such as girl-boy differences in academic preparation, behaviors and habits, and experiences in math classes. After accounting for these factors… more →
Who refers whom? The effects of teacher characteristics on disciplinary office referrals
Teachers affect a wide range of students’ educational and social outcomes, but how they contribute to students’ involvement in school discipline is less understood. We estimate the impact of teacher demographics and other observed qualifications on students’ likelihood of receiving a disciplinary referral. Using data that track all disciplinary referrals and the identity of both the referred… more →
U.S. School Finance: Resources and Outcomes
The impact of school resources on student outcomes was first raised in the 1960s and has been controversial since then. This issue enters into the decision making on school finance in both legislatures and the courts. The historical research found little consistent or systematic relationship of spending and achievement, but this research frequently suffers from significant concerns about the… more →
“All Students Matter:” The Place of Race in Discourse on Student Debt in a Federal Higher Education Policymaking Process
We used Critical Discourse Analysis to examine the racial discourse within recent attempts to reauthorize the Higher Education Act. Specifically, we interrogated congressional markup hearings to understand how members frame student debt and the racialized dynamics embedded within. Our findings highlight three types of discourse: “All Students” Matter, Paternalistic, Race-Evasive, and Explicit… more →
Screening with Multitasking: Theory and Empirical Evidence from Teacher Tenure Reform
What happens when employers screen their employees but only observe a subset of output? We specify a model with heterogeneous employees and show that their response to the screening affects output in both the probationary period and the post-probationary period. The post-probationary impact is due to their heterogeneous responses affecting which individuals are retained and hence the screening… more →