EdWorkingPapers
Estimating Treatment Effects with the Explanatory Item Response Model
This simulation study examines the characteristics of the Explanatory Item Response Model (EIRM) when estimating treatment effects when compared to classical test theory (CTT) sum and mean scores and item response theory (IRT)-based theta scores. Results show that the EIRM and IRT theta scores provide generally equivalent bias and false positive rates compared to CTT scores and superior… more →
Separate, but Better? Measuring School Spending Progressivity and its Association with School Segregation
Recent public discussions and legal decisions suggest that school segregation will remain persistent in the United States, but increased transparency may help monitor spending across schools. These circumstances revive an old question: is it possible to achieve an educational system that is separate but equal—or better—in terms of spending? This question motivates further understanding the… more →
Assessing Atlanta’s Placed-Based College Scholarship
We investigate whether and how Achieve Atlanta’s college scholarship and associated services impact college enrollment, persistence, and graduation among Atlanta Public School graduates experiencing low household income. Qualifying for the scholarship of up to $5,000/year does not meaningfully change college enrollment among those near the high school GPA eligibility thresholds. However… more →
The inequity of opt-in educational resources and an intervention to increase equitable access
Billions of dollars are invested in opt-in, educational resources to accelerate students’ learning. Although advertised to support struggling, marginalized students, there is no guarantee these students will opt in. We report results from a school system’s implementation of on-demand tutoring. The take up was low. At baseline, only 19% of students ever accessed the platform, and struggling… more →
Underrepresented Minority Students in College: The Role of Classmates
The role of racial diversity at college campuses has been debated for over a half a century with limited quasi-experimental evidence from classrooms. To fill this void, I estimate the extent that classmate racial compositions affect Hispanic and African-American students at a large and over-subscribed California community college where they are minorities. I find that when minority students… more →
Stay-at-Home Peer Mothers and Gender Norms: Short-run Effects on Educational Outcomes
Increased exposure to gender-role information affects a girl's educational performance. Utilizing the classroom randomization in Chinese middle schools, we find that the increased presence of stay-at-home peer mothers significantly reduces a girl's performance in mathematics. This exposure also cultivates gendered attitudes towards mathematics and STEM professions. The influence of peer… more →
Socio-economic inequalities in opportunities and participation in in-person learning during the COVID-19 pandemic
The disruption of in-person schooling during the Covid-19 pandemic has affected students’ learning, development, and well-being. Students in Latin America and the Caribbean have been hit particularly hard because schools in the region have stayed closed for longer than anywhere else, with long-term expected adverse consequences. Little is known about which factors are associated with the slow… more →
Variation in broadband access among undergraduate populations across the United States
Increasing numbers of students require internet access to pursue their undergraduate degrees, yet broadband access remains inequitable across student populations. Furthermore, surveys that currently show differences in access by student demographics or location typically do so at high levels of aggregation, thereby obscuring important variation between subpopulations within larger groups.… more →
The Stubborn Unresponsiveness of Youth Voter Turnout to Civic Education: Quasi-experimental Evidence from State-Mandated Civics Tests
Youth voter turnout remains stubbornly low and unresponsive to civic education. Rigorous evaluations of the adoption of civic tests for high school graduation by some states on youth voter turnout remain limited. We estimate the impact of a recent, state-mandated civics test policy—the Civics Education Initiative (CEI)—on youth voter turnout by exploiting spatial and temporal variation in the… more →
Opening the Black Box of College Major Choice: Evidence from an Information Intervention
We study the importance of job-related and non-job-related factors in students’ college major choices. Using a staggered intervention that allows us to provide students information about many different aspects of majors and to compare the magnitudes of the effects of each piece of information, we show that major choices depend on a wide set of factors. While students do not change their… more →
When your bootstraps are not enough: How demand and supply interact to generate learning in settings of extreme poverty
How much does family demand matter for child learning in settings of extreme poverty? In rural Gambia, families with high aspirations for their children’s future education and career, measured before children start school, go on to invest substantially more than other families in the early years of their children’s education. Despite this, essentially no children are literate or numerate three… more →
Global Universal Basic Skills: Current Deficits and Implications for World Development
How far is the world away from ensuring that every child obtains the basic skills needed to be internationally competitive? And what would accomplishing this mean for world development? Based on the micro data of international and regional achievement tests, we map achievement onto a common (PISA) scale. We then estimate the share of children not achieving basic skills for 159 countries that… more →
School District Borrowing and Capital Spending: The Effectiveness of State Credit Enhancement
School districts in the United States often borrow on the municipal bond market to pay for capital projects. Districts serving economically disadvantaged communities tend to receive lower credit ratings and pay higher interest rates. To remedy this problem, 24 states have established credit enhancement programs that promise to repay district debt when a district cannot do so, thereby enhancing… more →
Mandating Multiple Measures and Encouraging Student Supports: Evaluating a New Approach to Developmental Education in California’s Community Colleges
AB705 is a landmark higher education policy that has changed approaches to developmental/remedial education in the California Community College system. We study one district that implemented reforms by placing most students in transfer-level math/English courses and encouraging enrollment in support courses based on multiple measures of academic preparation (e.g., GPA). We use regression… more →
Dual Identification? The Effects of EL Status on SPED Placement in an Equity-Focused District
This study examines the effects of English Learner (EL) status on subsequent Special Education (SPED) placement. Through a research-practice partnership, we link student demographic data and initial English proficiency assessment data across seven cohorts of test takers and observe EL and SPED programmatic participation for these students over seven years. Our regression discontinuity (RD)… more →
School Segregation, Teacher Sorting, and the Distribution of Teachers
The distribution of teaching effectiveness across schools is fundamental to understanding how schools can address disparities in educational outcomes. Research and policy have recognized the importance of teaching effectiveness for decades. Five stylized facts predict that teachers should be differentially allocated across schools such that poor, Black and Hispanic students are taught by less… more →
Assessing School District Decision-Making: Evidence from the COVID-19 Pandemic
The COVID-19 pandemic drew new attention to the role of school boards in the U.S. In this paper, we examine school districts' choices of learning modality -- whether and when to offer in-person, virtual, or hybrid instruction -- over the course of the 2020-21 pandemic school year. The analysis takes advantage of granular weekly data on learning mode and COVID-19 cases for Ohio school… more →
Beyond Chronic Absenteeism: The Dynamics and Disparities of Class Absences in Secondary School
Student absenteeism is often conceptualized and quantified in a static, uniform manner, providing an incomplete understanding of this important phenomenon. Applying growth curve models to detailed class-attendance data, we document that secondary school students' unexcused absences grow steadily throughout a school year and over grades, while the growth of excused absences remain essentially… more →
Are Students Time Constrained? Course Load, GPA, and Failing
Given the simultaneous rise in time-to-graduation and college GPA, it may be that students reduce their course load to improve their performance. Yet, evidence to date only shows increased course loads increase GPA. We provide a mathematical model showing many unobservable factors -- beyond student ability -- can generate a positive relationship between course load and GPA unless researchers… more →
A Framework for Motivating Teacher-Student Relationships
Few question the value of teacher-student relationships (TSRs) for educational outcomes. TSRs are positively associated with students’ achievement and engagement, as well as teachers’ well-being. Building and maintaining these crucial classroom relationships, however, is not easy. Drawing on prominent motivation theories in educational psychology, I present the Motivating Teacher-Student… more →
They Only Hate the Term: Explaining Opposition to History Curriculum Policy and Critical Race Theory
The George Floyd Protests of the Summer of 2020 initiated public conversations around the need for antiracist teaching. Yet, over time the discussion evolved into policy debates around the use of Critical Race Theory in civics courses. The rapid transition masked the fact that we know little about Americans' policy preferences. Do Americans support antiracist teaching? What factors best… more →
Mixed-Delivery Public Prekindergarten: Differences in Demographics, Quality, and Children’s Gains in Community-Based versus Public School Programs across Five Large-Scale Systems
Nearly all states with public prekindergarten programs use mixed-delivery systems, with classrooms in both public schools and community-based settings. However, experts have long raised concerns about systematic inequities by setting within these public systems. We used data from five large-scale such systems that have taken steps to improve equity by setting (Boston, New… more →
Does High School Size Affect Rates of Risky Health Behaviors and Poor Mental Health Among Low-Income Teenagers? Evidence from New York City
There is increasing concern about risky behaviors and poor mental health among school-aged youth. A critical factor in youth well-being is school attendance. This study evaluates how school organization and structure affect health outcomes by examining the impacts of a popular urban high school reform -- “small schools” -- on youth risky behaviors and mental health, using data from New York… more →
Can a Commercial Screening Tool Help Select Better Teachers?
Improving teacher selection is an important strategy for strengthening the quality of the teacher workforce. As districts adopt commercial teacher screening tools, evidence is needed to understand these tools’ predictive validity. We examine the relationship between Frontline Education’s TeacherFit instrument and newly hired teachers’ outcomes. We find that a one SD increase on an index of… more →
Increasing High School Students' Preparation and Interest in STEM Fields: Does a Graduation Requirement Make a Difference?
Preparing K-12 students for careers in science, technology, engineering and mathematics (STEM) fields is an ongoing challenge confronting state policymakers. We examine the implementation of a science graduation testing requirement for high-school students in Massachusetts, beginning with the graduating class of 2010. We find that the design of the new requirement was quite complicated,… more →
Making the Grade: The Effect of Teacher Grading Standards on Student Outcomes
Teachers are among the most important inputs in the education production function. One mechanism by which teachers might affect student learning is through the grading standards they set for their classrooms. However, the effects of grading standards on student outcomes are relatively understudied. Using administrative data that links individual students and teachers in 8th and 9th grade… more →
The COVID-19 Impact on Reading Achievement Growth of Grade 3-5 Students in a U.S. Urban School District: Variation across Student Characteristics and Instructional Modalities
The current study aimed to explore the COVID-19 impact on the reading achievement growth of Grade 3-5 students in a large urban school district in the U.S. and whether the impact differed by students’ demographic characteristics and instructional modality. Specifically, using administrative data from the school district, we investigated to what extent students made gains in reading during the… more →
Using Predicted Academic Performance to Identify At-Risk Students in Public Schools
Measures of student disadvantage—or risk—are critical components of equity-focused education policies. However, the risk measures used in contemporary policies have significant limitations, and despite continued advances in data infrastructure and analytic capacity, there has been little innovation in these measures for decades. We develop a new measure of student risk for use in education… more →
Blurred Boundaries: A Day in the Life of a Teacher
The burnout, stress, and work-life balance challenges faced by teachers have received renewed interest due to the myriad disruptions and changes to K-12 schooling brought about by the COVID-19 pandemic. However, even prior to the pandemic relatively little was known about teachers’ time use outside of the classroom, the blurring of work and home boundaries, and how teachers compare to similar… more →
Evolution vs. Creationism in the Classroom: The Lasting Effects of Science Education
Anti-scientific attitudes can impose substantial costs on societies. Can schools be an important agent in mitigating the propagation of such attitudes? This paper investigates the effect of the content of science education on anti-scientific attitudes, knowledge, and choices. The analysis exploits staggered reforms that reduce or expand the coverage of evolution theory in US state science… more →
Putting the K in Rank: How Kindergarten Classrooms Impact Short and Long-Run Outcomes
A student's class rank has important short and long-term effects on important educational outcomes. Despite our growing understanding of these rank effects, we still do not know how early in a child's academic career they begin. To address this, I use data from the Tennessee STAR project, which randomly assigned over 6,323 kindergarteners to classroom environments, to study the impact of… more →
Signals, Information, and the Value of College Names
Colleges can send signals about their quality by adopting new, more alluring names. We study how this affects college choice and labor market performance of college graduates. Administrative data show name-changing colleges enroll higher-aptitude students, with larger effects for alluring-but-misleading name changes and among students with less information. A large resume audit study suggests… more →
Patterns, Determinants, and Consequences of Ability Tracking: Evidence from Texas Public Schools
Schools often track students to classes based on ability. Proponents of tracking argue it is a low-cost tool to improve learning since instruction is more effective when students are more homogeneous, while opponents argue it exacerbates initial differences in opportunities without strong evidence of efficacy. In fact, little is known about the pervasiveness or determinants of ability tracking… more →
At What Cost?: Is Technical Education Worth the Investment?
Career and technical education (CTE) has existed in the United States for over a century, and only in recent years have there been opportunities to assess the causal impact of participating in these programs while in high school. To date, no work has assessed whether the relative costs of these programs meet or exceed the benefits as described in recent evaluations. In this paper, we use… more →
The politics of progressivity: Court-ordered reforms, racial difference, and school finance fairness
This paper contributes to our understanding of American education politics by exploring when and why states redistribute K-12 education dollars to poorer schools. It does so by examining three explanations for intra-state changes in progressivity: court-ordered finance reforms, political trends, and demographic changes. Using state-level data from 1995-2016, we find mixed evidence that… more →
You Are Who You Eat With: Academic Peer Effects from School Lunch Lines
Using daily lunch transaction data from NYC public schools, I determine which students frequently stand next to one another in the lunch line. I use this `revealed' friendship network to estimate academic peer effects in elementary school classrooms, improving on previous work by defining not only where social connections exist, but the relative strength of these connections. Equally weighting… more →
Impacts of Publicly Funded Health Insurance for Adults on Children’s Academic Achievement
Publicly funded adult health insurance through the Affordable Care Act (ACA) has had positive effects on low-income adults. We examine whether the ACA’s Medicaid expansions influenced child development and family functioning in low-income households. We use a difference-in-differences framework that exploits cross-state policy variation and focus on children in low-income families from a… more →
Does Reclassification Change How English Learners Feel about School and Themselves? Evidence from a Regression Discontinuity Design
Reclassification can be an important juncture in the academic experience of English Learners (ELs). Literature has explored the potential for reclassification to influence academic outcomes like achievement, yet its impact on social-emotional learning (SEL) skills, which are as malleable and important to long-term success, remains unclear. Using a regression discontinuity design, we examine… more →
Cream Skimming and Pushout of Students Participating in a Statewide Private School Voucher Program
A pervasive issue in the school choice literature is whether schools of choice cream-skim students by enrolling high-achieving, less challenging, or less costly students. Similarly, schools of choice may “pushout” low-achieving, more challenging, or more costly students. Using longitudinal student-level data from Indiana, we created multiple measures to examine whether there is evidence… more →
Computationally Identifying Funneling and Focusing Questions in Classroom Discourse
Responsive teaching is a highly effective strategy that promotes student learning. In math classrooms, teachers might funnel students towards a normative answer or focus students to reflect on their own thinking, deepening their understanding of math concepts. When teachers focus, they treat students’ contributions as resources for collective sensemaking, and thereby significantly improve… more →
Not the Great Equalizer? Local Economic Mobility and Inequality Effects for the Establishment of U.S. Universities
We exploit historical natural experiments to test whether universities increase economic mobility and equality. We use "runner-up’" counties that were strongly considered to become university sites but were not selected for as-good-as-random reasons as counterfactuals for university counties. University establishment causes greater intergenerational income mobility but also increases cross-… more →
Beyond Teachers: Estimating Individual Guidance Counselors’ Effects on Educational Attainment
Counselors are a common school resource for students navigating complicated and con- sequential education choices. I estimate counselors’ causal effects using quasi-random assignment policies in Massachusetts. Counselors vary substantially in their effectiveness at increasing high school graduation and college attendance, selectivity, and persistence. Counselor effects on educational… more →
Is there a national teacher shortage? A systematic examination of reports of teacher shortages in the United States
Teachers are critical to student learning, but adequately staffing classrooms has been challenging in many parts of the country. Even though teacher shortages are being reported across the U.S., teacher shortages are poorly understood. Determining and addressing teacher shortages is difficult due to the lack of data. Neither the federal government nor the majority of states have provided… more →
The Distribution of School Resources in The United States: A Comparative Analysis Across Levels of Governance, Student Sub-groups, And Educational Resources
Levels of governance (the nation, states, and districts), student subgroups (racially and ethnically minoritized and economically disadvantaged students), and types of resources (expenditures, class sizes, and teacher quality) intersect to represent a complex and comprehensive picture of K-12 educational resource inequality. Drawing on multiple sources of the most recently available data, we… more →
Heterogeneity in Labor Market Returns to Master’s Degrees: Evidence from Ohio
Graduate education is among the fastest growing segments of the U.S. higher educational system. This paper provides up-to-date causal evidence on labor market returns to Master’s degrees and examines heterogeneity in the returns by field area, student demographics and initial labor market conditions. We use rich administrative data from Ohio and an individual fixed effects model that compares… more →
Who Benefits From Attending Effective Schools?
We estimate the longer-run effects of attending an effective high school (one that improves a combination of test scores, survey measures of socio-emotional development, and behaviors in 9th grade) for students who are more versus less educationally advantaged (i.e., likely to attain more years of education based on 8th-grade characteristics). All students benefit from attending effective… more →
What Happened to the K-12 Education Labor Market During COVID? The Acute Need for Better Data Systems
The COVID-19 pandemic upended the U.S. education system and the economy in ways that dramatically affected the jobs of K-12 educators. However, data limitations have led to considerable uncertainty and conflicting reports about the nature of staffing challenges in schools. We draw on education employment data from the Bureau of Labor Statistics (BLS) and State Education Agencies (SEA) to… more →
Replicating and Extending Effects of “Achievement Gap” Discourse
Scholars argue the “racial achievement gap” frame perpetuates deficit mindsets. Previously, we found teachers gave lower priority to racial equity when disparities were framed as “achievement gaps” versus “inequality in educational outcomes.” In this brief, we analyze data from two survey experiments using a teacher sample and an MTurk sample. We find: (1) the effect of “achievement gap” (AG)… more →
Do STEM Students Vote?
For decades, pundits, politicians, college administrators, and academics have lamented the dismal rates of civic engagement among students who enroll in courses and eventually major in science, technology, engineering, and mathematics (i.e., STEM) fields. However, the research supporting this conclusion has faced distinct challenges in terms of data quality. Does STEM actually decrease the… more →
On the Threshold: Impacts of Barely Passing High-School Exit Exams on Post-Secondary Enrollment and Completion
Many states use high-school exit examinations to assess students’ career and college readiness in core subjects. We find meaningful consequences of barely passing the mathematics examination in Massachusetts, as opposed to just failing it. However, these impacts operate at different educational attainment margins for low-income and higher-income students. As in previous work, we find that… more →