EdWorkingPapers
Assessing School District Decision-Making: Evidence from the COVID-19 Pandemic
The COVID-19 pandemic drew new attention to the role of school boards in the U.S. In this paper, we examine school districts' choices of learning modality -- whether and when to offer in-person, virtual, or hybrid instruction -- over the course of the 2020-21 pandemic school year. The analysis takes advantage of granular weekly data on learning mode and COVID-19 cases for Ohio school… more →
Beyond Chronic Absenteeism: The Dynamics and Disparities of Class Absences in Secondary School
Student absenteeism is often conceptualized and quantified in a static, uniform manner, providing an incomplete understanding of this important phenomenon. Applying growth curve models to detailed class-attendance data, we document that secondary school students' unexcused absences grow steadily throughout a school year and over grades, while the growth of excused absences remain essentially… more →
Are Students Time Constrained? Course Load, GPA, and Failing
Given the simultaneous rise in time-to-graduation and college GPA, it may be that students reduce their course load to improve their performance. Yet, evidence to date only shows increased course loads increase GPA. We provide a mathematical model showing many unobservable factors -- beyond student ability -- can generate a positive relationship between course load and GPA unless researchers… more →
A Framework for Motivating Teacher-Student Relationships
Few question the value of teacher-student relationships (TSRs) for educational outcomes. TSRs are positively associated with students’ achievement and engagement, as well as teachers’ well-being. Building and maintaining these crucial classroom relationships, however, is not easy. Drawing on prominent motivation theories in educational psychology, I present the Motivating Teacher-Student… more →
Mixed-Delivery Public Prekindergarten: Differences in Demographics, Quality, and Children’s Gains in Community-Based versus Public School Programs across Five Large-Scale Systems
Nearly all states with public prekindergarten programs use mixed-delivery systems, with classrooms in both public schools and community-based settings. However, experts have long raised concerns about systematic inequities by setting within these public systems. We used data from five large-scale such systems that have taken steps to improve equity by setting (Boston, New… more →
They Only Hate the Term: Explaining Opposition to History Curriculum Policy and Critical Race Theory
The George Floyd Protests of the Summer of 2020 initiated public conversations around the need for antiracist teaching. Yet, over time the discussion evolved into policy debates around the use of Critical Race Theory in civics courses. The rapid transition masked the fact that we know little about Americans' policy preferences. Do Americans support antiracist teaching? What factors best… more →
Does High School Size Affect Rates of Risky Health Behaviors and Poor Mental Health Among Low-Income Teenagers? Evidence from New York City
There is increasing concern about risky behaviors and poor mental health among school-aged youth. A critical factor in youth well-being is school attendance. This study evaluates how school organization and structure affect health outcomes by examining the impacts of a popular urban high school reform -- “small schools” -- on youth risky behaviors and mental health, using data from New York… more →
Can a Commercial Screening Tool Help Select Better Teachers?
Improving teacher selection is an important strategy for strengthening the quality of the teacher workforce. As districts adopt commercial teacher screening tools, evidence is needed to understand these tools’ predictive validity. We examine the relationship between Frontline Education’s TeacherFit instrument and newly hired teachers’ outcomes. We find that a one SD increase on an index of… more →
Making the Grade: The Effect of Teacher Grading Standards on Student Outcomes
Teachers are among the most important inputs in the education production function. One mechanism by which teachers might affect student learning is through the grading standards they set for their classrooms. However, the effects of grading standards on student outcomes are relatively understudied. Using administrative data that links individual students and teachers in 8th and 9th grade… more →
Increasing High School Students' Preparation and Interest in STEM Fields: Does a Graduation Requirement Make a Difference?
Preparing K-12 students for careers in science, technology, engineering and mathematics (STEM) fields is an ongoing challenge confronting state policymakers. We examine the implementation of a science graduation testing requirement for high-school students in Massachusetts, beginning with the graduating class of 2010. We find that the design of the new requirement was quite complicated,… more →
The COVID-19 Impact on Reading Achievement Growth of Grade 3-5 Students in a U.S. Urban School District: Variation across Student Characteristics and Instructional Modalities
The current study aimed to explore the COVID-19 impact on the reading achievement growth of Grade 3-5 students in a large urban school district in the U.S. and whether the impact differed by students’ demographic characteristics and instructional modality. Specifically, using administrative data from the school district, we investigated to what extent students made gains in reading during the… more →
Using Predicted Academic Performance to Identify At-Risk Students in Public Schools
Measures of student disadvantage—or risk—are critical components of equity-focused education policies. However, the risk measures used in contemporary policies have significant limitations, and despite continued advances in data infrastructure and analytic capacity, there has been little innovation in these measures for decades. We develop a new measure of student risk for use in education… more →
Blurred Boundaries: A Day in the Life of a Teacher
The burnout, stress, and work-life balance challenges faced by teachers have received renewed interest due to the myriad disruptions and changes to K-12 schooling brought about by the COVID-19 pandemic. However, even prior to the pandemic relatively little was known about teachers’ time use outside of the classroom, the blurring of work and home boundaries, and how teachers compare to similar… more →
Evolution vs. Creationism in the Classroom: The Lasting Effects of Science Education
Anti-scientific attitudes can impose substantial costs on societies. Can schools be an important agent in mitigating the propagation of such attitudes? This paper investigates the effect of the content of science education on anti-scientific attitudes, knowledge, and choices. The analysis exploits staggered reforms that reduce or expand the coverage of evolution theory in US state science… more →
Putting the K in Rank: How Kindergarten Classrooms Impact Short and Long-Run Outcomes
A student's class rank has important short and long-term effects on important educational outcomes. Despite our growing understanding of these rank effects, we still do not know how early in a child's academic career they begin. To address this, I use data from the Tennessee STAR project, which randomly assigned over 6,323 kindergarteners to classroom environments, to study the impact of… more →
Signals, Information, and the Value of College Names
Colleges can send signals about their quality by adopting new, more alluring names. We study how this affects college choice and labor market performance of college graduates. Administrative data show name-changing colleges enroll higher-aptitude students, with larger effects for alluring-but-misleading name changes and among students with less information. A large resume audit study suggests… more →
The politics of progressivity: Court-ordered reforms, racial difference, and school finance fairness
This paper contributes to our understanding of American education politics by exploring when and why states redistribute K-12 education dollars to poorer schools. It does so by examining three explanations for intra-state changes in progressivity: court-ordered finance reforms, political trends, and demographic changes. Using state-level data from 1995-2016, we find mixed evidence that… more →
Patterns, Determinants, and Consequences of Ability Tracking: Evidence from Texas Public Schools
Schools often track students to classes based on ability. Proponents of tracking argue it is a low-cost tool to improve learning since instruction is more effective when students are more homogeneous, while opponents argue it exacerbates initial differences in opportunities without strong evidence of efficacy. In fact, little is known about the pervasiveness or determinants of ability tracking… more →
At What Cost?: Is Technical Education Worth the Investment?
Career and technical education (CTE) has existed in the United States for over a century, and only in recent years have there been opportunities to assess the causal impact of participating in these programs while in high school. To date, no work has assessed whether the relative costs of these programs meet or exceed the benefits as described in recent evaluations. In this paper, we use… more →
You Are Who You Eat With: Academic Peer Effects from School Lunch Lines
Using daily lunch transaction data from NYC public schools, I determine which students frequently stand next to one another in the lunch line. I use this `revealed' friendship network to estimate academic peer effects in elementary school classrooms, improving on previous work by defining not only where social connections exist, but the relative strength of these connections. Equally weighting… more →
Impacts of Publicly Funded Health Insurance for Adults on Children’s Academic Achievement
Publicly funded adult health insurance through the Affordable Care Act (ACA) has had positive effects on low-income adults. We examine whether the ACA’s Medicaid expansions influenced child development and family functioning in low-income households. We use a difference-in-differences framework that exploits cross-state policy variation and focus on children in low-income families from a… more →
Does Reclassification Change How English Learners Feel about School and Themselves? Evidence from a Regression Discontinuity Design
Reclassification can be an important juncture in the academic experience of English Learners (ELs). Literature has explored the potential for reclassification to influence academic outcomes like achievement, yet its impact on social-emotional learning (SEL) skills, which are as malleable and important to long-term success, remains unclear. Using a regression discontinuity design, we examine… more →
Cream Skimming and Pushout of Students Participating in a Statewide Private School Voucher Program
A pervasive issue in the school choice literature is whether schools of choice cream-skim students by enrolling high-achieving, less challenging, or less costly students. Similarly, schools of choice may “pushout” low-achieving, more challenging, or more costly students. Using longitudinal student-level data from Indiana, we created multiple measures to examine whether there is evidence… more →
Not the Great Equalizer? Local Economic Mobility and Inequality Effects for the Establishment of U.S. Universities
We exploit historical natural experiments to test whether universities increase economic mobility and equality. We use "runner-up’" counties that were strongly considered to become university sites but were not selected for as-good-as-random reasons as counterfactuals for university counties. University establishment causes greater intergenerational income mobility but also increases cross-… more →
Computationally Identifying Funneling and Focusing Questions in Classroom Discourse
Responsive teaching is a highly effective strategy that promotes student learning. In math classrooms, teachers might funnel students towards a normative answer or focus students to reflect on their own thinking, deepening their understanding of math concepts. When teachers focus, they treat students’ contributions as resources for collective sensemaking, and thereby significantly improve… more →
Is there a national teacher shortage? A systematic examination of reports of teacher shortages in the United States
Teachers are critical to student learning, but adequately staffing classrooms has been challenging in many parts of the country. Even though teacher shortages are being reported across the U.S., teacher shortages are poorly understood. Determining and addressing teacher shortages is difficult due to the lack of data. Neither the federal government nor the majority of states have provided… more →
Beyond Teachers: Estimating Individual Guidance Counselors’ Effects on Educational Attainment
Counselors are a common school resource for students navigating complicated and con- sequential education choices. I estimate counselors’ causal effects using quasi-random assignment policies in Massachusetts. Counselors vary substantially in their effectiveness at increasing high school graduation and college attendance, selectivity, and persistence. Counselor effects on educational… more →
The Distribution of School Resources in The United States: A Comparative Analysis Across Levels of Governance, Student Sub-groups, And Educational Resources
Levels of governance (the nation, states, and districts), student subgroups (racially and ethnically minoritized and economically disadvantaged students), and types of resources (expenditures, class sizes, and teacher quality) intersect to represent a complex and comprehensive picture of K-12 educational resource inequality. Drawing on multiple sources of the most recently available data, we… more →
What Happened to the K-12 Education Labor Market During COVID? The Acute Need for Better Data Systems
The COVID-19 pandemic upended the U.S. education system and the economy in ways that dramatically affected the jobs of K-12 educators. However, data limitations have led to considerable uncertainty and conflicting reports about the nature of staffing challenges in schools. We draw on education employment data from the Bureau of Labor Statistics (BLS) and State Education Agencies (SEA) to… more →
Heterogeneity in Labor Market Returns to Master’s Degrees: Evidence from Ohio
Graduate education is among the fastest growing segments of the U.S. higher educational system. This paper provides up-to-date causal evidence on labor market returns to Master’s degrees and examines heterogeneity in the returns by field area, student demographics and initial labor market conditions. We use rich administrative data from Ohio and an individual fixed effects model that compares… more →
Who Benefits From Attending Effective Schools?
We estimate the longer-run effects of attending an effective high school (one that improves a combination of test scores, survey measures of socio-emotional development, and behaviors in 9th grade) for students who are more versus less educationally advantaged (i.e., likely to attain more years of education based on 8th-grade characteristics). All students benefit from attending effective… more →
Replicating and Extending Effects of “Achievement Gap” Discourse
Scholars argue the “racial achievement gap” frame perpetuates deficit mindsets. Previously, we found teachers gave lower priority to racial equity when disparities were framed as “achievement gaps” versus “inequality in educational outcomes.” In this brief, we analyze data from two survey experiments using a teacher sample and an MTurk sample. We find: (1) the effect of “achievement gap” (AG)… more →
Do STEM Students Vote?
For decades, pundits, politicians, college administrators, and academics have lamented the dismal rates of civic engagement among students who enroll in courses and eventually major in science, technology, engineering, and mathematics (i.e., STEM) fields. However, the research supporting this conclusion has faced distinct challenges in terms of data quality. Does STEM actually decrease the… more →
On the Threshold: Impacts of Barely Passing High-School Exit Exams on Post-Secondary Enrollment and Completion
Many states use high-school exit examinations to assess students’ career and college readiness in core subjects. We find meaningful consequences of barely passing the mathematics examination in Massachusetts, as opposed to just failing it. However, these impacts operate at different educational attainment margins for low-income and higher-income students. As in previous work, we find that… more →
The Other Half of the Story: Does Excluding the Early Grades from School Ratings Matter?
Because high-stakes testing for school accountability does not begin until third grade, accountability ratings for elementary schools do not directly measure students’ academic progress in grades K through 2. While it is possible that children’s test scores in grades 3 and above are highly correlated with children’s outcomes in the untested grades, research provides reasons to believe that… more →
Heterogeneous Effects of Violence on Student Achievement
In this paper, I study the causal relationship between violence and human capital accumulation. Due to a power vacuum left in conflict zones of Colombia after the 2016 peace agreement, large spikes in violence were reported in the municipalities of the country dominated by the rebel group FARC. I compare student test scores in municipalities that experienced the increase in violence to the… more →
The Enduring Struggle of Standards-Based Reform: Lessons from a National Research Center on College and Career-Ready Standards
Standards have been at the heart of state and federal efforts to improve education for several decades. Most recently, standards-based reforms have evolved with a focus on more ambitious "college- and career-ready" (CCR) standards. This paper synthesizes the results of a seven-year national research center focused on the implementation and effects of CCR standards. The paper draws on… more →
U.S. Middle School Mathematics Instruction, 2016
In recent decades, U.S. education leaders have advocated for more intellectually ambitious mathematics instruction in classrooms. Evidence about whether more ambitious mathematics instruction has filtered into contemporary classrooms, however, is largely anecdotal. To address this issue, we analyzed 93 lessons recorded by a national random sample of middle school mathematics teachers. We find… more →
School reopening decisions during the COVID-19 pandemic: What can we learn from the emerging literature?
After near-universal school closures in the United States at the start of the pandemic, lawmakers and educational leaders made plans for when and how to reopen schools for the 2020-21 school year. Educational researchers quickly assessed how a range of public health, political, and demographic factors were associated with school reopening decisions and parent preferences for in-person and… more →
Modeling Item-Level Heterogeneous Treatment Effects with the Explanatory Item Response Model: Leveraging Online Formative Assessments to Pinpoint the Impact of Educational Interventions
Analyses that reveal how treatment effects vary allow researchers, practitioners, and policymakers to better understand the efficacy of educational interventions. In practice, however, standard statistical methods for addressing Heterogeneous Treatment Effects (HTE) fail to address the HTE that may exist within outcome measures. In this study, we present a novel application of the Explanatory… more →
Keep Me In, Coach: The Short- and Long-Term Effects of Targeted Academic Coaching
To boost college graduation rates, policymakers often advocate for academic supports such as coaching or mentoring. Proactive and intensive coaching interventions are effective, but are costly and difficult to scale. We evaluate a relatively lower-cost group coaching program targeted at first-year college students placed on academic probation. Participants attend a workshop where coaches aim… more →
Incentivizing Equity? The Effects of Performance-Based Funding on Race-Based Gaps in College Completion
Performance-based funding models for higher education, which tie state support for institutions to performance on student outcomes, have proliferated in recent decades. Some states have designed these policies to also address educational attainment gaps by including bonus payments for traditionally low-performing groups. Using a Synthetic Control Method research design, we examine the impact… more →
Strictly Speaking: Examining Teacher Use of Punishment and Student Outcomes
While a growing body of literature has documented the negative impacts of exclusionary punishments, such as suspensions, on academic outcomes, less is known about how teachers vary in disciplinary behaviors and the attendant impacts on students. We use administrative data from North Carolina elementary schools to examine the extent to which teachers vary in their use of referrals and investigate… more →
Linkage Between Fields of Concentration in High School Career-Technical Education and College Majors
In this descriptive study, we use longitudinal student-level administrative records from 4 cohorts of high school graduates in Kentucky to examine the extent to which students persist and attain post-secondary credentials in the CTE fields of concentration they choose in high school. To our knowledge, this is the first paper to use student-level administrative data to examine how different… more →
Student Selection into an Income Share Agreement
Financing college expenses through an income share agreement (ISA) is an arrangement where the student agrees to pay a fixed percentage of future earned income for a designated period of time in exchange for college funding. Using administrative and survey data for all eligible applicants to a university ISA program, I estimate the adverse selection into the ISA and provide preliminary… more →
Out of the Gate, but Not Necessarily Teaching: A Descriptive Portrait of Early-Career Earnings for Those Who Are Credentialed to Teach
Prior work on teacher candidates in Washington State has shown that about two thirds of individuals who trained to become teachers between 2005 and 2015 and received a teaching credential did not enter the state’s public teaching workforce immediately after graduation, while about one third never entered a public teaching job in the state at all. In this analysis, we link data on these teacher… more →
How Much Do Early Teachers Matter?
We present new estimates of the importance of teachers in early grades for later grade outcomes, but unlike the existing literature that examines teacher “fade-out,” we directly compare the contribution of early-grade teachers to later year outcomes against the contributions of later year teachers to the same later year outcomes. Where the prior literature finds that much of the contribution… more →
Hard-to-Staff Centers: Exploring Center-Level Variation in the Persistence of Child Care Teacher Turnover
High rates of teacher turnover in child care settings have negative implications for young children’s learning experiences and for efforts to improve child care quality. Prior research has explored the prevalence and predictors of turnover at the individual teacher level, but less is known about turnover at the center level – specifically, how turnover varies across child care centers or… more →
Correspondence Measures for Assessing Replication Success
Given recent evidence challenging the replicability of results in the social and behavioral sciences, critical questions have been raised about appropriate measures for determining replication success in comparing effect estimates across studies. At issue is the fact that conclusions about replication success often depend on the measure used for evaluating correspondence in… more →
The Impact of Summer Programs on Student Mathematics Achievement: A Meta-Analysis
We present results from a meta-analysis of 37 contemporary experimental and quasi-experimental studies of summer programs in mathematics for children in Grades pre-K-12, examining what resources and characteristics predict stronger student achievement. Children who participated in summer programs that included mathematics activities experienced significantly better mathematics achievement… more →