EdWorkingPapers
Evolution vs. Creationism in the Classroom: The Lasting Effects of Science Education
Anti-scientific attitudes can impose substantial costs on societies. Can schools be an important agent in mitigating the propagation of such attitudes? This paper investigates the effect of the content of science education on anti-scientific attitudes, knowledge, and choices. The analysis exploits staggered reforms that reduce or expand the coverage of evolution theory in US state science… more →
Signals, Information, and the Value of College Names
Colleges can send signals about their quality by adopting new, more alluring names. We study how this affects college choice and labor market performance of college graduates. Administrative data show name-changing colleges enroll higher-aptitude students, with larger effects for alluring-but-misleading name changes and among students with less information. A large resume audit study suggests… more →
Patterns, Determinants, and Consequences of Ability Tracking: Evidence from Texas Public Schools
Schools often track students to classes based on ability. Proponents of tracking argue it is a low-cost tool to improve learning since instruction is more effective when students are more homogeneous, while opponents argue it exacerbates initial differences in opportunities without strong evidence of efficacy. In fact, little is known about the pervasiveness or determinants of ability tracking… more →
At What Cost?: Is Technical Education Worth the Investment?
Career and technical education (CTE) has existed in the United States for over a century, and only in recent years have there been opportunities to assess the causal impact of participating in these programs while in high school. To date, no work has assessed whether the relative costs of these programs meet or exceed the benefits as described in recent evaluations. In this paper, we use… more →
The politics of progressivity: Court-ordered reforms, racial difference, and school finance fairness
This paper contributes to our understanding of American education politics by exploring when and why states redistribute K-12 education dollars to poorer schools. It does so by examining three explanations for intra-state changes in progressivity: court-ordered finance reforms, political trends, and demographic changes. Using state-level data from 1995-2016, we find mixed evidence that… more →
You Are Who You Eat With: Academic Peer Effects from School Lunch Lines
Using daily lunch transaction data from NYC public schools, I determine which students frequently stand next to one another in the lunch line. I use this `revealed' friendship network to estimate academic peer effects in elementary school classrooms, improving on previous work by defining not only where social connections exist, but the relative strength of these connections. Equally weighting… more →
Impacts of Publicly Funded Health Insurance for Adults on Children’s Academic Achievement
Publicly funded adult health insurance through the Affordable Care Act (ACA) has had positive effects on low-income adults. We examine whether the ACA’s Medicaid expansions influenced child development and family functioning in low-income households. We use a difference-in-differences framework that exploits cross-state policy variation and focus on children in low-income families from a… more →
Does Reclassification Change How English Learners Feel about School and Themselves? Evidence from a Regression Discontinuity Design
Reclassification can be an important juncture in the academic experience of English Learners (ELs). Literature has explored the potential for reclassification to influence academic outcomes like achievement, yet its impact on social-emotional learning (SEL) skills, which are as malleable and important to long-term success, remains unclear. Using a regression discontinuity design, we examine… more →
Cream Skimming and Pushout of Students Participating in a Statewide Private School Voucher Program
A pervasive issue in the school choice literature is whether schools of choice cream-skim students by enrolling high-achieving, less challenging, or less costly students. Similarly, schools of choice may “pushout” low-achieving, more challenging, or more costly students. Using longitudinal student-level data from Indiana, we created multiple measures to examine whether there is evidence… more →
Not the Great Equalizer? Local Economic Mobility and Inequality Effects for the Establishment of U.S. Universities
We exploit historical natural experiments to test whether universities increase economic mobility and equality. We use "runner-up’" counties that were strongly considered to become university sites but were not selected for as-good-as-random reasons as counterfactuals for university counties. University establishment causes greater intergenerational income mobility but also increases cross-… more →
Computationally Identifying Funneling and Focusing Questions in Classroom Discourse
Responsive teaching is a highly effective strategy that promotes student learning. In math classrooms, teachers might funnel students towards a normative answer or focus students to reflect on their own thinking, deepening their understanding of math concepts. When teachers focus, they treat students’ contributions as resources for collective sensemaking, and thereby significantly improve… more →
Is there a national teacher shortage? A systematic examination of reports of teacher shortages in the United States
Teachers are critical to student learning, but adequately staffing classrooms has been challenging in many parts of the country. Even though teacher shortages are being reported across the U.S., teacher shortages are poorly understood. Determining and addressing teacher shortages is difficult due to the lack of data. Neither the federal government nor the majority of states have provided… more →
Beyond Teachers: Estimating Individual Guidance Counselors’ Effects on Educational Attainment
Counselors are a common school resource for students navigating complicated and con- sequential education choices. I estimate counselors’ causal effects using quasi-random assignment policies in Massachusetts. Counselors vary substantially in their effectiveness at increasing high school graduation and college attendance, selectivity, and persistence. Counselor effects on educational… more →
The Distribution of School Resources in The United States: A Comparative Analysis Across Levels of Governance, Student Sub-groups, And Educational Resources
Levels of governance (the nation, states, and districts), student subgroups (racially and ethnically minoritized and economically disadvantaged students), and types of resources (expenditures, class sizes, and teacher quality) intersect to represent a complex and comprehensive picture of K-12 educational resource inequality. Drawing on multiple sources of the most recently available data, we… more →
Who Benefits From Attending Effective Schools?
We estimate the longer-run effects of attending an effective high school (one that improves a combination of test scores, survey measures of socio-emotional development, and behaviors in 9th grade) for students who are more versus less educationally advantaged (i.e., likely to attain more years of education based on 8th-grade characteristics). All students benefit from attending effective… more →
Heterogeneity in Labor Market Returns to Master’s Degrees: Evidence from Ohio
Graduate education is among the fastest growing segments of the U.S. higher educational system. This paper provides up-to-date causal evidence on labor market returns to Master’s degrees and examines heterogeneity in the returns by field area, student demographics and initial labor market conditions. We use rich administrative data from Ohio and an individual fixed effects model that compares… more →
What Happened to the K-12 Education Labor Market During COVID? The Acute Need for Better Data Systems
The COVID-19 pandemic upended the U.S. education system and the economy in ways that dramatically affected the jobs of K-12 educators. However, data limitations have led to considerable uncertainty and conflicting reports about the nature of staffing challenges in schools. We draw on education employment data from the Bureau of Labor Statistics (BLS) and State Education Agencies (SEA) to… more →
Do STEM Students Vote?
For decades, pundits, politicians, college administrators, and academics have lamented the dismal rates of civic engagement among students who enroll in courses and eventually major in science, technology, engineering, and mathematics (i.e., STEM) fields. However, the research supporting this conclusion has faced distinct challenges in terms of data quality. Does STEM actually decrease the… more →
Replicating and Extending Effects of “Achievement Gap” Discourse
Scholars argue the “racial achievement gap” frame perpetuates deficit mindsets. Previously, we found teachers gave lower priority to racial equity when disparities were framed as “achievement gaps” versus “inequality in educational outcomes.” In this brief, we analyze data from two survey experiments using a teacher sample and an MTurk sample. We find: (1) the effect of “achievement gap” (AG)… more →
On the Threshold: Impacts of Barely Passing High-School Exit Exams on Post-Secondary Enrollment and Completion
Many states use high-school exit examinations to assess students’ career and college readiness in core subjects. We find meaningful consequences of barely passing the mathematics examination in Massachusetts, as opposed to just failing it. However, these impacts operate at different educational attainment margins for low-income and higher-income students. As in previous work, we find that… more →
Heterogeneous Effects of Violence on Student Achievement
In this paper, I study the causal relationship between violence and human capital accumulation. Due to a power vacuum left in conflict zones of Colombia after the 2016 peace agreement, large spikes in violence were reported in the municipalities of the country dominated by the rebel group FARC. I compare student test scores in municipalities that experienced the increase in violence to the… more →
The Other Half of the Story: Does Excluding the Early Grades from School Ratings Matter?
Because high-stakes testing for school accountability does not begin until third grade, accountability ratings for elementary schools do not directly measure students’ academic progress in grades K through 2. While it is possible that children’s test scores in grades 3 and above are highly correlated with children’s outcomes in the untested grades, research provides reasons to believe that… more →
The Enduring Struggle of Standards-Based Reform: Lessons from a National Research Center on College and Career-Ready Standards
Standards have been at the heart of state and federal efforts to improve education for several decades. Most recently, standards-based reforms have evolved with a focus on more ambitious "college- and career-ready" (CCR) standards. This paper synthesizes the results of a seven-year national research center focused on the implementation and effects of CCR standards. The paper draws on… more →
U.S. Middle School Mathematics Instruction, 2016
In recent decades, U.S. education leaders have advocated for more intellectually ambitious mathematics instruction in classrooms. Evidence about whether more ambitious mathematics instruction has filtered into contemporary classrooms, however, is largely anecdotal. To address this issue, we analyzed 93 lessons recorded by a national random sample of middle school mathematics teachers. We find… more →
School reopening decisions during the COVID-19 pandemic: What can we learn from the emerging literature?
After near-universal school closures in the United States at the start of the pandemic, lawmakers and educational leaders made plans for when and how to reopen schools for the 2020-21 school year. Educational researchers quickly assessed how a range of public health, political, and demographic factors were associated with school reopening decisions and parent preferences for in-person and… more →
Modeling Item-Level Heterogeneous Treatment Effects with the Explanatory Item Response Model: Leveraging Online Formative Assessments to Pinpoint the Impact of Educational Interventions
Analyses that reveal how treatment effects vary allow researchers, practitioners, and policymakers to better understand the efficacy of educational interventions. In practice, however, standard statistical methods for addressing Heterogeneous Treatment Effects (HTE) fail to address the HTE that may exist within outcome measures. In this study, we present a novel application of the Explanatory… more →
Keep Me In, Coach: The Short- and Long-Term Effects of Targeted Academic Coaching
To boost college graduation rates, policymakers often advocate for academic supports such as coaching or mentoring. Proactive and intensive coaching interventions are effective, but are costly and difficult to scale. We evaluate a relatively lower-cost group coaching program targeted at first-year college students placed on academic probation. Participants attend a workshop where coaches aim… more →
Incentivizing Equity? The Effects of Performance-Based Funding on Race-Based Gaps in College Completion
Performance-based funding models for higher education, which tie state support for institutions to performance on student outcomes, have proliferated in recent decades. Some states have designed these policies to also address educational attainment gaps by including bonus payments for traditionally low-performing groups. Using a Synthetic Control Method research design, we examine the impact… more →
How Much Do Early Teachers Matter?
We present new estimates of the importance of teachers in early grades for later grade outcomes, but unlike the existing literature that examines teacher “fade-out,” we directly compare the contribution of early-grade teachers to later year outcomes against the contributions of later year teachers to the same later year outcomes. Where the prior literature finds that much of the contribution… more →
Student Selection into an Income Share Agreement
Financing college expenses through an income share agreement (ISA) is an arrangement where the student agrees to pay a fixed percentage of future earned income for a designated period of time in exchange for college funding. Using administrative and survey data for all eligible applicants to a university ISA program, I estimate the adverse selection into the ISA and provide preliminary… more →
Linkage Between Fields of Concentration in High School Career-Technical Education and College Majors
In this descriptive study, we use longitudinal student-level administrative records from 4 cohorts of high school graduates in Kentucky to examine the extent to which students persist and attain post-secondary credentials in the CTE fields of concentration they choose in high school. To our knowledge, this is the first paper to use student-level administrative data to examine how different… more →
Out of the Gate, but Not Necessarily Teaching: A Descriptive Portrait of Early-Career Earnings for Those Who Are Credentialed to Teach
Prior work on teacher candidates in Washington State has shown that about two thirds of individuals who trained to become teachers between 2005 and 2015 and received a teaching credential did not enter the state’s public teaching workforce immediately after graduation, while about one third never entered a public teaching job in the state at all. In this analysis, we link data on these teacher… more →
Strictly Speaking: Examining Teacher Use of Punishment and Student Outcomes
While a growing body of literature has documented the negative impacts of exclusionary punishments, such as suspensions, on academic outcomes, less is known about how teachers vary in disciplinary behaviors and the attendant impacts on students. We use administrative data from North Carolina elementary schools to examine the extent to which teachers vary in their use of referrals and investigate… more →
Hard-to-Staff Centers: Exploring Center-Level Variation in the Persistence of Child Care Teacher Turnover
High rates of teacher turnover in child care settings have negative implications for young children’s learning experiences and for efforts to improve child care quality. Prior research has explored the prevalence and predictors of turnover at the individual teacher level, but less is known about turnover at the center level – specifically, how turnover varies across child care centers or… more →
Correspondence Measures for Assessing Replication Success
Given recent evidence challenging the replicability of results in the social and behavioral sciences, critical questions have been raised about appropriate measures for determining replication success in comparing effect estimates across studies. At issue is the fact that conclusions about replication success often depend on the measure used for evaluating correspondence in… more →
The impact of school desegregation on White individuals' racial attitudes and politics in adulthood
In this paper I study how school desegregation by race following Brown v. Board of Education affected White individuals’ racial attitudes and politics in adulthood. I use geocoded nationwide data from the General Social Survey and differences-in-differences to identify causal impacts. Integration significantly reduced White individuals’ political conservatism as adults in the U.S.… more →
The Impact of Summer Programs on Student Mathematics Achievement: A Meta-Analysis
We present results from a meta-analysis of 37 contemporary experimental and quasi-experimental studies of summer programs in mathematics for children in Grades pre-K-12, examining what resources and characteristics predict stronger student achievement. Children who participated in summer programs that included mathematics activities experienced significantly better mathematics achievement… more →
STEM Summer Programs for Underrepresented Youth Increase STEM Degrees
The federal government and many individual organizations have invested in programs to support diversity in the STEM pipeline, including STEM summer programs for high school students, but there is little rigorous evidence of their efficacy. We fielded a randomized controlled trial to study a suite of such programs targeted to underrepresented high school students at an elite, technical… more →
College Field Specialization and Beliefs about Relative Performance: An Experimental Intervention to Understand Gender Gaps in STEM
Beliefs about relative academic performance may shape field specialization and explain gender gaps in STEM enrollment, but little causal evidence exists. To test whether these beliefs are malleable and salient enough to change behavior, I run a randomized controlled trial with 5,700 undergraduates across seven introductory STEM courses. Providing relative performance information shrinks gender… more →
Effectiveness of Tier 1 Content-Integrated Literacy Intervention on Early Elementary English Learners’ Reading Comprehension and Writing: Evidence from Randomized Controlled Trial
The current study replicated and extended the previous findings of content-integrated literacy intervention focusing on its effectiveness on first- and second-grade English learners’ (N = 1,314) reading comprehension, writing, vocabulary knowledge, and oral proficiency. Statistically significant findings were replicated on science and social studies vocabulary knowledge (ES = .51 and .53,… more →
Promises, Pitfalls, and Tradeoffs in Identifying Gifted Learners: Evidence from a Curricular Experiment
Disparities in gifted representation across demographic subgroups represents a large and persistent challenge in U.S. public schools. In this paper, we measure the impacts of a school-wide curricular intervention designed to address such disparities. We implemented Nurturing for a Bright Tomorrow (NBT) as a cluster randomized trial across elementary schools with the low gifted identification… more →
How States Prioritize Educational Needs during the COVID-19 Pandemic: Assessing the Distribution of the Governor’s Emergency Education Relief Fund
The Coronavirus Aid, Relief and Economic Security (CARES) Act passed by Congress in 2020 included significant aid to state education systems. These included direct aid to K-12 districts and higher education institutions, and funds to be used at the discretion of Governors through the Governor’s Emergency Education Relief Fund (GEER). We examine the factors influencing where and how GEER… more →
The Impact of COVID-19 on Community College Enrollment and Student Success: Evidence from California Administrative Data
This paper examines how the pandemic impacted the enrollment patterns, fields of study, and academic outcomes of students in the California Community College System, the largest higher-education system in the country. Enrollment dropped precipitously during the pandemic – the total number of enrolled students fell by 11 percent from fall 2019 to fall 2020 and by another 7 percent from fall… more →
Latinx Community College Students Experiencing Financial Aid Income Verification: A Critical Race Analysis
Every year millions of students seeking access to federal financial aid complete the Free Application for Federal Student Aid (FAFSA) application which grants an estimated $234 billion in federal aid in the 2020-21 academic year. Upon receiving students’ FAFSA, the U.S. Department of Education selects some students for income verification, a process in which educational institutions check the… more →
Racial Category Usage in Education Research: Examining the Publications from AERA Journals
How scholars name different racial groups has powerful salience for understanding what researchers study. We explored how education researchers used racial terminology in recently published, high-profile, peer-reviewed studies. Our sample included all original empirical studies published in the non-review AERA journals from 2009 to 2019. We found two-thirds of articles used at least one racial… more →
Crossing the Finish Line but Losing the Race? Socioeconomic Inequalities in the Labor Market Trajectories of Community College Graduates
Despite decades and hundreds of billions of dollars of federal and state investment in policies to promote postsecondary educational attainment as a key lever for increasing the economic mobility of lower-income populations, research continues to show large and meaningful differences in the mid-career earnings of students from families in the bottom and top income quintiles. Prior research has… more →
Learning to Value Girls: Balanced Infant Sex Ratios at Higher Parental Education in the U.S. 1969-2018
Infant sex ratios that differ from the biological norm provide a measure of gender status inequality that is not susceptible to social desirability bias. Ratios may become less biased with educational expansion through reduced preference for male children. Alternatively, bias could increase with education through more access to sex-selective medical technologies. Using National Vital… more →
Variation in the Relationship between School Spending and Achievement: Progressive Spending Is Efficient
The equity-efficiency tradeoff and cumulative return theories predict larger returns to school spending in areas with higher previous investment in children. Equity – not efficiency – is therefore used to justify progressive school funding: spending more in communities with fewer financial resources. Yet it remains unclear how returns to school spending vary across areas by previous investment… more →
Study More Tomorrow
We design a commitment contract for college students, "Study More Tomorrow," and conduct a randomized control trial testing a model of its demand. The contract commits students to attend peer tutoring if their midterm grade falls below a pre-specified threshold. The contract carries a financial penalty for noncompliance, in contrast to other commitment devices for studying tested in the… more →
Challenges and Tradeoffs of “Good” Teaching: The Pursuit of Multiple Educational Outcomes
The pursuit of multiple educational outcomes makes teaching a complex craft subject to potential conflicts and competing commitments. Using a dataset in which teachers were randomly assigned to students paired with videotapes of instruction, we both document and unpack such a tradeoff. Upper-elementary teachers who excel at raising students’ math test scores often are less successful at… more →