EdWorkingPapers
The Other Half of the Story: Does Excluding the Early Grades from School Ratings Matter?
Because high-stakes testing for school accountability does not begin until third grade, accountability ratings for elementary schools do not directly measure students’ academic progress in grades K through 2. While it is possible that children’s test scores in grades 3 and above are highly correlated with children’s outcomes in the untested grades, research provides reasons to believe that… more →
Heterogeneous Effects of Violence on Student Achievement
In this paper, I study the causal relationship between violence and human capital accumulation. Due to a power vacuum left in conflict zones of Colombia after the 2016 peace agreement, large spikes in violence were reported in the municipalities of the country dominated by the rebel group FARC. I compare student test scores in municipalities that experienced the increase in violence to the… more →
The Enduring Struggle of Standards-Based Reform: Lessons from a National Research Center on College and Career-Ready Standards
Standards have been at the heart of state and federal efforts to improve education for several decades. Most recently, standards-based reforms have evolved with a focus on more ambitious "college- and career-ready" (CCR) standards. This paper synthesizes the results of a seven-year national research center focused on the implementation and effects of CCR standards. The paper draws on… more →
U.S. Middle School Mathematics Instruction, 2016
In recent decades, U.S. education leaders have advocated for more intellectually ambitious mathematics instruction in classrooms. Evidence about whether more ambitious mathematics instruction has filtered into contemporary classrooms, however, is largely anecdotal. To address this issue, we analyzed 93 lessons recorded by a national random sample of middle school mathematics teachers. We find… more →
Modeling Item-Level Heterogeneous Treatment Effects with the Explanatory Item Response Model: Leveraging Online Formative Assessments to Pinpoint the Impact of Educational Interventions
Analyses that reveal how treatment effects vary allow researchers, practitioners, and policymakers to better understand the efficacy of educational interventions. In practice, however, standard statistical methods for addressing Heterogeneous Treatment Effects (HTE) fail to address the HTE that may exist within outcome measures. In this study, we present a novel application of the Explanatory… more →
School reopening decisions during the COVID-19 pandemic: What can we learn from the emerging literature?
After near-universal school closures in the United States at the start of the pandemic, lawmakers and educational leaders made plans for when and how to reopen schools for the 2020-21 school year. Educational researchers quickly assessed how a range of public health, political, and demographic factors were associated with school reopening decisions and parent preferences for in-person and… more →
Keep Me In, Coach: The Short- and Long-Term Effects of Targeted Academic Coaching
To boost college graduation rates, policymakers often advocate for academic supports such as coaching or mentoring. Proactive and intensive coaching interventions are effective, but are costly and difficult to scale. We evaluate a relatively lower-cost group coaching program targeted at first-year college students placed on academic probation. Participants attend a workshop where coaches aim… more →
Incentivizing Equity? The Effects of Performance-Based Funding on Race-Based Gaps in College Completion
Performance-based funding models for higher education, which tie state support for institutions to performance on student outcomes, have proliferated in recent decades. Some states have designed these policies to also address educational attainment gaps by including bonus payments for traditionally low-performing groups. Using a Synthetic Control Method research design, we examine the impact… more →
How Much Do Early Teachers Matter?
We present new estimates of the importance of teachers in early grades for later grade outcomes, but unlike the existing literature that examines teacher “fade-out,” we directly compare the contribution of early-grade teachers to later year outcomes against the contributions of later year teachers to the same later year outcomes. Where the prior literature finds that much of the contribution… more →
Out of the Gate, but Not Necessarily Teaching: A Descriptive Portrait of Early-Career Earnings for Those Who Are Credentialed to Teach
Prior work on teacher candidates in Washington State has shown that about two thirds of individuals who trained to become teachers between 2005 and 2015 and received a teaching credential did not enter the state’s public teaching workforce immediately after graduation, while about one third never entered a public teaching job in the state at all. In this analysis, we link data on these teacher… more →
Student Selection into an Income Share Agreement
Financing college expenses through an income share agreement (ISA) is an arrangement where the student agrees to pay a fixed percentage of future earned income for a designated period of time in exchange for college funding. Using administrative and survey data for all eligible applicants to a university ISA program, I estimate the adverse selection into the ISA and provide preliminary… more →
Linkage Between Fields of Concentration in High School Career-Technical Education and College Majors
In this descriptive study, we use longitudinal student-level administrative records from 4 cohorts of high school graduates in Kentucky to examine the extent to which students persist and attain post-secondary credentials in the CTE fields of concentration they choose in high school. To our knowledge, this is the first paper to use student-level administrative data to examine how different… more →
Strictly Speaking: Examining Teacher Use of Punishment and Student Outcomes
While a growing body of literature has documented the negative impacts of exclusionary punishments, such as suspensions, on academic outcomes, less is known about how teachers vary in disciplinary behaviors and the attendant impacts on students. We use administrative data from North Carolina elementary schools to examine the extent to which teachers vary in their use of referrals and investigate… more →
Hard-to-Staff Centers: Exploring Center-Level Variation in the Persistence of Child Care Teacher Turnover
High rates of teacher turnover in child care settings have negative implications for young children’s learning experiences and for efforts to improve child care quality. Prior research has explored the prevalence and predictors of turnover at the individual teacher level, but less is known about turnover at the center level – specifically, how turnover varies across child care centers or… more →
Correspondence Measures for Assessing Replication Success
Given recent evidence challenging the replicability of results in the social and behavioral sciences, critical questions have been raised about appropriate measures for determining replication success in comparing effect estimates across studies. At issue is the fact that conclusions about replication success often depend on the measure used for evaluating correspondence in… more →
The Impact of Summer Programs on Student Mathematics Achievement: A Meta-Analysis
We present results from a meta-analysis of 37 contemporary experimental and quasi-experimental studies of summer programs in mathematics for children in Grades pre-K-12, examining what resources and characteristics predict stronger student achievement. Children who participated in summer programs that included mathematics activities experienced significantly better mathematics achievement… more →
The impact of school desegregation on White individuals' racial attitudes and politics in adulthood
In this paper I study how school desegregation by race following Brown v. Board of Education affected White individuals’ racial attitudes and politics in adulthood. I use geocoded nationwide data from the General Social Survey and differences-in-differences to identify causal impacts. Integration significantly reduced White individuals’ political conservatism as adults in the U.S.… more →
STEM Summer Programs for Underrepresented Youth Increase STEM Degrees
The federal government and many individual organizations have invested in programs to support diversity in the STEM pipeline, including STEM summer programs for high school students, but there is little rigorous evidence of their efficacy. We fielded a randomized controlled trial to study a suite of such programs targeted to underrepresented high school students at an elite, technical… more →
College Field Specialization and Beliefs about Relative Performance: An Experimental Intervention to Understand Gender Gaps in STEM
Beliefs about relative academic performance may shape field specialization and explain gender gaps in STEM enrollment, but little causal evidence exists. To test whether these beliefs are malleable and salient enough to change behavior, I run a randomized controlled trial with 5,700 undergraduates across seven introductory STEM courses. Providing relative performance information shrinks gender… more →
Effectiveness of Tier 1 Content-Integrated Literacy Intervention on Early Elementary English Learners’ Reading Comprehension and Writing: Evidence from Randomized Controlled Trial
The current study replicated and extended the previous findings of content-integrated literacy intervention focusing on its effectiveness on first- and second-grade English learners’ (N = 1,314) reading comprehension, writing, vocabulary knowledge, and oral proficiency. Statistically significant findings were replicated on science and social studies vocabulary knowledge (ES = .51 and .53,… more →
Promises, Pitfalls, and Tradeoffs in Identifying Gifted Learners: Evidence from a Curricular Experiment
Disparities in gifted representation across demographic subgroups represents a large and persistent challenge in U.S. public schools. In this paper, we measure the impacts of a school-wide curricular intervention designed to address such disparities. We implemented Nurturing for a Bright Tomorrow (NBT) as a cluster randomized trial across elementary schools with the low gifted identification… more →
The Impact of COVID-19 on Community College Enrollment and Student Success: Evidence from California Administrative Data
This paper examines how the pandemic impacted the enrollment patterns, fields of study, and academic outcomes of students in the California Community College System, the largest higher-education system in the country. Enrollment dropped precipitously during the pandemic – the total number of enrolled students fell by 11 percent from fall 2019 to fall 2020 and by another 7 percent from fall… more →
How States Prioritize Educational Needs during the COVID-19 Pandemic: Assessing the Distribution of the Governor’s Emergency Education Relief Fund
The Coronavirus Aid, Relief and Economic Security (CARES) Act passed by Congress in 2020 included significant aid to state education systems. These included direct aid to K-12 districts and higher education institutions, and funds to be used at the discretion of Governors through the Governor’s Emergency Education Relief Fund (GEER). We examine the factors influencing where and how GEER… more →
Latinx Community College Students Experiencing Financial Aid Income Verification: A Critical Race Analysis
Every year millions of students seeking access to federal financial aid complete the Free Application for Federal Student Aid (FAFSA) application which grants an estimated $234 billion in federal aid in the 2020-21 academic year. Upon receiving students’ FAFSA, the U.S. Department of Education selects some students for income verification, a process in which educational institutions check the… more →
Racial Category Usage in Education Research: Examining the Publications from AERA Journals
How scholars name different racial groups has powerful salience for understanding what researchers study. We explored how education researchers used racial terminology in recently published, high-profile, peer-reviewed studies. Our sample included all original empirical studies published in the non-review AERA journals from 2009 to 2019. We found two-thirds of articles used at least one racial… more →
Crossing the Finish Line but Losing the Race? Socioeconomic Inequalities in the Labor Market Trajectories of Community College Graduates
Despite decades and hundreds of billions of dollars of federal and state investment in policies to promote postsecondary educational attainment as a key lever for increasing the economic mobility of lower-income populations, research continues to show large and meaningful differences in the mid-career earnings of students from families in the bottom and top income quintiles. Prior research has… more →
Learning to Value Girls: Balanced Infant Sex Ratios at Higher Parental Education in the U.S. 1969-2018
Infant sex ratios that differ from the biological norm provide a measure of gender status inequality that is not susceptible to social desirability bias. Ratios may become less biased with educational expansion through reduced preference for male children. Alternatively, bias could increase with education through more access to sex-selective medical technologies. Using National Vital… more →
Variation in the Relationship between School Spending and Achievement: Progressive Spending Is Efficient
The equity-efficiency tradeoff and cumulative return theories predict larger returns to school spending in areas with higher previous investment in children. Equity – not efficiency – is therefore used to justify progressive school funding: spending more in communities with fewer financial resources. Yet it remains unclear how returns to school spending vary across areas by previous investment… more →
Study More Tomorrow
We design a commitment contract for college students, "Study More Tomorrow," and conduct a randomized control trial testing a model of its demand. The contract commits students to attend peer tutoring if their midterm grade falls below a pre-specified threshold. The contract carries a financial penalty for noncompliance, in contrast to other commitment devices for studying tested in the… more →
Challenges and Tradeoffs of “Good” Teaching: The Pursuit of Multiple Educational Outcomes
The pursuit of multiple educational outcomes makes teaching a complex craft subject to potential conflicts and competing commitments. Using a dataset in which teachers were randomly assigned to students paired with videotapes of instruction, we both document and unpack such a tradeoff. Upper-elementary teachers who excel at raising students’ math test scores often are less successful at… more →
Changes in Teachers’ Mobility and Attrition in Arkansas During the First Two Years of the COVID-19 Pandemic
The COVID-19 pandemic has been a trying period for teachers. Teachers had to adapt to unexpected conditions, teaching in unprecedented ways. As a result, teachers' levels of stress and burnout have been high throughout the pandemic, raising concerns about a potential increase in teacher turnover and future teacher shortages. We use administrative data for the state of Arkansas… more →
Second Time's the Charm? How Sustained Relationships from Repeat Student-Teacher Matches Build Academic and Behavioral Skills
We examine the dynamic nature of student-teacher match quality by studying the effect of having a teacher for more than one year. Using data from Tennessee and panel methods, we find that having a repeat teacher improves achievement and decreases absences, truancy, and suspensions. These results are robust to a range of tests for student and teacher sorting. High-achieving students benefit… more →
What is a School Finance Reform? Uncovering the ubiquity and diversity of school finance reforms using a Bayesian changepoint estimator
School finance reforms are not well defined and are likely more prevalent than the current literature has documented. Using a Bayesian changepoint estimator, we quantitatively identify the years when state education revenues abruptly increased for each state between 1960 and 2008 and then document the state-specific events that gave rise to these changes. We find 108 instances of abrupt… more →
Excellence for all? University honors programs and human capital formation
Can public university honors programs deliver the benefits of selective undergraduate education within otherwise nonselective institutions? We evaluate the impact of admission to the Honors College at Oregon State University, a large nonselective public university. Admission to the Honors College depends heavily on a numerical application score. Nonlinearities in admissions probabilities as a… more →
Assessors influence results: Evidence on enumerator effects and educational impact evaluations
A significant share of education and development research uses data collected by workers called “enumerators.” It is well-documented that “enumerator effects”—or inconsistent practices between the individual people who administer measurement tools— can be a key source of error in survey data collection. However, it is less understood whether this is a problem for academic assessments or… more →
The Effects and Local Implementation of School Finance Reforms on Teacher Salary, Hiring and Turnover
Knowing how policy-induced salary schedule changes affect teacher recruitment and retention will significantly advance our understanding of how resources matter for K-12 student learning. This study sheds light on this issue by estimating how legislative funding changes in Washington state in 2018-19—induced by the McCleary court-ordered reform—affected teacher salaries and labor market… more →
Washington School Finance: Exploring the History and Present-Day Challenges for Fiscal Equity
In this forthcoming book chapter, the authors provide an in-depth description of the history and current issues pertaining to public school finance in Washington State, including how recent federal stimulus funding impacted resource levels. The state uses a resource-based funding model, where the amount of funds each school district receives is based on the district’s enrollment level and a… more →
Signal Weighted Value-Added Models
This study introduces the signal weighted teacher value-added model (SW VAM), a value-added model that weights student-level observations based on each student’s capacity to signal their assigned teacher’s quality. Specifically, the model leverages the repeated appearance of a given student to estimate student reliability and sensitivity parameters, whereas traditional VAMs represent a special… more →
Why Do School Districts Matter? An Interdisciplinary Framework and Empirical Review
What guidance does research provide school districts about how to improve system performance and increase equity? Despite over 30 years of inquiry on the topic of effective districts, existing frameworks are relatively narrow in terms of disciplinary focus (primarily educational leadership perspectives) and research design (primarily qualitative case studies). To bridge this gap, we first… more →
Design and Analytic Features for Reducing Biases in Skill-Building Intervention Impact Forecasts
Despite policy relevance, longer-term evaluations of educational interventions are relatively rare. A common approach to this problem has been to rely on longitudinal research to determine targets for intervention by looking at the correlation between children’s early skills (e.g., preschool numeracy) and medium-term outcomes (e.g., first-grade math achievement). However, this approach has… more →
The narrowing gender wage gap among faculty at public universities in the U.S.
We study the conditional gender wage gap among faculty at public research universities in the U.S. We begin by using a cross-sectional dataset from 2016 to replicate the long-standing finding in research that conditional on rich controls, female faculty earn less than their male colleagues. Next, we construct a data panel to track the evolution of the wage gap through 2021. We show that the… more →
Grads on the Go: Measuring College-Specific Labor Markets for Graduates
This paper introduces a new measure of the labor markets served by colleges and universities across the United States. About 50 percent of recent college graduates are living and working in the metro area nearest the institution they attended, with this figure climbing to 67 percent in-state. The geographic dispersion of alumni is more than twice as great for highly selective 4-year… more →
Native Flight Responses to Immigration: Evidence from K-12 School Enrollments
Over the past few decades, the U.S. has received a consistent and increasing influx of immigrants into the nation. Immigration poses challenges relating to diversity, inclusion and cohesion in education systems, including K-12 education. In the context of immigration, the theory of native flight argues that U.S. born populations move away from neighborhoods when an increasing number of… more →
Documenting Their Decisions: How Undocumented Students Enroll and Persist in College
The absence of federal support leaves undocumented students reliant on state policies to financially support their postsecondary education. We descriptively examine the postsecondary trajectories of tens of thousands of undocumented students newly eligible for California’s state aid program, using detailed application data to compare them to similar peers. In this context, undocumented… more →
Unequal & Increasingly Unfair: How Federal Policy Creates Disparities in Special Education Funding
The formula used to allocate federal funding for state and local special education programs is one of the Individual with Disabilities Act’s most critical components. The formula not only serves as the primary mechanism for dividing available federal dollars among states, it also represents policymakers’ intent to equalize educational opportunities for students with disabilities nationwide. In… more →
Bias in kindergarten ability group placement: Does parental lobbying make it worse? Do formal assessments make it better?
Von Hippel & Cañedo (2021) reported that US kindergarten teachers placed girls, Asian-Americans, and children from families of high socioeconomic status (SES) into higher ability groups than their test scores alone would warrant. The results fit the view that teachers were biased.
This comment asks whether parents’ lobbying for higher placement might explain these results. The… more →
When expectation isn’t reality: Racial disparities in overestimation and STEM attrition among first-year students in college
Existing research indicates that racially minoritized students with similar academic preparation are less likely than their represented peers to persist in STEM, raising the question of factors that may contribute to racial disparities in STEM participation beyond academic preparation. We extend the current literature by first examining race-based differences in what students expect to receive… more →
The Effect of Active Learning Professional Development Training on College Students’ Academic Outcomes
Growing literature documents the promise of active learning instruction in engaging students in college classrooms. Accordingly, faculty professional development (PD) programs on active learning have become increasingly popular in postsecondary institutions; yet, quantitative evidence on the effectiveness of these programs is limited. Using administrative data and an individual fixed effects… more →
Two Years Later: How COVID-19 has Shaped the Teacher Workforce
The unprecedented challenges of teaching during COVID-19 prompted fears of a mass exodus from the profession. We examine the extent to which these fears were realized using administrative records of Massachusetts teachers between 2015-16 and 2021-22. Relative to pre-pandemic levels, average turnover rates were similar going into the fall of 2020 but increased by 17 percent going into the fall… more →
Instructional Coaching Personnel and Program Scalability
Instructional coaching is an attractive alternative to one-size-fits-all teacher training and development in part because it is purposefully differentiated: programming is aligned to individual teachers’ needs and implemented by an individual coach. But, how much of the benefit of coaching as an instructional improvement model depends on the specific coach with whom a teacher works?… more →