EdWorkingPapers
Learning-Mode Choice, Student Engagement, and Achievement Growth During the COVID-19 Pandemic
The COVID-19 pandemic initially resulted in an unanticipated and near-universal shift from in-person to virtual instruction in spring 2020. During the 2020-21 school year, schools began to re-open and families were faced with decisions regarding the instructional mode for their children. We leverage administrative, survey, and virtual-learning data to examine the determinants of family… more →
From Interest to Entry: The Teacher Pipeline From College Application to Initial Employment
Strengthening teacher supply is a key policy objective for K–12 public education, but understanding of the early teacher pipeline remains limited. We leverage the universe of applications to a large public university in Texas from 2009–2020 to examine the pipeline into teacher education and employment as a K–12 public school teacher. A unique feature of Texas's centralized higher education… more →
The Uncertain Role of Educational Software in Remediating Student Learning: Regression discontinuity evidence from three local education agencies
Educators must balance the needs of students who start the school year behind grade level with their obligation to teach grade-appropriate content to all students. Educational software could help educators strike this balance by targeting content to students’ differing levels of mastery. Using a regression discontinuity design and detailed software log and administrative data, we compare two… more →
Impact Evaluations of Teacher Preparation Practices: Challenges and Opportunities for More Rigorous Research
Many teacher education researchers have expressed concerns with the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, external validity, and measurement. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher preparation practices published in peer-reviewed… more →
A Bridge to Graduation: Post-Secondary Effects of an Alternative Pathway for Students Who Fail High School Exit Exams
High school exit exams are meant to standardize the quality of public high schools and to ensure that students graduate with a set of basic skills and knowledge. Evidence suggests that a common perverse effect of exit exams is an increase in dropout for students who have difficulty passing tests, with a larger effect on minority students. To mitigate this, some states offer alternative, non-… more →
The Long-Run Impacts of Mexican-American School Desegregation
We present the first quantitative analysis of the impact of ending de jure segregation of Mexican-American school children in the United States by examining the effects of the 1947 Mendez v. Westminster court decision on long-run educational attainment for Hispanics and non-Hispanic whites in California. Our identification strategy relies on comparing individuals across California counties… more →
Can interactive online training make high school students more entrepreneurial? Experimental evidence from Rwanda
We study the short-run effects of a gamified online entrepreneurship training offered to high school students in Rwanda during the COVID-19 pandemic. Using a randomized controlled trial, we estimate sizeable effects of the 6-week training on entrepreneurial activity. One month after the training, participants in schools offered the training were much more likely to own a business than… more →
Can Information and Advising Affect Postsecondary Participation and Attainment for Non-Traditional Students? Evidence from a Large-Scale Experiment with the U.S. Army
Non-traditional students disproportionately enroll in institutions with weaker graduation and earnings outcomes. One hypothesis is that these students would have made different choices had they been provided with better information or supports during the decision-making process. We conducted a large-scale, multi-arm field experiment with the U.S. Army to investigate whether personalized… more →
Can Adolescents Acquire Cultural Capital Through Social Capital Access and Exposure? Longitudinal Experimental Evidence of the Impact of Ties to College-Educated Adults
Scholarly debate focuses on whether cultural capital reproduces existing inequalities or provides a path to upward mobility. Most research, however, focuses only on cross-sectional associations and is unclear about how disadvantaged adolescents can increase their amounts of cultural capital. Traditionally, most adolescents’ interactions with adults occur across two axes of socialization:… more →
Investing in the Teacher Workforce: Experimental Evidence on Teachers’ Preferences
While investing in the teacher workforce is central to improving schools, school resources are notoriously limited, forcing school leaders to make difficult decisions on how to prioritize funds. This paper examines a critical input to resource allocation decisions: teacher preferences. Using an original, online discrete choice survey experiment with a national sample of 1,030 U.S. teachers, we… more →
The Impacts of School District Consolidation on Rural Communities: Evidence from Arkansas Reform
Over the past fifty years, school districts have consolidated in an effort to achieve economies of scale. While the determinants and effects of district mergers on operations have been studied (Gordon and Knight 2006; Duncombe and Yinger 2007; Jones et al 2008), the impact on communities has not. In small towns, schools not only educate, but also provide stable employment and are a cornerstone… more →
How Do Charter Schools Affect System-Level Test Scores and Graduation Rates? A National Analysis
We study the combined effects of charter schools, and their various mechanisms, on a national level and across multiple outcomes. Using difference-in-differences and fixed effects methods, we find that charter entry (above 10 percent market share) increases high school graduation rate in geographic districts by about 2-4 percentage points and increases test scores by 0.06-0.16 standard… more →
Teacher Labor Market Equilibrium and Student Achievement
We study whether reallocating existing teachers across schools within a district can increase student achievement, and what policies would help achieve these gains. Using a model of multi-dimensional value-added, we find meaningful achievement gains from reallocating teachers within a district. Using an estimated equilibrium model of the teacher labor market, we find that achieving most… more →
Relaxing Electoral Constraints in Local Education Funding
We study a California policy that loosened constraints on some local governments by lowering the share of votes required to pass school capital improvement bond referendums. We show that the policy change yielded larger tax proposals that received less support from voters, yet led to a doubling of approved spending. We show that this effect is concentrated in more racially diverse… more →
Do Early Warning Systems Help High School Students Stay on Track for College? Mixed Methods Evaluation of the Ninth Grade Success Initiative
As the transition point between middle school and high school, ninth grade can either set a student up for long-term success or diminish a student’s likelihood of graduating high school altogether. Interventions that can help educators better meet the needs of students during this critical juncture represent powerful levers for driving school improvement. The Ninth Grade Success Initiative is… more →
Negative Impacts From the Shift to Online Learning During the COVID-19 Crisis: Evidence from a Statewide Community College System
The COVID-19 pandemic led to an abrupt shift from in-person to virtual instruction in Spring 2020. We use two complementary difference-in differences frameworks, one that leverages within-instructor-by-course variation on whether students started their Spring 2020 courses in person or online and another that incorporates student fixed effects. We estimate the impact of this shift on the… more →
When Do Informational Interventions Work? Experimental Evidence from New York City High School Choice
This paper reports the results of a large, school-level randomized controlled trial evaluating a set of three informational interventions for young people choosing high schools in 473 middle schools, serving over 115,000 8th graders. The interventions differed in their level of customization to the student and their mode of delivery (paper or online); all treated schools received identical… more →
Test Score Patterns Across Three COVID-19-impacted School Years
The COVID-19 pandemic has been a seismic and on-going disruption to K-12 schooling. Using test scores from 5.4 million U.S. students in grades 3-8, we tracked changes in math and reading achievement across the first two years of the pandemic. Average fall 2021 math test scores in grades 3-8 were .20-27 standard deviations (SDs) lower relative to same-grade peers in fall 2019, while reading… more →
The Role of Student Beliefs in Dual-Enrollment Courses
Dual-enrollment courses are theorized to promote students' preparedness for college in part by bolstering their beneficial beliefs, such as academic self-efficacy, educational expectations, and sense of college belonging. These beliefs may also shape students' experiences and outcomes in dual-enrollment courses, yet few if any studies have examined this possibility. We study a large dual-… more →
The Long-Run Educational Benefits of High-Achieving Classrooms
Despite the prevalence of school tracking, evidence on whether it improves student success is mixed. This paper studies how tracking within high school impacts high-achieving students’ short- and longer-term academic outcomes. Our setting is a large and selective Chinese high school, where first-year students are separated into high-achieving and regular classrooms based on their performance… more →
Is a Name Change a Game Change? The Impact of College-to-University Conversions
In the competitive U.S. higher education market, institutions differentiate themselves to attract both students and tuition dollars. One understudied example of this differentiation is the increasing trend of "colleges" becoming "universities" by changing their names. Leveraging variation in the timing of such conversions in an event study framework, I show that becoming a university increases… more →
Local Supply, Temporal Dynamics, and Unrealized Potential in Teacher Hiring
We explore the dynamics of competitive search in the K-12 public education sector. Using data from Boston Public Schools, we document how teacher labor supply varies substantially by position types, schools, and the timing of job postings. We find that early-posted positions are more likely to be filled and end up securing new hires that are better-qualified, more-effective, and more likely to… more →
Can learning be measured by phone? Evidence from Kenya
School closures induced by COVID-19 placed heightened emphasis on alternative ways to measure student learning besides in-person exams. We leverage the administration of phone-based assessments (PBAs) measuring numeracy and literacy for primary school children in Kenya, along with in-person standardized tests administered to the same students prior to school shutdowns, to assess the validity… more →
The Effects of Growth Mindset on College Persistence and Completion
We study the long-term effects of a psychological intervention on longitudinal academic outcomes and degree completion of college students. All freshmen at a large public university were randomized to an online growth mindset, belonging, or control group. We tracked students’ academic outcomes including GPA, number of credits attempted and earned, major choices, and degree completion. We found… more →
The Academic Origins of Economics Faculty
We use roster data of 96 top U.S. economics departments to document the academic origins of their tenure-track faculty. Academic origins may have implications for how undergraduate (B.A.) and doctoral (Ph.D.) students are trained and placed, as well as the type of research produced. We find that faculty educated at top-ranked Ph.D. universities are overrepresented; e.g., over half of our… more →
Public Investments and Class Gaps in Parents’ Developmental Expenditures
Families and governments are the primary sources of investment in children, proving access to basic resources and other developmental opportunities. Recent research identifies significant class gaps in parental investments that contribute to high levels of inequality by family income and education and, potentially, to inequality in children’s development. State-level public… more →
A Meta-Analysis of the Experimental Evidence Linking STEM Classroom Interventions to Teacher Knowledge, Classroom Instruction, and Student Achievement
Despite growing evidence that classroom interventions in science, technology, engineering, and mathematics (STEM) can increase student achievement, there is little evidence regarding how these interventions affect teachers themselves and whether these changes predict student learning. We present results from a meta-analysis of 37 experimental studies of preK-12 STEM professional learning and… more →
Social Spending and Educational Gaps in Infant Health in the United States, 1998-2017
Recent expansions of child tax, food assistance and health insurance programs have made American families’ need for a robust social safety net highly evident, while researchers and policymakers continue to debate the best way to support families via the welfare state. How much do children – and which children – benefit from social spending? Using the State-by-State Spending on Kids Dataset,… more →
Unfinished Business? Academic and Labor Market Profile of Adults with Substantial College Credits But No Degree
Recent state policy efforts have focused on increasing attainment among adults with some college but no degree (SCND). Yet little is actually known about the SCND population. Using data from the Virginia Community College System (VCCS), we provide the first detailed profile on the academic, employment, and earnings trajectories of the SCND population, and how these compare to VCCS graduates.… more →
From Referrals to Suspensions: New Evidence on Racial Disparities in Exclusionary Discipline
We use novel data on disciplinary referrals, including those that do not lead to suspensions, to better understand the origins of racial disparities in exclusionary discipline. We find significant differences between Black and white students in both referral rates and the rate at which referrals convert to suspensions. An infraction fixed-effects research design that compares the disciplinary… more →
Stacking the Deck for Employment Success: Labor Market Returns to Stackable Credentials
With rapid technological transformations to the labor market, many working adults return to college after graduation to obtain additional training or credentials. Using a comparative individual fixed effects strategy and an administrative panel dataset of enrollment and employment in Virginia, we provide the first causal estimates of credential “stacking” – earning two or more community college… more →
Effects of Four-Day School Weeks on Older Adolescents: Examining Impacts of the Schedule on Academic Achievement, Attendance, and Behavior in High School
Four-day school weeks have proliferated across the United States in recent years, reaching over 650 public school districts in 24 states as of 2019, but little is known about their implementation and there is no consensus on their effects on students. This study uses district level panel data from Oklahoma and a difference-in-differences research design to provide estimates of the causal… more →
Pension Reform and Labor Supply
As unfunded pension liabilities grow, governments experiment with ways to curb costs. We examine the effect of a representative cost-cutting reform on the retention and productivity of workers. The reform reduced pension annuities and increased penalties for early retirement, projected to save 8 percent of revenues. We leverage administrative records and a discontinuity in the reform to… more →
Students' Grade Satisfaction Influences Evaluations of Teaching: Evidence from Individual-level Data and an Experimental Intervention
Student surveys are widely used to evaluate university teaching and increasingly adopted at the K-12 level, although there remains considerable debate about what they measure. Much disagreement focuses on the well-documented correlation between student grades and their evaluations of instructors. Using individual-level data from 19,000 evaluations of 700 course sections at a flagship public… more →
Tightening the Leaky Pipeline(s): The Role of Beliefs About Ability in STEM Major Choice
To study beliefs about ability and STEM major choice, I conduct a field experiment where I provide students with information that they are above average in their top fields of study. I find that STEM students are more likely to switch out of their major and that non-STEM students fail to switch into STEM at the same rates as other fields. I also find that learning you are above average in your… more →
Student-Teacher Ethnoracial Matching in the Earliest Grades: Benefits for Executive Function Skills
The benefits of student-teacher ethnoracial matching on student outcomes—ranging from academic achievement to postsecondary attainment—are well documented. Yet, we know far less about the role of student-teacher ethnoracial matching in the earliest grades school and on less about effects on non-academic outcomes. The purpose of this study is to advance our understanding of student-teacher… more →
Can Schools Change Religious Attitudes? Evidence from German State Reforms of Compulsory Religious Education
We study whether compulsory religious education in schools affects students' religiosity as adults. We exploit the staggered termination of compulsory religious education across German states in models with state and cohort fixed effects. Using three different datasets, we find that abolishing compulsory religious education significantly reduced religiosity of affected students in adulthood.… more →
Typologizing Teacher Practice: How Teachers Integrate Culturally Responsive, Ambitious, and Traditional Teaching Approaches
As states and districts expand their goals for equitable mathematics instruction to focus on cultural responsiveness and rigor, it is critical to understand how teachers integrate multiple teaching approaches. Drawing on survey data from a larger study of professional learning, we use mixture modeling to identify seven unique ways that middle school mathematics teachers integrate ambitious,… more →
Effective teacher professional development: new theory and a meta-analytic test
Multiple meta-analyses have now documented small positive effects of teacher professional development (PD) on pupil test scores. However, the field lacks any validated explanatory account of what differentiates more from less effective in-service training. As a result, researchers have little in the way of advice for those tasked with designing or commissioning better PD. We set out to remedy… more →
Student Misconduct and Learning Outcomes Evidence from Pennsylvania’s K-12 Building Records: 1999-2018
This paper compares and contrasts two required building level school violence measures under NCLB, arrests and incidents of well-defined school misconduct acts, across 20 years of Pennsylvania’s approximately 3,000 public school buildings. Generally, both arrests for school violence and incidents of school violence are rare events. Over 20 years, the third quartile arrest rate was zero and,… more →
Do Long Bus Rides Drive Down Academic Outcomes?
School buses may be a critical education policy lever, breaking the link between schools and neighborhoods and facilitating access to school choice. Yet little is known about the commute for bus riders, including the average length of the bus ride or whether long commutes harm academic outcomes. We begin to fill this gap using data from New York City to explore the morning commutes of over 120… more →
Is kindergarten ability group placement biased? New data, new methods, new answers
Half of kindergarten teachers split children into higher and lower ability groups for reading or math. In national data, we predicted kindergarten ability group placement using linear and ordinal logistic regression with classroom fixed effects. In fall, test scores were the best predictors of group placement, but there was bias favoring girls, high-SES (socioeconomic status) children, and… more →
College Major Restrictions and Student Stratification
Underrepresented minority (URM) college students have been steadily earning degrees in relatively less-lucrative fields of study since the mid-1990s. A decomposition reveals that this widening gap is principally explained by rising stratification at public research universities, many of which increasingly enforce GPA restriction policies that prohibit students with poor introductory grades… more →
Whose Turn Now? The Enactment & Expansion of Private School Choice Programs across the US
Private school choice policies have been enacted and expanded across the United States since the 1990s. By January 2021, 30 states plus the District of Columbia and Puerto Rico hosted 67 distinct private school choice policies. Why have some states adopted and expanded this education reform while others have demurred? Which states are more likely to adopt specific types of private school… more →
A Half Century of Progress in U. S. Student Achievement: Agency and Flynn Effects; Ethnic and SES Differences
Principals (policymakers) disagree as to whether U. S. student performance has changed over the past half century. To inform conversations, agents administered seven million psychometrically linked tests in math (m) and reading (rd) in 160 survey waves to national probability samples of cohorts born between 1954 and 2007. Estimated change in standard deviations (sd) per decade varies by agent… more →
Federal Stimulus Aid and School Finance: Lessons from the Great Recession
In 2009, the federal government passed the American Recovery and Reinvestment Act (ARRA) to combat the effects of the Great Recession and state revenue shortfalls, directing over $97 billion to school districts. In this chapter, we draw lessons from this distribution of fiscal stimulus funding to inform future federal intervention in school finance during periods of economic downturn. We find… more →
Do Refugee Students Affect the Academic Achievement of Peers? Evidence from a Large Urban School District
Policy debate on refugee resettlement focuses on perceived adverse effects on local communities, with sparse credible evidence to ascertain its impact. This paper examines whether attending school with refugees affects the academic outcomes of non-refugee students. Leveraging variation in the share of refugees within schools and across grades, I find that increasing the share of grade-level… more →
Optimal Allocation of Seats in the Presence of Peer Effects: Evidence from a Job Training Program
We consider the case in which the number of seats in a program is limited, such as a job training program or a supplemental tutoring program, and explore the implications that peer effects have for which individuals should be assigned to the limited seats. In the frequently-studied case in which all applicants are assigned to a group, the average outcome is not changed by shuffling the group… more →
Bridging human and machine scoring in experimental assessments of writing: tools, tips, and lessons learned from a field trial in education
In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This process is both time and labor-intensive, which… more →
Heterogeneity in High School Career and Technical Education Outcomes
High school Career and Technical Education (CTE) has received an increase in attention from both policymakers and researchers in recent years. This study fills a needed gap in the growing research base by examining heterogeneity within the wide range of programs falling under the broader CTE umbrella, and highlights the need for greater nuance in research and policy conversations that… more →