EdWorkingPapers
Advanced Placement and Initial College Enrollment: Evidence from an Experiment
To evaluate how Advanced Placement courses affect college-going, we randomly assigned the offer of enrollment into an AP science course to over 1,800 students in 23 schools that had not previously offered the course. We find no substantial AP course effects on students’ plans to enroll in college or on their college entrance exam scores. Yet AP course-takers enroll in less selective colleges… more →
The Segregation of Students by Income in Public Schools
Over the past three decades, children from low-income families and those from more affluent families have increasingly been attending different public schools. While recent work has helped us understand patterns of income segregation between districts and schools within districts, we know very little about segregation of students as they experience school: in the classroom. In this paper, we… more →
Within-Year Achievement Gains for English Learners
This study reports achievement levels and fall-to-spring gains in grades K to 8 for three groups of English Learners (ELs): (a) ever-ELs who were ever eligible for service; (b) current-ELs who continue to require service; and (b) dually-identified students eligible for both EL and Special Education services. I leverage unique data that include 186,139 ever-ELs and their never-EL peers in 1,520… more →
Growing up Homeless: Student Homelessness and Educational Outcomes in Los Angeles
Homelessness is rising among public school students in large cities across the US. Using nine years of student-level administrative data, we examine how homelessness affects students’ mathematics and attendance outcomes within the Los Angeles Unified School District, including the differential effects of homelessness based on duration and timing of their homeless experiences. Results using… more →
Does Peer Motivation Impact Educational Investments? Evidence From DACA
Despite the significant influence that peer motivation is likely to have on educational investments during high school, it is difficult to test empirically since exogenous changes in peer motivation are rarely observed. In this paper, I focus on the 2012 introduction of Deferred Action for Childhood Arrivals (DACA) to study a setting in which peer motivation changed sharply for a subset of… more →
A Descriptive Analysis of Cream Skimming and Pushout in Choice versus Traditional Public Schools
One of the controversies surrounding charter schools is whether these schools may either “cream skim” high-performing students from traditional public schools or “pushout” low-achieving students or students with discipline histories, leaving traditional public schools to educate the most challenging students. We use these terms strictly for brevity and acknowledge that many of the reasons that… more →
The Disciplinary Differences in the Characteristics And Effects of Non-Tenure-Track Faculty
Using data with detailed instructor employment information from a state college system, this study examines disciplinary variations in the characteristics and effects of non-tenure-track faculty hired through temporary and long-term employment. We identify substantial differences in the demographic and employment characteristics between the two types of non-tenure-line faculty, where the… more →
Parental Resources and College Attendance: Evidence from Lottery Wins
We examine U.S. children whose parents won the lottery to trace out the effect of financial resources on college attendance. The analysis leverages federal tax and financial aid records and substantial variation in win size and timing. While per-dollar effects are modest, the relationship is weakly concave, with a high upper bound for amounts greatly exceeding college costs. Effects are… more →
How Much Does Teacher Quality Vary Across Teacher Preparation Programs? Reanalyses from Six States
At least sixteen US states have taken steps toward holding teacher preparation programs (TPPs) accountable for teacher value-added to student test scores. Yet it is unclear whether teacher quality differences between TPPs are large enough to make an accountability system worthwhile. Several statistical practices can make differences between TPPs appear larger and more significant than they are… more →
Vocational Education: An International Perspective
Vocational education is formal education about work, and vocational programs of study typically target a narrow subset of middle-income occupations. In this chapter, we trace vocational education from competing 20th century education philosophies to its varied structures throughout the 21st century world. We then review the body of economic research on labor market returns to vocational… more →
The Three R’s of Teacher Pension Funding: Redistribution, Return, and Risk
How are teacher pension benefits funded? Under traditional plans, the full cost of a career teacher’s benefits far exceeds the contributions designated for them. The gap between the two has three pieces, which may (with some license) be mnemonically tagged the three R’s of pension funding: Redistribution, Return, and Risk. First, some… more →
Informing school-choosing families about their options: A field experiment from New Orleans
In order for school choice reforms to fulfill their potential, school choosers must be informed about their options. We conducted a randomized controlled trial during the school choice application period in New Orleans to assess the effects of providing information to parents. Families with children entering pre-K, kindergarten, or ninth grade were assigned to one of two treatment groups or a… more →
Capacity and flexibility in community college CTE programs: program offerings and student success
This article asks whether small changes to community college courses and programs can help improve student outcomes. We use administrative data from the California Community College system, including millions of student records and detailed course-level information for most career-technical education programs in the state. We construct a summary measure of each program’s flexibility,… more →
Ordinal Approaches to Decomposing Between-group Test Score Disparities
The estimation of test score “gaps” and gap trends plays an important role in monitoring educational inequality. Researchers decompose gaps and gap changes into within- and between-school portions to generate evidence on the role schools play in shaping these inequalities. However, existing decomposition methods assume an equal-interval test scale and are a poor fit to coarsened data such as… more →
The Opioid Crisis and Educational Performance
The opioid crisis is widely recognized as one of the most important public health emergencies of our time, and an issue that is particularly acute for rural communities. We propose a simple model of how opioids in a community can impact the education outcomes of children based on both the extent of exposure to opioids in the community and the child’s vulnerability to any given level of… more →
Higher-Quality Elementary Schools Sustain the Prekindergarten Boost: Evidence from an Exploration of Variation in the Boston Prekindergarten Program’s Impacts
While there is a consensus that attending preschool better prepares children for kindergarten, evidence on the factors that sustain the preschool boost into the early elementary years is still emerging. To add to this literature, we use lottery data from applicants to oversubscribed schools in Boston Public Schools (BPS) prekindergarten program to estimate variation in the effects of the… more →
The Effects of Financial Aid Loss on Persistence and Graduation: A Multi-Dimensional Regression Discontinuity Approach
For years Georgia's HOPE Scholarship program provided full tuition scholarships to high achieving students. State budgetary shortfalls reduced its generosity in 2011. Under the new rules, only students meeting more rigorous merit-based criteria would retain the original scholarship covering full tuition, now called Zell Miller, with other students seeing aid reductions of approximately 15… more →
Learning Lessons from Instruction: Descriptive Results from an Observational Study of Urban Elementary Classrooms
Background:
For nearly three decades, policy-makers and researchers in the United States have promoted more intellectually rigorous standards for mathematics teaching and learning. Yet, to date, we have limited descriptive evidence on the extent to which reform-oriented instruction has been enacted at scale.Purpose:
The purpose of the study is… more →Rent-Seeking through Collective Bargaining: Teachers Unions and Education Production
We explore how teachers unions affect education production by comparing outcomes between districts allocating new tax revenue amidst collective bargaining negotiations and districts allocating tax revenue well before. Districts facing union pressure increase teacher salaries and benefits, spend down reserves, and experience no student achievement gains. Conversely, districts facing less… more →
The Effect of Course Shutouts on Community College Students: Evidence from Waitlist Cutoffs
One frequently cited yet understudied channel through which money matters for college students is course availability- colleges may respond to budgetary pressure by reducing course offerings. Open admissions policies, binding class size constraints, and heavy reliance on state funding may make this channel especially salient at community colleges, which enroll 47% of U.S. undergraduates in… more →
Teachers’ Willingness To Pay For Retirement Benefits: A National Stated Preferences Experiment
Many states have recently made or are considering changes to their teacher retirement systems. However, little is known about how teachers value various elements of their retirement benefits versus other aspects of their jobs and compensation. To help alleviate this gap, we use a discrete choice stated preferences experiment embedded in a nationally representative survey of teachers to… more →
Using Semantic Similarity to Assess Adherence and Replicability of Intervention Delivery
Researchers are rarely satisfied to learn only whether an intervention works, they also want to understand why and under what circumstances interventions produce their intended effects. These questions have led to increasing calls for implementation research to be included in high quality studies with strong causal claims. Of critical importance is determining… more →
The Effect of Charter Schools on School Segregation
We conduct a comprehensive examination of the causal effect of charter schools on school segregation, using a triple differences design that utilizes between-grade differences in charter expansion within school systems, and an instrumental variable approach that leverages charter school opening event variation. Charter schools increase school segregation for Black, Hispanic, White, and Asian… more →
State Investment in Higher Education: Effects on Human Capital Formation, Student Debt, and Long-Term Financial Outcomes of Students
Most public colleges and universities rely heavily on state financial support. As state budgets have tightened in recent decades, appropriations for higher education have declined substantially. Despite concerns expressed by policymakers and scholars that the declines in state support have reduced the return to education investment for public sector students, little evidence exists that can… more →
The Impact of Merit Aid on College Choice and Degree Attainment: Reexamining Florida’s Bright Futures Program
We replicate and extend prior work on Florida’s Bright Futures merit aid scholarship to consider its effect on college enrollment and degree completion. We estimate causal impacts using a regression discontinuity design to exploit SAT thresholds that strongly determine eligibility. We find no positive impacts on attendance or attainment, and instrumental variable results generally reject… more →
Politics, Markets, and Pandemics: Public Education’s Response to COVID-19
The COVID-19 pandemic presents a unique opportunity to examine how local governments respond to a public health crisis amid high levels of partisan polarization and an increasing tendency for local issues to become nationalized. As an arena that has, in recent years, been relatively separate from national partisan divides, public schools provide a useful window into these dynamics. Leveraging… more →
The Effects of Absenteeism on Cognitive and Social-Emotional Outcomes: Lessons for COVID-19
In March 2020, most schools in the United States closed their doors and transitioned to distance learning in an effort to contain COVID-19. During the transition a significant number of students did not fully engage in these learning opportunities due to resource or other constraints. An urgent question for schools around the nation is how much did the pandemic impact student academic and… more →
An Evaluation of Credit Recovery as an Intervention for High School Students Who Fail Courses
Credit recovery (CR) refers to online courses that high school students take after previously failing the course. Many have suggested that CR courses are helping students to graduate from high school without corresponding increases in academic skills. This study analyzes administrative data from the state of North Carolina to evaluate these claims using full data from public and private CR… more →
Happy Together? The Peer Effects of Dual Enrollment Students on Community College Student Outcomes
Nationally, 15% of first-time community college students were high school dual enrollment (DE) students, which raises concerns about how high school peers might influence college enrollees. Using administrative data from a large state community college system, we examine whether being exposed to a higher percentage of DE peers in entry-level (gateway) math and English courses influences non-DE… more →
Dual Language Education and Academic Growth
This paper reports math and reading academic achievement and growth in grades 2 to 8 for Hispanic participants and nonparticipants of a Spanish-English dual language program. I apply a piecewise multilevel growth model to administrative data from a large school district that enrolls a substantial English Learner student population. Dual language participants started 2nd grade with lower… more →
Education Leaders’ Knowledge of Causal Research Design: A Measurement Challenge
Federal policy has both incentivized and supported better use of research evidence by educational leaders. However, the extent to which these leaders are well-positioned to understand foundational principles from research design and statistics, including those that underlie the What Works Clearinghouse ratings of research studies, remains an open question. To investigate educational… more →
The Effect of the Community Eligibility Provision on the Ability of Free and Reduced-Price Meal Data to Identify Disadvantaged Students
The Community Eligibility Provision (CEP) is a policy change to the federally-administered National School Lunch Program that allows schools serving low-income populations to classify all students as eligible for free meals, regardless of individual circumstances. This has implications for the use of free and reduced-price meal (FRM) data to proxy for student disadvantage in education research… more →
Can Technology Transform Communication between Schools, Teachers, and Parents? Evidence from a Randomized Field Trial
We study the adoption and implementation of a new mobile communication app among a sample of 132 New York City public schools. The app provides a platform for sharing general announcements and news as well as engaging in personalized two-way communication with individual parents. We provide participating schools with free access to the app and randomize schools to receive intensive support (… more →
Nudges Don’t Work When the Benefits Are Ambiguous: Evidence from a High-Stakes Education Program
The Post-9/11 GI Bill allows service members to transfer generous education benefits to a dependent. We run a large scale experiment that encourages service members to consider the transfer option among a population that includes individuals for whom the transfer benefits are clear and individuals for whom the net-benefits are significantly more ambiguous. We find no impact of a one-time email… more →
The Dynamic Effects of a Summer Learning Program on Behavioral Engagement in School
The evidence that student learning declines sharply (or stagnates) during the summer has motivated a substantial interest in programs that provide intensive academic instruction during the summer. However, the existing literature suggests that such programs, which typically focus on just one or two subjects, have modest effects on students’ achievement and no impact on measures of their… more →
Promises and limitations of nudging in education
This article takes stock of where the field of behavioral science applied to education policy seems to be at, which avenues seem promising and which ones seem like dead ends. I present a curated set of studies rather than an exhaustive literature review, categorizing interventions by whether they nudge (keep options intact) or “shove” (restrict choice), and whether they apply a high or low… more →
Best and Brightest? The Impact of Student Visa Restrictiveness on Who Attends College in the US
Recent immigration policies have created massive uncertainty for international students to obtain F-1 visas. Yet, before the COVID-19 pandemic, student visa applicants already faced an approximately 27 percent refusal rate that varies by time and region. Using data on the universe of SAT takers between 2004 and 2015 matched with college enrollment records, we examine how the anticipated F-1 visa… more →
How Can Released State Test Items Support Interim Assessment Purposes in an Educational Crisis?
State testing programs regularly release previously administered test items to the public. We provide an open-source recipe for state, district, and school assessment coordinators to combine these items flexibly to produce scores linked to established state score scales. These would enable estimation of student score distributions and achievement levels. We discuss how educators can use… more →
The Economic Impacts of Learning Losses
The worldwide school closures in early 2020 led to losses in learning that will not easily be made up for even if schools quickly return to their prior performance levels. These losses will have lasting economic impacts both on the affected students and on each nation unless they are effectively remediated.
While the precise learning losses are not yet known, existing research suggests… more →
Can Community Crime Monitoring Reduce Student Absenteeism?
In this paper we study the impact on student absenteeism of a large school-based community crime monitoring program that employed local community members to monitor and report crime on designated city blocks during students’ travel to and from school. We find that the program resulted in a 0.78 percentage point reduction in the school-level absence rate (11 percent effect). We explore two… more →
Comprehensive Support and Student Success: Can Out of School Time Make a Difference?
StudentU is a comprehensive program that provides education, nutrition, and social support services to disadvantaged students outside of the regular school day. In this paper I investigate the effects of this multi-year program on the early high school outcomes of participating students by exploiting data from oversubscribed admissions lotteries. I estimate that lottery winners who entered the… more →
Immigrant Integration in the United States: The Role of Adult English Language Training
While current debates center on whether and how to admit immigrants to the United States, little attention has been paid to interventions designed to help immigrants integrate after they arrive. Public adult education programs are the primary policy lever for building the language skills of the over 23 million adults with limited English proficiency in the United States. We leverage the… more →
Examining the Relationship between Psychosocial and Academic Outcomes in Higher Education: A Descriptive Analysis
This paper estimates the relationship between students’ psychosocial and academic outcomes during their first three years enrolled at public, four-year institutions. Our sample is comprised of students from low-income backgrounds who applied for a competitive scholarship and enrolled at a four-year public institution. We follow two cohorts of entering students throughout their first three… more →
Examining STEM Performance within a Comprehensive College Transition Program
We examine the impact of the Thompson Scholars Learning Community (TSLC), a comprehensive college transition program serving students with a variety of majors, on students’ science, technology, engineering, and math (STEM)-related outcomes. We use an explanatory mixed-methods design, which prioritizes the quantitative analyses and uses qualitative analyses to contextualize and explain our… more →
What Factors Drive Individual Misperceptions of the Returns to Schooling in Tanzania? Some Lessons for Education Policy
Evidence on educational returns and the factors that determine the demand for schooling in developing countries is extremely scarce. We use two surveys from Tanzania to estimate both the actual and perceived schooling returns and subsequently examine what factors drive individual misperceptions regarding actual returns. Using ordinary least squares and instrumental variable methods, we find… more →
An Experimental Evaluation of Arts Field Trips
This paper presents results of a multi-visit, longitudinal experiment on the academic and social-emotional effects of arts-based field trips. We randomly assign fourth and fifth grade students to receive arts-based field trips throughout the school year or to serve as a control. Treatment students express greater tolerance for people with different opinions and a desire to consume arts.… more →
More Than Shortages: The Unequal Distribution of Substitute Teaching
Classroom teachers in the US are absent on average approximately six percent of a school year. Despite the prevalence of teacher absences, surprisingly little research has assessed the key source of replacement instruction: substitute teachers. Using detailed administrative and survey data from a large urban school district, we document the prevalence, predictors, and variation of substitute… more →
The Importance of Cognitive Domains and the Returns to Schooling in South Africa: Evidence from Two Labor Surveys
Numerous studies have considered the important role of cognition in estimating the returns to schooling. How cognitive abilities affect schooling may have important policy implications, especially in developing countries during periods of increasing educational attainment. Using two longitudinal labor surveys that collect direct proxy measures of cognitive skills, we study the importance of… more →
Disproportionate Burden: Estimating the Cost of FAFSA Verification for Public Colleges and Universities
Verification is a federally mandated process that requires selected students to further attest that the information reported on their FAFSA is accurate and complete. In this brief, we estimate institutional costs of administrating the FAFSA verification mandate and consider variation in costs by institution type and sector. Using data from 2014, we estimate that compliance costs to… more →
Test-Based Accountability and the Effectiveness of School Finance Reforms
A recent literature provides new evidence that school resources are important for student outcomes. In this paper, we show that school finance reform-induced increases in student performance are driven by those states that had test-based accountability policies in place at the time. By incentivizing school improvement, accountability systems (such as the federal No Child Left Behind act) may… more →