Program and policy effects

This research analyzes the implementation of a school suspension ban in Maryland to investigate whether a top-down state-initiated ban on suspensions in early primary grades can influence school behavior regarding school discipline. Beginning in the fall of 2017, the State of Maryland banned the use of out-of-school suspensions for grades PK-2, unless a student posed an “imminent threat” to staff or students. This research investigates (1) what was the effect of the ban on discipline outcomes for students in both treated grades and upper elementary grades not subject to the ban? (2) did schools bypass the ban by coding more events as threatening or increasing the use of inschool suspensions? and (3) were there differential effects for students in groups that are historically suspended more often? Using a comparative interrupted time series strategy, we find that the ban is associated with a substantial reduction in, but not a total elimination of, out-ofschool suspensions for targeted grades without substitution of in-school suspensions. Disproportionalities by race and other characteristics remain after the ban. Grades not subject to the ban experienced few effects, suggesting the ban did not trigger a schoolwide response that reduced exclusionary discipline.

More →

Public school systems across the U.S. have made major investments in tutoring to support students’ academic recovery in the wake of the COVID-19 pandemic. We evaluate a large urban district’s efforts to design, implement, and scale a district-operated, standards-based tutoring program across three years. We draw on extensive interviews and survey data to document the dynamic changes in the program as Metro Nashville Public Schools integrated core operations into its leadership and school structures, expanded tutor supply by pivoting from a volunteer to a teacher-based staffing model, and addressed scheduling constraints by offering tutoring immediately before and after school in addition to during the school day. The district steadily scaled the program across two years, delivering over 125,000 total hours of tutoring to more than 6,800 students while also increasing dosage each semester. Using a collection of experimental and quasi-experimental designs, we find consistent evidence of a small to medium average positive effect on students’ reading test scores (0.04 to 0.09 standard deviations), but no average effects on math test scores or course grades in either subject. We discuss four possible explanations for these results, including a limited treatment-control contrast, modest program duration, heterogeneous effects, and miscalibrated expectations of tutoring effects at scale.

More →

Racial disparities in infant health conditions have persisted for decades. However, there is surprisingly limited evidence regarding the long-term consequences of these disparities. Using novel linked administrative data from Texas and the shift to Medicaid Managed Care (MMC), I show that MMC-driven declines in infant health worsened cognitive and noncognitive outcomes for Black children, while MMC-driven enhancements in infant health improved noncognitive outcomes and educational attainment for Hispanics. Effects concentrate in low-value added districts for either demographic, suggesting that the long run impacts of changes to early life health conditions are more pronounced in less effective schools for one’s demographic. 

More →

Researchers and policymakers aspire for educational interventions to change children’s long-run developmental trajectories. However, intervention impacts on cognitive and achievement measures commonly fade over time. Less is known, although much is theorized, about socialemotional skill persistence. The current meta-analysis investigated whether intervention impacts on social-emotional skills demonstrated greater persistence than impacts on cognitive skills. We drew studies from eight pre-existing meta-analyses, generating a sample of 86 educational RCTs targeting children from infancy through adolescence, together involving 56,662 participants and 450 outcomes measured at post-test and at least one follow-up. Relying on a meta-regression approach for modeling persistence rates, we tested the extent to which post-test impact magnitudes predicted follow-up impact magnitudes. We found that post-test impacts were equally predictive of follow-up impacts for cognitive and social-emotional skills at 6- to 12- months follow-up, indicating similar conditional persistence rates across skill types. At 1- to 2- years follow-up, rates were lower and, if anything, cognitive skills showed greater conditional persistence than social-emotional skills. A small positive follow-up effect was observed, on average, beyond what was directly predicted by the post-test impact, indicating that interventions may have long-term effects that are not fully mediated by post-test effects. This pattern of results implied that smaller post-test impacts produced more persistent effects than larger post-test impacts, and social-emotional skill impacts were smaller, on average, than cognitive skill impacts. Considered as a whole, intervention impacts on both social-emotional and cognitive skills demonstrated fadeout, especially for interventions that produced larger initial effects. Implications for theory and future directions are discussed.

More →

This paper reports findings from a nationally representative survey of K-12 teachers in May 2023 that examines the potential long-term impacts of COVID-19 on public schooling. The findings suggest fundamental ways in which school operations, instructional practice and parent-teacher interaction have changed since the pandemic. Some changes seem promising; others suggest caution. While policymakers may not be able to directly influence some of the reported changes in the short run, monitoring the evolution of school practices (and their consequences for children) will position educational leaders to help teachers and students address the consequences of the COVID-19 pandemic going forward.

More →

The immediate impacts of COVID-19 on K12 schooling are well known. Over nearly 18 months, students’ academic performance and mental health deteriorated dramatically. This study aims to identify if and how the pandemic led to longer-term changes in core aspects of schooling. Drawing on semi-structured interviews with 31 teachers and administrators across 12 districts in two states, we find that schools today look quite different in several areas including the availability and use of instructional technology, instructional practice, parent-teacher communication, and the balance between academics and social-emotional well-being. We interpret these findings through the lens of institutional theory, and discuss implications of the changes for practitioners and policymakers.

More →

This study examines the effects of universal public pre-kindergarten for 3-year-olds (Pre-K3) on later public education outcomes, including enrollment, school mobility, special education status, and in-grade retention from kindergarten through second grade. While universal pre-kindergarten programs typically target 4-year-olds, interest in expanding to 3-year-olds is growing. Using the centralized assignment lottery in the District of Columbia as the basis for a quasi-experimental design, we find that Pre-K3 students are more likely to persist in the public system and remain in the same school. These effects are strongest for residents of low-income neighborhoods and communities of color and for students enrolled in dual language programs. Overall, public Pre-K3 appears to stabilize children’s early educational experiences, especially those starting furthest from opportunity.

More →

Currently 15 percent of U.S. students receive special education services, a widespread intensive intervention with variable effects on students. Spurred by changes in federal policy, many states and districts have begun adopting the Response to Intervention (RTI) approach to identifying students to receive special education services. RTI seeks to provide a system for targeting interventions to children facing early academic challenges and identifying children with specific learning disabilities (SLD). This paper uses a difference-in-differences design to examine the effects of RTI adoption across Oregon on elementary students’ disability identification and state-standardized achievement test scores. RTI adoption reduced special education identification by 1.4 percentage points (11%) and SLD identification by 0.5 percentage points (15%). RTI also caused moderately large reading test score gains for Black students (0.15 SD) and did not reduce other students’ achievement. These findings suggest RTI is a promising approach to supporting struggling students.

More →

A digital information explosion has transformed cities’ residential and educational markets in ways that are still being uncovered. Although urban stratification scholars have increasingly scrutinized whether emerging digital platforms disrupt or reproduce longstanding segregation patterns, direct links between one theoretically important form of digital information– school quality data– and neighborhood and school segregation are rarely drawn. To clarify these dynamics, we leverage an exogenous digital information shock, in which the Los Angeles Times’ website revealed measures of a particularly important school quality proxy– schools’ value-added effectiveness– for nearly all elementary schools in the Los Angeles Unified School District. Results suggest that although the information shock had no detectable effects on residential sorting or neighborhood racial segregation, it did exert modest effects on school sorting—particularly for Latino and Asian students— albeit not in ways that materially diminished school racial segregation because the racial compositions of high- and low value-added schools were broadly similar both before and after the information shock. We conclude that the urban stratification implications of digital information may be more nuanced than often appreciated, with effects shaped by racial heterogeneity in both constraints and preferences vis-à-vis specific types of information and operating through mechanisms beyond residential segregation.

More →

Recent policies have expanded the availability of career-focused advising in high schools, including for students pursuing career and technical education (CTE) courses of study who might not have been adequately served by traditional college-focused advising. However, there is limited research on the effects of these policies. This study examines the implementation and impacts of career-focused advising in the context of North Carolina’s career coaching program, which places community college staff on select high school campuses to provide guidance around career pathways and high school coursetaking that can prepare students for those pathways. Using descriptive analysis and interviews, we found that the program connected students with information about career opportunities as well as about the state’s dual enrollment program, which can help students to get a jumpstart on earning a credential while still in high school. We used two quasiexperimental methods to analyze the impacts of the program. Our school-level event study analysis found that a school receiving a career coach increased the rate of participation in the dual enrollment program, on average, and may result in an increase in students intending to directly enter the workforce after high school and a decrease in four-year college enrollment. Our student-level propensity score-weighting analysis found that students who met with the career coaches took slightly more CTE dual enrollment courses in high school and were more likely to enroll at two-year colleges after high school than similar students who did not meet with a coach.

More →