Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Henry T. Woodyard, Tim R. Sass, Ishtiaque Fazlul.

Numerous studies have demonstrated a strong link between participation in pre-K programs and both short-term student achievement and positive later-life outcomes.  Existing evidence primarily stems from experimental studies of small-scale, high-quality programs conducted in the 1960s and 1970s and analyses of the federal Head Start program.  Meanwhile, evidence on state-funded pre-K programs, with no income restrictions, is scant and inconclusive.  Using enrollment lotteries for over-subscribed school-based sites in Georgia’s universal pre-K program, we analyze the impact of participation on elementary school outcomes.  Lottery winners enter kindergarten more prepared in both math and reading than non-winning peers. Gains fade by the end of kindergarten, and some negative achievement effects emerge by grade 4. Free-and-reduced-price meal (FRPM) students benefit more compared to non-FRPM students in later grades, suggesting greater benefits from attendance for disadvantaged students.  Although we find no effects for discipline, lottery winners had one fewer absence each grade after kindergarten.

More →


Justin C. Ortagus, Rodney Hughes, Hope Allchin.

This study leverages national data and a quasi-experimental design to examine the influence of enrolling in an exclusively online degree program on students’ likelihood of completing their degree. We find that enrolling in an exclusively online degree program had a negative influence on students’ likelihood of completing their bachelor’s degree or any degree when compared to their otherwise-similar peers who enrolled in at least some face-to-face courses. The negative relationship between exclusively online enrollment and students’ likelihood of bachelor’s degree completion was relatively consistent among White, Black, Hispanic, Asian, low-income, and military students. Findings focused solely on those students enrolled in exclusively online degree programs revealed that the negative influence of exclusively online enrollment was exacerbated when the student attended a for-profit four-year institution.

More →


Quentin Brummet, Lindsay Liebert, Thurston Domina, Paul Yoo, Andrew Penner.

Although existing research suggests that students benefit on a range of outcomes when they enroll in early algebra classes, policy efforts that accelerate algebra enrollment for large numbers of students often have negative effects. Explanations for this apparent contradiction often emphasize the potential role of teacher and peer effects, which could create positive effects for individual students placed into early algebra that would not translate to larger-scale policies. We use detailed data from Oregon that contain information on the teachers and peers to whom students are exposed in order to investigate these explanations. Our regression discontinuity analyses replicate key findings from prior studies, indicating that placement in eighth-grade algebra boosts student achievement in math and English language arts. We then demonstrate that eighth-grade algebra placement positively affects the achievement level of students’ classmates, as well as the years of experience and value added of students’ math teachers. The effects on peer composition that we observe are large enough to plausibly explain the majority of the effects of eighth-grade algebra on student test scores.

More →


Lam D. Pham, Gage F. Matthews, Timothy A. Drake.

While multiple studies have examined the impact of school turnaround, less is known about reforms under the Every Student Succeeds Act (ESSA). To advance this literature, we examine North Carolina’s Restart (NCR) model. NCR aligns with ESSA by giving school leaders increased flexibility. Also, NCR differs from previous turnaround models by repackaging a traditionally sanction-based approach to instead motivate school leaders with increased autonomy. Using comparative interrupted time series models, we find positive NCR effects in math, but not in English Language Arts or on non-test-based student outcomes. Also, nearly a quarter of the positive NCR effect can be explained by decreased teacher and principal turnover. These results provide evidence to support current shifts toward reform models featuring local autonomy.

More →


Dorottya Demszky, Jing Liu, Heather C. Hill, Shyamoli Sanghi, Ariel Chung.

While recent studies have demonstrated the potential of automated feedback to enhance teacher instruction in virtual settings, its efficacy in traditional classrooms remains unexplored. In collaboration with TeachFX, we conducted a pre-registered randomized controlled trial involving 523 Utah mathematics and science teachers to assess the impact of automated feedback in K-12 classrooms. This feedback targeted “focusing questions” – questions that probe students’ thinking by pressing for explanations and reflection. Our findings indicate that automated feedback increased teachers’ use of focusing questions by 20%. However, there was no discernible effect on other teaching practices. Qualitative interviews revealed mixed engagement with the automated feedback: some teachers noticed and appreciated the reflective insights from the feedback, while others had no knowledge of it. Teachers also expressed skepticism about the accuracy of feedback, concerns about data security, and/or noted that time constraints prevented their engagement with the feedback. Our findings highlight avenues for future work, including integrating this feedback into existing professional development activities to maximize its effect.

More →


Zid Mancenido, Heather C. Hill, Jeannette Garcia Coppersmith, Hannah Carter, Cynthia Pollard, Chris Monschauer.

Practice-based teacher education has increasingly been adopted as an alternative to more traditional, conceptually-focused pedagogies, yet the field lacks causal evidence regarding the relative efficacy of these approaches. To address this issue, we randomly assigned 185 college students to one of three experimental conditions reflective of common conceptually-focused and practice-based teacher preparation pedagogies. We find significant and large positive effects of practice-based pedagogies on participants’ skills in eliciting and responding to student thinking as demonstrated through a written assessment and a short teaching episode. Our findings contribute to a developing evidence base that can assist policymakers and teacher educators in designing effective teacher preparation at scale.

More →


Xi Yang, Jian Zou.

This paper studies how school spending impacts student achievement by exploiting the US interstate branching deregulation as state tax revenue shocks. Leveraging school finance data from universal school districts, our difference-in-differences estimation reveals that deregulation leads to an increase in per-pupil total revenue and expenditure. The rise in revenue is primarily attributed to higher state revenues, while the expenditure increase is more prominent in low-income school districts. Using restricted-use student assessments from the Nation’s Report Card, we find that deregulation results in improved student achievement, with no distributional effects evident across students’ ability, race, or free lunch status. We introduce an instrumental variables approach that accounts for dynamic treatment effects and estimate that a one-thousand-dollar increase in per-pupil spending leads to a 0.035 standard deviation improvement in student achievement.

More →


Jing Liu, Megan Kuhfeld, Monica Lee.

Noncognitive constructs such as self-e cacy, social awareness, and academic engagement are widely acknowledged as critical components of human capital, but systematic data collection on such skills in school systems is complicated by conceptual ambiguities, measurement challenges and resource constraints. This study addresses this issue by comparing the predictive validity of two most widely used metrics on noncogntive outcomes|observable academic behaviors (e.g., absenteeism, suspensions) and student self-reported social and emotional learning (SEL) skills|for the likelihood of high school graduation and postsecondary attainment. Our  ndings suggest that conditional on student demographics and achievement, academic behaviors are several-fold more predictive than SEL skills for all long-run outcomes, and adding SEL skills to a model with academic behaviors improves the model's predictive power minimally. In addition, academic behaviors are particularly strong predictors for low-achieving students' long-run outcomes. Part-day absenteeism (as a result of class skipping) is the largest driver behind the strong predictive power of academic behaviors. Developing more nuanced behavioral measures in existing administrative data systems might be a fruitful strategy for schools whose intended goal centers on predicting students' educational attainment.

More →


Kristen Shure, Zach Weingarten.

Decentralized matching markets experience high rates of instability due to information frictions. This paper explores the role of these frictions in one of the most unstable markets in the United States, the labor market for first-year school teachers. We develop and estimate a dynamic model of labor mobility that considers non-pecuniary information frictions directly. We find that teachers overestimate the value of hidden amenities and their own preferences for teaching. Improving access to information improves stability by 12% and reduces between-school switching by 18%, but reduces teacher labor supply by over 5%. Compared to each tested alternative, including targeted wage premiums at hard-to-staff schools, bonuses that incentivize retention, and lowered tenure requirements, information revelation improves match quality most.

More →


Walter G. Ecton.

Career and Technical Education (CTE) has long played a substantial, though controversial, role within America’s public schools. While supporters argue that CTE may increase student engagement and prepare students for success in the workforce, detractors caution that CTE may inhibit students’ access to the rigorous academic coursework needed for college and high-status careers. As students’ time in high school is a relatively fixed resource, this paper seeks to better understand the extent to which CTE is associated with trade-offs within students’ high school curricula. Using a robust statewide longitudinal data system, this study explores the extent to which CTE may limit course taking in a wide range of subjects (including core academic subjects, electives, and Advanced Placement courses). Special attention is paid to how curricular trade-offs may occur differently among different student populations, keeping in mind the legacy of tracking as a long-employed mechanism for reducing opportunity. On average, results indicate that CTE courses do crowd out students’ enrollment in non-CTE elective areas, but that CTE does not lead to large declines in college preparatory coursetaking, though there are nuances for certain student populations. Overall, these findings counter longstanding narratives that CTE participation limits student access to college preparatory coursework.

More →