Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Xin Li, Liping Ma, Xiaoyang Ye, Qiong Zhu.

This paper provides one of the first natural experimental evidence on the consequences of a transition from college-major (early specialization) to college-then-major (late specialization) choice mechanism. Specifically, we study a recent reform in China that allows college applicants to apply to a meta-major consisting of different majors and to declare a specialization late in college instead of applying to a specific major. Using administrative data over 18 years on the universe of college applicants in a Chinese province, we examine the impacts of the staggered adoption of the reform across institutions on student composition changes. We find substantial heterogeneous effects across institutions and majors despite the aggregate null effects. This paper provides important policy implications regarding college admissions mechanism designs.

More →


Liping Ma, Xin Li, Qiong Zhu, Xiaoyang Ye.

One of the most important mechanism design policies in college admissions is to let students choose a college major sequentially (college-then-major choice) or jointly (college-major choice). In the context of the Chinese meta-major reforms that transition from college-major choice to college-then-major choice, we provide the first experimental evidence on the information frictions and heterogeneous preferences that students have in their response to the meta-major option. In a randomized experiment with a nationwide sample of 11,424 high school graduates, we find that providing information on the benefits of a meta-major significantly increased students’ willingness to choose the meta major; however, information about specific majors and assignment mechanisms did not affect student major choice preferences. We also find that information provision mostly affected the preferences of students who were from disadvantaged backgrounds, lacked accurate information, did not have clear major preferences, or were risk loving.

More →


Julie Edmunds, Fatih Unlu, Brian Phillips, Bryan Hutchins, Christine Mulhern.

Recent policy efforts have attempted to increase the number of dual enrollment courses offered within Career and Technical Education pathways and there is evidence to suggest that this practice is widespread. However, there is very little research on student participation in CTE dual enrollment and on its impacts. This study examines participation in the CTE dual enrollment pathway in North Carolina, finding that about 9% of North Carolina students participated in CTE dual enrollment courses in 11th or 12th grade and disparities in participation among subgroups were less than for college transfer dual enrollment courses. Using a quasi-experimental approach to examine the effect of the program, the study found that participation is CTE was positively associated with college credits earned in high school, graduation from high school, and overall enrollment in college within one year after high school. The study also examined results by subgroup.

More →


David M. Houston, Matthew P. Steinberg.

In spring 2020, nearly every U.S. public school closed at the onset of the Covid-19 pandemic. Existing evidence suggests that local political partisanship and teachers union strength were better predictors of fall 2020 school re-opening status than Covid case and death rates. We replicate and extend these analyses using data collected over the 2020-21 academic year. We demonstrate that Covid case and death rates were meaningfully associated with initial rates of in-person instruction. We also show that all three factors—Covid, partisanship, and teachers unions—became less predictive of in-person instruction as the school year continued. We then leverage data from two nationally representative surveys of Americans’ attitudes toward education and identify an as-yet undiscussed factor that predicts in-person instruction: public support for increasing teacher salaries. We speculate that education leaders were better able to manage the logistical and political complexities of school re-openings in communities with greater support for educators.

More →


NaYoung Hwang, Cory Koedel.

We evaluate the effects of grade retention on students’ academic, attendance, and disciplinary outcomes in Indiana. Using a regression discontinuity design, we show that third grade retention increases achievement in English Language Arts (ELA) and math immediately and substantially, and the effects persist into middle school. We find no evidence of grade retention effects on student attendance or disciplinary incidents, again into middle school. Our findings combine to show that Indiana’s third grade retention policy improves achievement for retained students without adverse impacts along (measured) non-academic dimensions.

More →


Eric S. Taylor.

When an employee expects repeated evaluation and performance incentives over time, the potential future rewards create an incentive to invest in building relevant skills. Because new skills benefit job performance, the effects of an evaluation program can persist after the rewards end or even anticipate the start of rewards. I test for persistence and anticipation effects, along with more conventional predictions, using a quasi-experiment in Tennessee schools. Performance improves with new evaluation measures, but gains are larger when the teacher expects future rewards linked to future scores. Performance rises further when incentives start and remains higher even after incentives end.

More →


Darryl V. Hill, Rodney Hughes, Matthew A. Lenard, David D. Liebowitz, Lindsay C. Page.

Policy makers periodically consider using student assignment policies to improve educational outcomes by altering the socio-economic and academic skill composition of schools. We exploit the quasi-random reassignment of students across schools in the Wake County Public School System to estimate the academic and behavioral effects of being reassigned to a different school and, separately, of shifts in peer characteristics. We rule out all but substantively small effects of transitioning to a different school as a result of reassignment on test scores, course grades and chronic absenteeism. In contrast, increasing the achievement levels of students' peers improves students' math and ELA test scores but harms their ELA course grades. Test score benefits accrue primarily to students from higher-income families, though students with lower family income or lower prior performance still benefit. Our results suggest that student assignment policies that relocate students to avoid the over-concentration of lower-achieving students or those from lower-income families can accomplish equity goals (despite important caveats), although these reassignments may reduce achievement for students from higher-income backgrounds.

More →


Matthew A. Kraft, Melissa Arnold Lyon.

We examine the state of the U.S. K-12 teaching profession over the last half century by compiling nationally representative time-series data on four interrelated constructs: professional prestige, interest among students, preparation for entry, and job satisfaction. We find a consistent and dynamic pattern across every measure: a rapid decline in the 1970s, a swift rise in the 1980s, relative stability for two decades, and a sustained drop beginning around 2010. The current state of the teaching profession is at or near its lowest levels in 50 years. We identify and explore a range of factors that might explain these historical patterns including education funding, teacher pay, outside opportunities, unionism, barriers to entry, working conditions, accountability, autonomy, and school shootings.  

More →


Matthew A. Kraft, Megan Conklin, Grace Falken.

We examine the labor supply decisions of substitute teachers – a large, on-demand market with broad shortages and inequitable supply. In 2018, Chicago Public Schools implemented a targeted bonus program designed to reduce unfilled teacher absences in largely segregated Black schools with historically low substitute coverage rates. Using a regression discontinuity design, we find that incentive pay substantially improved coverage equity and raised student achievement. Changes in labor supply were concentrated among Black and Hispanic substitutes from nearby neighborhoods with experience in incentive schools. Wage elasticity estimates suggest incentives would need to be 50% of daily wages to close fill-rate gaps.

More →


Seth B. Hunter, Matthew P. Steinberg.

Districts nationwide have revised their educator evaluation systems, increasing the frequency with which administrators observe and evaluate teacher instruction. Yet, limited insight exists on the role of evaluator feedback for instructional improvement. Relying on unique observation-level data, we examine the alignment between evaluator and teacher assessments of teacher instruction and the potential consequences for teacher productivity and mobility. We show that teachers and evaluators typically rate teacher performance similarly during classroom observations, but with significant variability in teacher-evaluator ratings. While teacher performance improves across multiple classroom observations, evaluator ratings likely overstate productivity improvements among the lowest-performing teachers. Evaluators, but not teachers, systematically rate teacher performance lower in classrooms serving higher concentrations of economically disadvantaged students. And while teacher performance improves when evaluators provide more critical feedback about teacher instruction, teachers receiving critical feedback may seek alternative teaching assignments in schools with less critical evaluation settings. We discuss the implications of these findings for the design, implementation and impact of educator evaluation systems.

More →