Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Federick Ngo, Tatiana Melguizo.

AB705 is a landmark higher education policy that has changed approaches to developmental/remedial education in the California Community College system. We study one district that implemented reforms by placing most students in transfer-level math/English courses and encouraging enrollment in support courses based on multiple measures of academic preparation (e.g., GPA). We use regression discontinuity designs to examine the impact of these new placement procedures, finding benefits to English support course recommendations for low GPA students, but no evidence of benefits or penalties for math. We use inverse probability weighted regression adjustment to explore the relationship between support course enrollment and subsequent outcomes. While enrollment in concurrent support courses appeared beneficial, enrollment in developmental courses was associated with poorer outcomes.

More →


Lindsay C. Page, Katharine Meyer, Jeonghyun Lee, Hunter Gehlbach.

College success requires students to engage with their institution both academically and administratively. Missteps with required processes can threaten students’ ability to persist. We experimentally assessed the effectiveness of an artificially intelligent text-based chatbot to provide proactive outreach and support to college students to navigate administrative processes and use campus resources. In both the two-year and four-year college context, outreach was most effective when focused on administrative processes which were acute, time-sensitive, and for which outreach could be targeted to those for whom it was relevant. We draw lessons regarding the effective use of nudge-type efforts to support college success.

More →


Mark Murphy, Angela Johnson.
This study examines the effects of English Learner (EL) status on subsequent Special Education (SPED) placement. Through a research-practice partnership, we link student demographic data and initial English proficiency assessment data across seven cohorts of test takers and observe EL and SPED programmatic participation for these students over seven years. Our regression discontinuity (RD) estimates at the English proficiency margin consistently differ substantively from positive associations generated through regression analyses. RD evidence indicates that EL status had no effect on SPED placement at the English proficiency threshold. Grade-by-grade and subgroup RD analyses at this margin suggest that ELs were modestly under-identified for SPED during grade 5 and that ELs whose primary language was Spanish were under-identified for SPED.

More →


Jessalynn James, James H. Wyckoff.

The distribution of teaching effectiveness across schools is fundamental to understanding how schools can address disparities in educational outcomes. Research and policy have recognized the importance of teaching effectiveness for decades. Five stylized facts predict that teachers should be differentially allocated across schools such that poor, Black and Hispanic students are taught by less qualified and less effective teachers. Yet, research is unclear whether these predictions have empirical support. Our purpose is to better understand whether there are meaningful differences in teacher effectiveness among schools. We find that poor, Black and Hispanic students are more likely to be taught by novice teachers when they live in more segregated MSAs. Moreover, the geographic nature of segregation varies across MSAs. Differentiating segregation within urban districts and segregation between urban districts and outlying districts in the same MSAs is essential to understanding poor students’ exposure to novice teachers and policies that address these disparities. We find that poor, Black and Hispanic students are 50 percent more likely to be exposed to at least one novice teacher during elementary school compared to their more affluent white peers. These results raise questions regarding the enforcement of ESSA’s requirements on the distribution of teacher qualifications and quality.

More →


Jing Liu, Monica Lee.

Student absenteeism is often conceptualized and quantified in a static, uniform manner, providing an incomplete understanding of this important phenomenon. Applying growth curve models to detailed class-attendance data, we document that secondary school students' unexcused absences grow steadily throughout a school year and over grades, while the growth of excused absences remain essentially unchanged. Importantly, students starting the school year with a high number of unexcused absences, Black and Hispanic students, and low-income students accumulate unexcused absences at a significantly faster rate than their counterparts. Lastly, students with higher growth rates in unexcused absences consistently report lower perceptions of all aspects of school culture than their peers. Interventions targeting unexcused absences and/or improving school culture can be crucial to mitigating disengagement.

More →


Jing Liu, Megan Kuhfeld, Monica Lee, Danett Song.

Noncognitive constructs such as self-efficacy, social awareness, and academic engagement are widely acknowledged as critical components of human capital, but systematic data collection on such skills in school systems is complicated by conceptual ambiguities, measurement challenges and resource constraints. This study addresses this issue by comparing the predictive validity of two most widely used metrics on noncogntive outcomes|observable academic behaviors (e.g., absenteeism, suspensions) and student self-reported social and emotional learning (SEL) skills|for the likelihood of high school graduation and postsecondary attainment. Our findings suggest that conditional on student demographics and achievement, academic behaviors are several-fold more predictive than SEL skills for all long-run outcomes, and adding SEL skills to a model with academic behaviors improves the model's predictive power minimally. In addition, academic behaviors are particularly strong predictors for low-achieving students' long-run outcomes. Part-day absenteeism (as a result of class skipping) is the largest driver behind the strong predictive power of academic behaviors. Developing more nuanced behavioral measures in existing administrative data systems might be a fruitful strategy for schools whose intended goal centers on predicting students' educational attainment.

More →


Kaitlyn O'Hagan, Leanna Stiefel, Amy Ellen Schwartz.

Students with disabilities (SWDs) educated in traditional public schools alongside general education students (GENs) typically move to middle school in sixth grade, rather than continuing in a K-8/12. The documented negative effects of this move on GEN academic outcomes suggests similar negative—and perhaps larger—effects on SWDs. Using an instrumental variables strategy and NYC data on nine cohorts of students, we find the middle school transition causes a 0.30 (0.16) standard deviation decline in SWD math (ELA) performance and increases grade retention. Low-income SWDs and SWDs with a specific learning disability or emotional disturbance fare worse. However, the move does not widen the SWD-GEN gap, suggesting the need to ease the middle school transition for all students.

More →


Carly D. Robinson.

Few question the value of teacher-student relationships (TSRs) for educational outcomes. TSRs are positively associated with students’ achievement and engagement, as well as teachers’ well-being. Building and maintaining these crucial classroom relationships, however, is not easy. Drawing on prominent motivation theories in educational psychology, I present the Motivating Teacher-Student Relationships framework for understanding what motivates teachers to build positive TSRs. In particular, I focus on how teachers’ motivational beliefs about TSRs energize, direct, and sustain their efforts to engage in relationship-building behaviors and, thus, lead to positive relationships with their students. To build positive TSRs, teachers must believe it is their role to build TSRs, value TSRs, and believe they can successfully build TSRs (i.e., have relational self-efficacy). These beliefs are shaped by teachers’ sociocultural contexts and can facilitate or undermine the development of these learning relationships. With a greater understanding of how motivational beliefs influence social relationships, the field of education can more effectively develop theoretically grounded interventions to improve TSRs and mitigate inequality.

More →


Sara White, Leiah Groom-Thomas, Susanna Loeb.

This study synthesizes existing research on the implementation of tutoring programs which we define as one-to-one or small-group instruction in which a human tutor supports students grades K-12 in an academic subject area. Tutoring has emerged as an especially promising strategy for supporting students’ academic success with strong causal evidence finding large, positive effects on students' math and reading test scores across grade levels. Prior studies have reviewed this causal evidence of effects, but none have summarized the evidence on implementation. We iteratively developed search and selection criteria to identify studies addressing key research questions and synthesized these 40 studies which employ a range of research methodologies to describe how tutoring is implemented and experienced. We find that existing research provides rich descriptions of tutoring implementation within specific programs of focus, with most studies describing after-school tutoring and small-scale programs run by university professors. While few elements of implementation are studied in depth across multiple studies, common patterns emerge. Tutoring program launch is often facilitated by strategic relationships between schools and external tutoring providers and strengthened by transparent assessments of program quality and effectiveness. Successful tutoring implementation often hinges on the support of key school leaders with the power to direct the use of school funding, space, and time. Tutoring setting and schedule, tutor recruitment and training, and curriculum identification influence whether students are able to access tutoring services and the quality of the instruction provided. Ultimately, the evidence points to strong tutoring being driven by positive student-tutor relationships through which tutors provide instruction strategically targeted for students’ strengths and needs driving towards a long-term academic goal.

More →


Matthew A. Kraft, Sarah Novicoff.

Policymakers have renewed calls for expanding instructional time in the wake of the COVID-19 pandemic. We establish a set of empirical facts about time in school, synthesize the literature on the causal effects of instructional time, and conduct a case study of time use in an urban district. On average, instructional time in U.S. public schools is comparable to most high-income countries, with longer days but shorter years. However, instructional time varies widely across U.S. public schools with a 90th-10th percentile difference of 190 total hours. Empirical literature confirms that additional time can increase student achievement, but how this time is structured matters. Our case study suggests schools might also recover substantial lost learning time within the existing school day.

More →