Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Program and policy effects

Jo Al Khafaji-King.

This study evaluates the unintended consequences of the 2012 suspension ban in New York City. I find that the ban induced a substitution towards classification for students at high risk for suspension—Black students, male students, and those in schools with a high reliance on suspension. I find that disabilities that carry greater stigma and experience greater exclusion from the general education classroom drive the increases in classification. This substitution may benefit students if they are now receiving needed services. Simultaneously, ban-induced classifications may simply serve as a partial substitute for suspension.

More →


Andrew Kwok, Tuan D. Nguyen.

This concurrent mixed methods study descriptively explores teacher residency programs (TRPs) across the nation. We examine program and participant survey data from the National Center for Teacher Residencies (NCTR) to identify important TRP structures for resident support. Latent class analysis of program-level data reveals three types of TRPs (locally-funded low tuition, multi-funded multifaceted, and federally-funded post-residency support), while regression models indicate significant relationships between individual program structures and participant (residents, graduates, mentors, and principals) perceptions. Qualitative analyses of multiple open response items across participants details four salient TRP structures: providing extended clinical experience, localizing individual support, offering programmatic training, and teaching practical professional knowledge. Findings inform policymakers on TRP investment, practitioners about program design, and researchers for continued large-scale evidence.

More →


Christopher Cleveland, Ethan Scherer.

Education leaders must identify valid metrics to predict student long-term success. We exploit a unique dataset containing data on cognitive skills, self-regulation, behavior, course performance, and test scores for 8th-grade students. We link these data to data on students' high school outcomes, college enrollment, persistence, and on-time degree completion. Cognitive tests and survey-based self-regulation measures predict high school and college outcomes. However, these relationships become small and lose statistical significance when we control for test scores and a behavioral index. For leaders hoping to identify the best on-track indicators for college completion, the information collected in student longitudinal data systems better predicts both short- and long-run educational outcomes than these survey-based measures of self-regulation and cognitive skills.

More →


Christopher Cleveland, Ethan Scherer.

A growing body of research shows that students benefit when they demographically match their teachers. However, little is known about how matching affects social-emotional development. We use student-fixed effects to exploit changes over time in the proportion of teachers within a school grade who demographically match a student to estimate matching's effect on social-emotional measures, test scores, and behavioral outcomes. We find improvements for students in grit and interpersonal self-management when matched to teachers of their race and gender. Black female students drive these effects. We also find that matching reduces absences, especially for Black students. Our findings add to the emerging teacher diversity literature by showing its benefits for Black and female students during a critical stage of development.

More →


Catherine Armstrong Asher, Ethan Scherer, James S. Kim, Johanna Norshus Tvedt.

We leverage log data from an educational app and two-way text message records from over 3,500 students during the summers of 2019 and 2020, along with in-depth interviews in Spanish and English, to identify patterns of family engagement with educational technology. Based on the type and timing of technology use, we identify several distinct profiles of engagement, which we group into two categories: Independent Users who engage with technology-based educational software independently, and Interaction-Supported Users who use two-way communications to support their engagement. We also find that as the demands of families from schools increased during the COVID-19 pandemic, Spanish-speaking families were significantly more likely than English-speaking families to engage with educational technology across all categories of families, particularly as Interaction-Supported Users.

More →


Andrew Kwok, Iliana De La Cruz, Michelle Kwok.

Field supervisors are central to clinical teaching, but little is known about how their feedback informs preservice teachers (PSTs) development. This sequential mixed methods study examines over 3,000 supervisor observation evaluations. We qualitatively code supervisor written feedback, which indicates 2 broad pedagogical categories and 9 separate skills. We then quantize these feedback codes to identify the variation in the presence of these codes across PST characteristics, and then use several modeling techniques to indicate that specific feedback codes are negatively associated with evaluation score. Managing student attention was most detrimental to scores in early observations whereas instructional feedback (e.g., lesson delivery) was prioritized later in clinical teaching. Findings inform teacher preparation policy on understanding PST development and improving supervisory feedback.

More →


Lauren P. Bailes, Sarah Guthery.

This study examines the experience of demotion from a principalship to an assistant principalship and how race and gender can differentially impact career trajectories. Using administrative state dataset of 10,946 observations at the principal level, we used probit regression to determine the overall probability of demotion and Kaplan Meier survival analysis to estimate the differences in probability over time. Our analysis describes not only who experiences demotions, but includes the characteristics of the sending and receiving schools. Survival analysis illustrates how small differences over time in demotion by race resulted in statistically significant systemic differences. We also find that experience matters: for every additional year of experience in the principal role, the probability of experiencing demotion decreases by 0.34%.

More →


Kalena E. Cortes, Karen Kortecamp, Susanna Loeb, Carly D. Robinson.

This paper presents the results from a randomized controlled trial of Chapter One, an early elementary reading tutoring program that embeds part-time tutors into the classroom to provide short bursts of 1:1 instruction. Eligible kindergarten students were randomly assigned to receive supplementary tutoring during the 2021-22 school year (N=818). The study occurred in a large Southeastern district serving predominantly Black and Hispanic students. Students assigned to the program were over two times more likely to reach the program’s target reading level by the end of kindergarten (70% vs. 32%). The results were largely homogenous across student populations and extended to district-administered assessments. These findings provide promising evidence of an affordable and sustainable approach for delivering personalized reading tutoring at scale.

More →


James S. Kim, Joshua B. Gilbert, Jackie E. Relyea, Patrick Rich, Ethan Scherer, Mary A. Burkhauser, Johanna N. Tvedt.
We investigated the effectiveness of a sustained and spiraled content literacy intervention that emphasizes building domain and topic knowledge schemas and vocabulary for elementary-grade students. The Model of Reading Engagement (MORE) intervention underscores thematic lessons that provide an intellectual structure for helping students connect new learning to a general schema in Grade 1 (animal survival), Grade 2 (scientific investigation of past events like dinosaur mass extinctions), and Grade 3 (scientific investigation of living systems). A total of 30 elementary schools (N = 2,870 students) were randomized to a treatment or control condition. In the treatment condition (i.e., full spiral curriculum), students participated in content literacy lessons from Grades 1 to 3 during the school year and wide reading of thematically related informational texts in the summer following Grades 1 and 2. In the control condition (i.e., partial spiral curriculum), students participated in lessons in only Grade 3. The Grade 3 lessons for both conditions were implemented online during the COVID-19 pandemic school year. Results reveal that treatment students outperformed control students on science vocabulary knowledge across all three grades. Furthermore, intent-to-treat analyses revealed positive transfer effects on Grade 3 science reading (ES = .14), domain-general reading comprehension (ES = .11), and mathematics achievement (ES = .12). Treatment impacts were sustained at 14-month follow-up on Grade 4 reading comprehension (ES = .12) and mathematics achievement (ES = .16). Findings indicate that a content literacy intervention that spirals topics and vocabulary across grades can improve students’ long-term academic achievement outcomes.

More →


Sarah Novicoff, Thomas S. Dee.

While policymakers have demonstrated considerable enthusiasm for “science of reading” initiatives, the evidence on the impact of related reforms when implemented at scale is limited. In this pre-registered, quasi-experimental study, we examine California’s recent initiative to improve early literacy across the state’s lowest-performing elementary schools. The Early Literacy Support Block Grant (ELSBG) provided teacher professional development grounded in the science of reading as well as aligned supports (e.g., assessments and interventions), new funding (about $1000 per student), spending flexibility within specified guidelines, and expert facilitation and oversight of school-based planning. We find that ELSBG generated significant (and cost-effective) improvements in ELA achievement in its first two years of implementation (0.14 SD) as well as smaller, spillover improvements in math achievement.

More →