Search EdWorkingPapers
EdWorkingPapers
Framing the pandemic: Tracking educational problem formulation, Spring 2020-Fall 2021
We use data from the applications North Carolina public school districts and charter schools submitted for Elementary and Secondary School Emergency Relief (ESSER) to investigate the sense that educational leaders made of the pandemic as it unfolded. LEAs understood the pandemic as a multifaceted problem. Nearly all applications addressed four problems: (1) public health, (2) academics and learning loss, (3) student and community well-being, and (4) instructional access. However, we document considerable variation in problem emphasis over time, across LEAs, and across organizational sector. The pandemic was not a single organizational problem, but many simultaneous problems posed in varying and shifting combinations. We argue this multi-faceted organizational view should be a starting point for assessments of LEAs’ pandemic response.
Foreign Student Share and Supply of STEM-Designated Economics Programs
Over the past decade, there has been a significant increase in the number of U.S. institutions offering STEM-eligible degree programs in economics. This paper documents the trends in STEM-degree offerings across degree levels and examines the share of foreign students and other characteristics of institutions that offer STEM-eligible programs. Using a difference-in-differences design, this paper finds that departments with a proportion of foreign students above the sample median are 6 and 9 percentage points more likely to offer a STEM-eligible degree program at the bachelor's and master's levels, respectively, after the STEM designation in 2013. Additionally, the tobit regression results suggest that early adopters of STEM-eligible programs are associated with a higher share of foreign students, private institutions and doctoral and research institutions.
Using Gaussian Process Regression in Two-Dimensional Regression Discontinuity Designs
Sometimes a treatment, such as receiving a high school diploma, is assigned to students if their scores on two inputs (e.g., math and English test scores) are above established cutoffs. This forms a multidimensional regression discontinuity design (RDD) to analyze the effect of the educational treatment where there are two running variables instead of one. Present methods for estimating such designs either collapse the two running variables into a single running variable, estimate two separate one-dimensional RDDs, or jointly model the entire response surface. The first two approaches may lose valuable information, while the third approach can be very sensitive to model misspecification. We examine an alternative approach, developed in the context of geographic RDDs, which uses Gaussian processes to flexibly model the response surfaces and estimate the impact of treatment along the full range of students that were on the margin of receiving treatment. We demonstrate theoretically, in simulation, and in an applied example, that this approach has several advantages over current approaches, including over another nonparametric surface response method. In particular, using Gaussian process regression in two-dimensional RDDs shows strong coverage and standard error estimation, and allows for easy examination of treatment effect variation for students with different patterns of running variables and outcomes. As these nonparametric approaches are new in education-specific RDDs, we also provide an R package for users to estimate treatment effects using Gaussian process regression.
School and Crime
Criminal activity is seasonal, peaking in the summer and declining through the winter. We provide the first evidence that arrests of children and reported crimes involving children follow a different pattern: peaking during the school year and declining in the summer. We use a regression discontinuity design surrounding school start dates and an excess crime calculation to show that the school environment increases reported crimes involving children by roughly 50% annually. School exacerbates preexisting inequality in criminal interactions, increasing the Black-white and male-female gaps in reported juvenile crime and arrest rates by more than 40%.
Do the Effects Persist? An Examination of Long-term Effects After Students Leave Turnaround Schools
Whole-school reforms have received widespread attention, but a critical limitation of the current literature is the lack of evidence around whether these extensive and costly interventions improve students’ long-term outcomes after they leave reform schools. Leveraging Tennessee’s statewide turnaround reforms, we use difference-in-differences models to estimate the effect of attending a turnaround middle school on student outcomes in high school, including test scores, attendance, chronic absenteeism, disciplinary actions, drop out, and high school graduation. We find little evidence to support improved long-run student outcomes – mostly null effects that are nearly zero in magnitude. Our results contribute to a broad call for educational researchers to examine whether school reforms meaningfully affect student outcomes beyond short-term improvements in test scores.
Career Sequences and Unequal Sorting of Subject Area Teachers along the Path to the Principalship
The path to becoming a school principal is characterized by a variety of trajectories that reflect the diverse experiences and backgrounds of aspiring leaders. While ideally the road to the principalship would result in a proportional and representative body of principals, research has shown this is rarely the case. To gain a better understanding of where sorting mechanisms may occur along the principal pipeline, this paper longitudinally analyzes the full, start-to-finish career trajectories of over 1.6 million educators in Texas for 30 years. Using social sequence analysis and discrete-time hazard modeling, we find that (1) emergent principals tend to stay in their first teaching position longer than other educators and most often take a direct pathway towards the principalship; (2) proportionally, more principals emerge from elementary, ELA, Social Studies, or STEM fields, while fewer come from Special Education; (3) holding other features constant, male and Black educators are more likely to become a principal while female and Hispanic educators are less likely; and (4) educators are more likely to first become principals when transitioning to a smaller school with more Black and/or Hispanic students. While the pipeline does result in a balanced principal market in some areas, increasing efforts to encourage a more diverse content area representation as well as representation for Hispanic educators in Texas will be particularly important.
Classifying Courses at Scale: a Text as Data Approach to Characterizing Student Course-Taking Trends with Administrative Transcripts
Students’ postsecondary course-taking is of interest to researchers, yet has been difficult to study at large scale because administrative transcript data are rarely standardized across institutions or state systems. This paper uses machine learning and natural language processing to standardize college transcripts at scale. We demonstrate the approach’s utility by showing how the disciplinary orientation of students’ courses and majors align and diverge at 18 diverse four-year institutions in the College and Beyond II dataset. Our findings complicate narratives that student participation in the liberal arts is in great decline. Both professional and liberal arts majors enroll in a large amount of liberal arts coursework, and in three of the four core liberal arts disciplines, the share of course-taking in those fields is meaningfully higher than the share of majors in those fields. To advance the study of student postsecondary pathways, we release the classification models for public use.
Changes in Kindergarten Redshirting During the COVID-19 Pandemic
This study examined the impact of COVID-19 on academic "redshirting" in kindergarten, the practice of holding a child back for a year and enrolling them in kindergarten at age 6, using student-level data on all Delaware kindergarten students from fall 2014 through fall 2022. The rate of redshirting declined by 40% in fall 2020, then increased by 44% (relative to pre-pandemic baseline) in fall 2021, and more for some subgroups of children traditionally less likely to redshirt. Further, redshirting was not restricted to children with summer birthdays, as in previous years, with growth seen across the age distribution. Redshirting had not returned to pre-pandemic baseline by fall 2022. These findings point to changes in the motivations for redshirting kindergarten students since the pandemic.
Teaching Teachers to Use Computer Assisted Learning Effectively: Experimental and Quasi-Experimental Evidence
Mastery learning – the process by which students must demonstrate proficiency with a single topic before moving on – is well recognized as one of the best ways to learn, yet many teachers struggle or remain unsure about how to implement it into a classroom setting. This study leverages two field experiments to test the efficacy of a program designed to encourage greater mastery learning through technology and proactive continuous teacher support. Focusing on elementary and middle school mathematics, teachers receive weekly coaching in how to use Computer Assisted Learning (CAL) for students to follow a customized roadmap of incremental progress. Results indicate significant intent-to-treat effects on math performance of 0.12-0.22 standard deviations. Further analysis shows that these gains are concentrated among students in classrooms with at least an average of 35 minutes of practice per week. Teachers able to achieve high-dosage practice have a high degree of initial buy-in, a clear implementation strategy for when practice occurs, and a willingness to closely monitor progress and follow-up with struggling students.
Disability as Discipline? Effects of the New York City Suspension Ban on Identification of Students with Disabilities
Diversity Trends Among Faculty in STEM and non-STEM Fields at Selective Public Universities in the U.S. from 2016 to 2023
During the 2015-16 academic year, racial protests swept across college campuses in the U.S. These protests were followed by large university investments in initiatives to promote diversity, which combined with existing diversity dynamics, have helped to shape recent faculty diversity trends. We document diversity trends among faculty in STEM and non-STEM fields since the protests in 2015-16. We find that recent diversity trends are narrowing the gender gap among faculty in STEM and non-STEM fields, but widening racial-ethnic gaps, especially among Black faculty. A large body of prior research suggests these trends will affect students’ college experiences and how they choose majors.
Less is More: The Causal Effect of Four-Day School Weeks on Employee Turnover
The use of four-day school weeks (4dsw) in the United States has expanded rapidly over the past two decades. Previous work examines the impact of 4dsw on student outcomes, but little research to date examines the effect on school employees even though schools in some locales have adopted 4dsw to recruit and retain staff. This paper examines the effect of 4dsw adoption in Oregon, a state with widespread 4dsw use, on teacher and other school staff retention by leveraging a staggered roll-out of the schedule using a difference-in-differences design. We find that adopting a four-day week increased turnover among teachers, but that turnover among non-teaching staff was largely unaffected. The findings suggest that policymakers interested in implementing 4dsw for improved school employee retention should exercise caution and be attentive to the full set of incentives offered to staff.
Computational Language Analysis Reveals that Process-Oriented Thinking About Belonging Aids the College Transition
Inequality in college has both structural and psychological causes; these include the presence of self-defeating beliefs about the potential for growth and belonging. Such beliefs can be addressed through large-scale interventions in the college transition (Walton & Cohen, 2011; Walton et al., 2023) but are hard to measure. In our pre-registered study, we provide the strongest evidence to date that the belief that belonging challenges are common and tend to improve with time (“a process-oriented perspective”), the primary target of social-belonging interventions, is critical. We did so by developing and applying computational language measures to 25,000 essays written during a randomized trial of this intervention across 22 broadly representative US colleges and universities (Walton et al., 2023). We compare the hypothesized mediator to one of simple optimism, which includes positive expectations without recognizing that challenges are common. Examining the active control condition, we find that socially disadvantaged students are, indeed, significantly less likely to express a process-oriented perspective spontaneously, and more likely to express simple optimism. This matters: Students who convey a process-oriented perspective, both in control and treatment conditions, are significantly more likely to complete their first year of college full-time enrolled and have higher first-year GPAs, while simple optimism predicts worse academic progress. The social-belonging intervention helped distribute a process-oriented perspective more equitably, though disparities remained. These computational methods enable the scalable and unobtrusive assessment of subtle student beliefs that help or hinder college success.
The Causes and Consequences of U.S. Teacher Strikes
The U.S. has witnessed a resurgence of labor activism, with teachers at the forefront. We examine how teacher strikes affect compensation, working conditions, and productivity with an original dataset of 772 teacher strikes generating 48 million student days idle between 2007 and 2023. Using an event study framework, we find that, on average, strikes increase compensation by 8% and lower pupil-teacher ratios by 0.5 students, driven by new state revenues. We find little evidence of sizable impacts on student achievement up to five years post-strike, though strikes lasting 10 or more days decrease math achievement in the short-term.
JEL: I22, J30, J45, J52.