Search EdWorkingPapers
Search EdWorkingPapers by author, title, or keywords.
Search
Program and policy effects
Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel text-as-data methods to develop automated measures of teaching to complement classroom observations traditionally done by human raters. This approach is free of rater bias and enables the detection of three instructional factors that are well aligned with commonly used observation protocols: classroom management, interactive instruction, and teacher-centered instruction. The teacher-centered instruction factor is a consistent negative predictor of value-added scores, even after controlling for teachers’ average classroom observation scores. The interactive instruction factor predicts positive value-added scores. Our results suggest that the text-as-data approach has the potential to enhance existing classroom observation systems through collecting far more data on teaching with a lower cost, higher speed, and the detection of multifaceted classroom practices.
Developmental education, in which college students deemed unprepared for college-level coursework enroll in non-credit bearing courses, is widespread in American higher education. The current study evaluates the effect of mobile app courseware on the college outcomes of developmental education students, using a research design which randomly assigned course sections to receive access to the apps or not. The results show that access to the apps significantly improved student performance in developmental education outcomes, marginally improved medium-term college persistence and performance, but did not effect credential attainment in the study timeframe. Despite a number of barriers to implementation, the results suggest the intervention has the potential to improve the short-term outcomes of developmental education students in addition to being low-cost and scalable.
In this paper we study the effects of three large, nearly-simultaneous coal-fired power plant closures on school absences in Chicago. We find that the closures resulted in a 7 percent reduction in absenteeism in nearby schools relative to those farther away following the closures. For the typical elementary school in our sample, this translates into around 372 fewer absence-days per year in the aggregate, or around 0.71 fewer annual absences per student. We find that reductions in absences were larger in schools where pre-closure exposure to coal-fired power plants was more intense: namely, schools with low levels of air conditioning, schools more frequently in the wind path of the plants, and non-magnet (i.e., neighborhood) schools where students were more likely to live nearby. To explore potential mechanisms responsible for these absence reductions we investigate the effects of the closures on housing values and children’s respiratory health. We do not find statistical evidence of endogenous migration into neighborhoods near the coal-fired power plants following the closures but do find declines in emergency department visits for asthma-related conditions among school-age children.
Despite calls for more evidence regarding the effectiveness of teacher education practices, causal research in the field remains rare. One reason is that we lack designs and measurement approaches that appropriately meet the challenges of causal inference in the context of teacher education programs. This article provides a framework for how to fill this gap. We first outline the difficulties of doing causal research in teacher education. We then describe a set of replicable practices for developing measures of key teaching outcomes, and propose causal research designs suited to the needs of the field. Finally, we identify community-wide initiatives that are necessary to advance effectiveness research in teacher education at scale.
During the past fifteen years, immigration enforcement increased dramatically in the U.S. interior. There is a growing recognition that immigration enforcement in the U.S. interior has spillover effects onto U.S. citizens. I examine the impacts of a type of partnership between Immigration and Customs Enforcement (ICE) and local law enforcement, 287(g) programs, on school engagement within North Carolina. In North Carolina, nine counties were approved to establish 287(g) programs, and another fifteen applied but were not approved to participate. I use a triple difference strategy in which I compare educational outcomes for different groups of students in these two sets of counties before and after activation of 287(g) programs. I find that 287(g) programs decrease school engagement by decreasing attendance. This effect appears to be driven by increases in chronic absenteeism (missing 15 or more days per year). In contrast, I observe no effect of 287(g) programs on achievement.
Jackson, Wigger, and Xiong (2020a, JWX) provide evidence that education spending reductions following the Great Recession had widespread negative impacts on student achievement and attainment. This paper describes our process of duplicating JWX and highlights a variety of tests we employ to investigate the nature and robustness of the relationship between school spending reductions and student outcomes. Though per-pupil expenditures undoubtedly shifted downward due to the Great Recession, contrary to JWX, our findings indicate there is not a clear and compelling story about the impact of those reductions on student achievement. Moreover, we find that the relationship between K-12 spending and college-going rates is likely confounded with contemporaneous higher education funding trends. While we believe that K-12 spending reductions may have negative impacts on student outcomes, our results suggest that estimating generalizable causal effects remains a significant challenge.
There is no national consensus on how school districts calculate high school achievement disparities between students who experience homelessness and those who do not. Using administrative student-level data from a mid-sized public school district in the Southern United States, we show that commonly used ways of defining which students are considered homeless can yield markedly different estimates of the homelessness-housed student high school graduation gap. The key distinctions among homelessness definitions relate to how to classify homeless students who become housed and how to consider students who transfer out of the district or drop out of school. Eliminating housing insecurity-related achievement disparities necessitates understanding the link between homelessness and educational achievement; how districts quantify homelessness affects measured gaps.
Black students are about 1.5 times more likely to be receiving special education (SpEd) services relative to white students. While there is concern that this implies some black students are inappropriately placed in SpEd, the impacts of the disproportionate representation of minority students in SpEd remains unclear. Using administrative data from Texas, we find that capping black disproportionality led to small gains in high school completion and college attainment for black students in special and general education. Overall, our results suggest that reductions in SpEd misclassification among black students may serve to reduce gaps in later-life success across race.
We draw on administrative data from the country of Colombia to assess differences in student learning in online and traditional on-campus college programs. The Colombian context is uniquely suited to study this topic, as students take an exit examination at the end of their studies. We can therefore directly compare performance on the exit exam for students in online and on-campus programs both across and within institutions, degrees, and majors. Using inverse probability weighting methods based on a rich set of background characteristics coupled with institution-degree-major fixed effects, our results suggest that bachelor’s degree students in online programs perform worse on nearly all test score measures (including math, reading, writing, and English) relative to their counterparts in on-campus programs. Results for shorter technical certificates are more mixed. While online students perform significantly worse than on-campus students on exit exams in private institutions, they perform better in SENA—the main public vocational institution in the country.
Although the Janus v. AFCSME (2018) decision fundamentally changed the institutional context for U.S. teachers’ unions by placing all public school teachers in a “Right to Work” (RTW) framework, little research exists to conceptualize the effects of such policies that hinder unionization. To fill this gap, I exploit the different timing across states in the passage of RTW policies in a differences-in-differences framework to identify how exposure to a RTW policy affects students, teachers, and education policymaking. I find that RTW policies lead to declines in teachers’ union power, but contrary to what many union critics have argued, I find that efforts to weaken unions did not result in political opportunities for education reforms nor did they improve student achievement outcomes.