Search for EdWorkingPapers here by author, title, or keywords.
Program and policy effects
A growing body of research evaluates the effects of turnaround on chronically low-performing schools. We extend this research to formally test factors that either mediate or suppress the effects of two turnaround initiatives in Tennessee: the Achievement School District (ASD) and local Innovation Zones (iZones). Using difference-in-differences models within a mediational framework, we find that hiring highly effective teachers and employing effective principals partially explain positive effects of iZone interventions. In the ASD, high levels of teacher turnover suppress potential positive effects after the first year. In iZone schools, several factors suppress even larger positive effects: hiring more novice teachers; hiring more principals with less experience; and high levels of student chronic absenteeism and student in-migration.
Social programs and mandates are usually studied in isolation even though they often interact closely with each other. Given the immense recent changes to health insurance systems, there is much potential for spillover effects to other systems in which health plays a large role. In this study, we examine how health insurance interacts with education, specifically the education of students with disabilities. We present the first analysis in the literature of how a mandate for health insurers to cover therapy for Autism Spectrum Disorder (ASD) up to age 18 affects educational services received by, and test scores of, students with ASD. A key aspect of the mandate is that children covered by Medicaid aged out of benefits quickly (by age 6), leaving them with a far weaker benefit than children covered by private insurance. Since we do not observe insurance status directly, we proxy for private insurance coverage using ineligibility for free/reduced-price lunch (FRPL) and estimate impacts on identification with ASD, special education services, and achievement through a series of difference-in-differences and triple difference models. We find little evidence of an overall shift in ASD identification, but we do find substantial crowd-out of special education services for students with ASD from the mandate. The stronger mandate led to increased mainstreaming of students in general education classrooms and a reduction in special education support services like teacher consultants. Girls in particular are more likely to be mainstreamed. There is little evidence of changes in achievement, which supports our interpretation of the service reductions as crowd-out.
The College Board sought to reduce barriers in the college application process by minimizing information aggregation costs, encouraging a broad application portfolio, and providing an impetus to start the search process. Some students were offered additional encouragements, such as text message reminders or college application fee waivers. In a randomized control trial with 785,000 low- and middle-income students in the top 50% of the PSAT and SAT distributions, we find no changes in college enrollment patterns, with the exception of a 0.02σ increase in college quality measures for African-American and Hispanic students.
We present a reanalysis of the Tennessee Voluntary Prekindergarten Program (TNVPK), a state-funded program designed to promote the school readiness of 4-year-olds from low-income families. Oversubscribed programs used a lottery to randomly assign prospective enrollees a chance to attend TNVPK. We found that assignment to the program had largely null effects on measures of behavior, attendance, and retention collected during elementary school. TNVPK increased enrollment in special education by 4% between kindergarten and grade 3, and generated negative but generally statistically insignificant impacts on third-grade state test scores. We explore reasons for fadeout as well as threats to internal validity.
Using an additional decade of CNLSY data, this study replicated and extended Deming’s (2009) evaluation of Head Start’s life-cycle skill formation impacts in three ways. Extending the measurement interval for Deming’s adulthood outcomes, we found no statistically significant impacts on earnings and mixed evidence of impacts on other adult outcomes. Applying Deming’s sibling comparison framework to more recent birth cohorts born to CNLSY mothers revealed mostly negative Head Start impacts. Combining all cohorts shows generally null impacts on school-age and early adulthood outcomes.
I conduct a statewide experiment in Michigan with nearly 50,000 high-achieving high school seniors. Treated students are mailed a letter encouraging them to consider college and providing them with the web address of a college information website. I find that very high-achieving, low-income students, and very high-achieving, minority students are the most likely to navigate to the website. Small changes to letter content affect take-up. For example, highlighting college affordability induces 18 percent more students to the website than highlighting college choice, and 37 percent more than highlighting how to apply to college. I find a statistically precise zero impact on college enrollment among all students mailed the letter. However, low-income students experience a small increase in the probability that they enroll in college, driven by increases at four-year institutions. An examination of persistence through college, while imprecise, suggests that the students induced into college by the intervention persist at a lower rate than the inframarginal student.
We demonstrate that heat inhibits learning and that school air-conditioning may mitigate this effect. Student fixed effects models using 10 million PSAT-retakers show hotter school days in years before the test reduce scores, with extreme heat being particularly damaging. Weekend and summer temperature has little impact, suggesting heat directly disrupts learning time. New nationwide, school-level measures of air-conditioning penetration suggest patterns consistent with such infrastructure largely offsetting heat’s effects. Without air-conditioning, a 1°F hotter school year reduces that year’s learning by one percent. Hot school days disproportionately impact minority students, accounting for roughly five percent of the racial achievement gap.
Teachers’ impact on student long-run success is only partially explained by their contributions to students’ short-run academic performance. For this study, we explore a second dimension of teacher effectiveness by creating measures of teachers’ contributions to student class-attendance. We find systematic variation in teacher effectiveness at reducing unexcused class absences at the middle and high school level. These differences across teachers are as stable as those for student achievement, but teacher effectiveness on attendance only weakly correlates with their effects on achievement. We link these measures of teacher effectiveness to students’ long-run outcomes. A high value-added to attendance teacher has a stronger impact on students’ likelihood of finishing high school than does a high value-added to achievement teacher. Moreover, high value-added to attendance teachers can motivate students to pursue higher academic goals as measured by Advanced Placement course taking. These positive effects are particularly salient for low-achieving and low-attendance students.
Text-message based parenting programs have proven successful in improving parental engagement and preschoolers’ literacy development. The tested programs have provided a combination of (a) general information about important literacy skills, (b) actionable advice (i.e., specific examples of such activities), and (c) encouragement. The regularity of the texts – each week throughout the school year – also provided nudges to focus parents’ attention on their children. This study seeks to identify mechanisms of the overall effect of such programs. It investigates whether the actionable advice alone drives previous study’s results and whether additional texts of actionable advice improve program effectiveness. The findings provide evidence that text messaging programs can supply too little or too much information. A single text per week is not as effective at improving parenting practices as a set of three texts that also include information and encouragement, but a set of five texts with additional actionable advice is also not as effective as the three-text approach. The results on children’s literacy development depend strongly on the child’s pre-intervention literacy skills. For children in the lowest quarter of the pre-treatment literacy assessments, only providing one example of an activity decreases literacy scores by 0.15 standard deviations relative to the original intervention. Literacy scores of children in higher quarters are marginally higher with only one tip per week. We find no positive effects of increasing to five texts per week.