Search EdWorkingPapers
Education outside of school (after school, summer…)
Displaying 11 - 20 of 51
Interscholastic Policy Debate Promotes Critical Thinking and College-going: Evidence From Boston Public Schools
Few interventions reduce inequality in reading achievement, let alone higher order thinking skills, among adolescents. We study “policy debate”—an extracurricular activity focused on improving middle and high schoolers’ critical thinking, argumentation, and policy analysis skills—in Boston schools serving large concentrations of economically-disadvantaged students of color. Student fixed effects estimates show debate had positive impacts on ELA test scores of 0.13 SD, equivalent to 68% of a full year of average 9th grade learning. Gains were concentrated on analytical more than rote subskills. We find no harm to math, attendance, or disciplinary records, and evidence of positive effects on high school graduation and postsecondary enrollment. Impacts were largest among students who were lowest achieving prior to joining debate.
A Systematic Review of Research on Tutoring Implementation: Considerations when Undertaking Complex Instructional Supports for Students
Tutoring has emerged as an especially promising strategy for supporting students academically. This study synthesizes 33 articles on the implementation of tutoring, defined as one-to-one or small-group instruction in which a human tutor supports students grades K-12 in an academic subject, to better understand the facilitators and barriers to program success. We find that policies influenced tutoring implementation through the allocation of federal funding and stipulation of program design. Tutoring program launch has often been facilitated by strategic relationships between schools and external tutoring providers and strengthened by transparent assessments of program quality and effectiveness. Successful implementation hinged on the support of school leaders with the power to direct school funding, space, and time. Tutoring setting and schedule, recruitment and training, and curriculum influenced whether students are able to access quality tutoring and instruction. Ultimately, evidence suggests that tutoring was most meaningful when tutors fostered positive student-tutor relationships which they drew upon to target instruction toward students’ strengths and needs.
A Multi-State, Student-Level Analysis of the Effects of the Four-Day School Week on Student Achievement and Growth
Four-day school weeks are becoming increasingly common in the United States, but their effect on students’ achievement is not well-understood. The small body of existing research suggests the four-day schedule has relatively small, negative average effects (~-0.02 to -0.09 SD) on annual, standardized state test scores in math and reading, but these studies include only a single state or are limited by using district-level data. We conduct the first multi-state, student-level analysis that estimates the effect of four-day school weeks on student achievement and a more proximal measure of within-year growth using NWEA MAP Growth assessment data. We conduct difference-in-differences analyses to estimate the effect of attending a four-day week school relative to attending a five-day week school. We estimate significant negative effects of the schedule on spring reading achievement (-0.07 SD) and fall-to-spring achievement gains in math and reading (-0.06 SD in both). The negative effects of the schedule are disproportionately larger in non-rural schools than rural schools and for female students, and they may grow over time. Policymakers and practitioners will need to weigh the policy’s demonstrated negative average effects on achievement in their decisions regarding how and if to implement a four-day week.
Can brick phones bridge the digital learning divide? Evidence from SMS-based math practice
Hardware requirements are a barrier to widespread adoption of digital learning software among low-income populations. We investigate the demand among smallholder-farming households for a simple, adaptive math learning tool that can be accessed by widely available ``brick'' phones, and its effect on educational outcomes. Over a quarter of invited households used the tool, with greater demand among households lacking electricity, radios, or televisions. Usage was highest when schools were out of session. Engagement lapsed without regular reminders to use the service. Using random variation in access to the service, we find evidence that the platform increased test scores, school attendance, and grade attainment. Interpretation of these estimates is complicated by potentially endogenous outcome observation.
The Causal Impact of Charter Schools on Private Tutoring Prevalence
Greater school choice leads to lower demand for private tutoring according to various international studies, but this has not been explicitly tested for the U.S. context. To estimate the causal effect of charter school appearances on neighboring private tutoring prevalence, we employ a comparative event study model combined with a longitudinal matching strategy to accommodate differing treatment years. In contrast to findings from other countries, we estimate that charter schools increase, rather than decrease, tutoring prevalence in the United States. We further find that the effect varies considerably based on the characteristics of the treated neighborhood: areas with the highest income, educational attainment, and proportion Asian show the greatest treatment impacts, while the areas with the least show null effects. Moreover, methodologically this investigation offers a pipeline for flexibly estimating causal effects with observational, longitudinal, geographically located data.
What we teach about race and gender: Representation in images and text of children’s books
Books shape how children learn about society and norms, in part through representation of different characters. We introduce new artificial intelligence methods for systematically converting images into data and apply them, along with text analysis methods, to measure the representation of skin color, race, gender, and age in award-winning children’s books widely read in homes, classrooms, and libraries over the last century. We find that more characters with darker skin color appear over time, but the most influential books persistently depict characters with lighter skin color, on average, than other books, even after conditioning on race; we also find that children are depicted with lighter skin than adults on average. Relative to their growing share of the U.S. population, Black and Latinx people are underrepresented in these same books, while White males are overrepresented. Over time, females are increasingly present but appear less often in text than in images, suggesting greater symbolic inclusion in pictures than substantive inclusion in stories. We then present analysis of the supply of, and demand for, books with different levels of representation to better understand the economic behavior that may contribute to these patterns. On the demand side, we show that people consume books that center their own identities. On the supply side, we document higher prices for books that center non-dominant social identities and fewer copies of these books in libraries that serve predominantly White communities. Lastly, we show that the types of children's books purchased in a neighborhood are related to local political beliefs.
Online tutoring works: Experimental evidence from a program with vulnerable children
We provide evidence from a randomized controlled trial on the effectiveness of a novel, 100-percent online math tutoring program, targeted at secondary school students from highly disadvantaged neighborhoods. The intensive, eight-week-long program was delivered by qualified math teachers in groups of two students during after-school hours. The intervention significantly increased standardized test scores (+0.26 SD) and end-of-year math grades (+0.48 SD), while reducing the probability of repeating the school year. The intervention also raised aspirations, as well as self-reported effort at school.
The Impact of Summer Programs on Student Mathematics Achievement: A Meta-Analysis
STEM Summer Programs for Underrepresented Youth Increase STEM Degrees
The federal government and many individual organizations have invested in programs to support diversity in the STEM pipeline, including STEM summer programs for high school students, but there is little rigorous evidence of their efficacy. We fielded a randomized controlled trial to study a suite of such programs targeted to underrepresented high school students at an elite, technical institution. The STEM summer programs differ in their length (one week, six weeks, or six months) and modality (on-site or online). Students offered seats in the STEM summer programs are more likely to enroll in, persist through, and graduate from college, with gains in institutional quality coming from both the host institution and other elite universities. The programs also increase the likelihood that students graduate with a degree in a STEM field, with the most intensive program increasing four-year graduation with a STEM degree attainment by 33 percent. The shift to STEM degrees increases potential earnings by 2 to 6 percent. Program-induced gains in college quality fully account for the gains in graduation, but gains in STEM degree attainment are larger than predicted based on institutional differences.
Job Training Programs as Crime Deterrents? Evidence from a Low-Income Targeted Training Program RCT
The primary goal of job training programs is to improve employment and earning outcomes of participants. However, effective job training programs may have potential secondary benefits, including in the form of reduced arrests. In this paper, we evaluate the impact of a job training program in New Orleans that was implemented using a randomized controlled trial design. We find that among those who had a prior criminal record, those assigned to the treatment group were two-fifths as likely to get arrested as those assigned to the control group at any time point after randomization. We explore several potential mechanisms for why this effect occurs and find suggestive evidence that the training program’s impact on wages, as well as peer effects from other trainees, can partially explain this effect.