Search EdWorkingPapers
Education outside of school (after school, summer…)
Displaying 1 - 10 of 51
Do Innovative Career Pathways in Massachusetts High Schools Promote Equitable Access to Higher Education?
Two persistent shortcomings of the American labor market are the wage gaps and unequal unemployment rates that exist between racial groups. More specifically, Black and Latinx high school graduates earn less and are more likely to be unemployed than their White counterparts, on average. Likewise, students from low-income families are much more likely to be low-income themselves in adulthood. One of the ways Massachusetts seeks to address this is by offering Innovation Career Pathways, optional career and technical education (CTE) programs within traditional public high schools that are attended by students from historically disadvantaged backgrounds, to grant them access to preparation for in demand careers through technical courses and hands-on learning experiences. In addition to being conducive to economic opportunity directly by promoting career readiness, literature suggests that CTE programs may also do so indirectly by having a positive effect on educational attainment, which has a positive relationship with employment as well as earnings. This study investigates the effects of participation in the Massachusetts Innovation Career Pathways (ICP) on college readiness, college enrollment, and college persistence of racial minority and low-income students using Inverse Probability of Treatment Weighting, as determined by propensity scores. Given the findings that program participation has positive effects on college enrollment and persistence across racial and economic groups, increased recruitment of Black, Latinx, and low-income students into the program may be a way to promote equitable access to higher education in the state of Massachusetts.
Unpacking the Impacts of a Youth Behavioral Health Intervention: Experimental Evidence from Chicago
Racial disparities in violence exposure and criminal justice contact are a subject of growing policy and public concern. We conduct a large-scale, randomized controlled trial of a six-month behavioral health intervention combining intensive mentoring and group therapy designed to reduce criminal justice and violence involvement among Black and Latinx youth in Chicago. Over 24 months, youth offered the program experienced an 18 percent reduction in the probability of any arrest and a 23 percent reduction in the probability of a violent-crime arrest. These statistically significant impacts, with smaller magnitudes, continue to persist up to 3 years post randomization. To better understand the behavior change we observe given an arrest is a proxy for criminal behavior, we create a supervised machine learning algorithm from arrest narratives that determines if an arrest was initiated more or less at the discretion of police. We find that the program’s impacts are concentrated in arrests where officers have less discretion in initiating contact, while having little impact on more discretionary contact arrests (e.g. a young person exhibiting “suspicious” behavior). This analysis suggests the effects of the program are being driven by a reduction in youth offending behavior rather than by avoiding police contact.
Human Capital at Home: Evidence from a Randomized Evaluation in the Philippines
Children spend most of their time at home in their early years, yet efforts to promote human capital at home in many low- and middle-income settings remain limited. We conduct a randomized controlled trial to evaluate an intervention which encourages parents and caregivers to foster human capital accumulation among their children between ages 3 and 5, with a focus on math and phonics skills. Children gain 0.52 and 0.51 standard deviations relative to the control group on math and phonics tests, respectively (p<0.001). A year later effects persist, but math gains dissipate to 0.15 (p=0.06) and phonics to 0.13 (p=0.12). Effects appear to be mediated largely through instructional support by parents and not other parent investment mechanisms, such as more positive parent-child interactions or additional time spent on education at home beyond the intervention. Our results show that parents can be effective conduits of educational instruction even in low-resource settings.
Teaching Teachers to Use Computer Assisted Learning Effectively: Experimental and Quasi-Experimental Evidence
Mastery learning – the process by which students must demonstrate proficiency with a single topic before moving on – is well recognized as one of the best ways to learn, yet many teachers struggle or remain unsure about how to implement it into a classroom setting. This study leverages two field experiments to test the efficacy of a program designed to encourage greater mastery learning through technology and proactive continuous teacher support. Focusing on elementary and middle school mathematics, teachers receive weekly coaching in how to use Computer Assisted Learning (CAL) for students to follow a customized roadmap of incremental progress. Results indicate significant intent-to-treat effects on math performance of 0.12-0.22 standard deviations. Further analysis shows that these gains are concentrated among students in classrooms with at least an average of 35 minutes of practice per week. Teachers able to achieve high-dosage practice have a high degree of initial buy-in, a clear implementation strategy for when practice occurs, and a willingness to closely monitor progress and follow-up with struggling students.
Kumon In: The Recent, Rapid Rise of Private Tutoring Centers
The increasing prevalence of private tutoring has received minimal scholarly attention in the United States. We use over 25 years of geocoded data on the universe of U.S. private tutoring centers to estimate the size and growth of this industry and to identify predictors of tutoring center locations. We document four important facts. First, from 1997 to 2022, the number of private tutoring centers more than tripled, from about 3,000 to 10,000, with steady growth through 2015 before a more recent plateau. Second, the number and growth of private tutoring centers is heavily concentrated in geographic areas with high income and parental education. More than half of tutoring centers are in areas in the top quintile of income. Third, even conditional on income and parental education, private tutoring centers tend to locate in areas with many Asian American families, suggesting important differences by ethnic or cultural identity in demand for such services. Fourth, we see only marginal evidence that prevalence of private tutoring centers is related to the structure of K-12 school markets, including the prevalence of private schools and charter or magnet school options. The rapid rise in high-income families’ demand for this form of private educational investment mimics phenomena observed in other spheres of education and family life, with potentially important implications for inequality in student outcomes.
GED® College Readiness Benchmarks and Post-Secondary Success
In 2016, the GED® introduced college readiness benchmarks designed to identify testers who are academically prepared for credit-bearing college coursework. The benchmarks are promoted as awarding college credits or exempting “college-ready” GED® graduates from remedial coursework. I show descriptive evidence that those identified as college-ready by these benchmarks enroll and persist in college at significantly higher rates than others who pass the GED® exam, but at lower rates than recent graduates with traditional high school diplomas. Regression discontinuity estimates show that crossing a college readiness threshold does not substantially influence testers' college enrollment or persistence during the two years following their first test attempt. Relatedly, I observe little exam retaking by those who fall narrowly short of the minimum college readiness score thresholds. This contrasts strongly with retaking behavior near the lower GED® passing threshold that determines eligibility for a high school equivalency credential. Those who narrowly fail a GED® subject test are over 100 times more likely to retest than those who fall just short of a college readiness benchmark in the same subject. GED® college readiness benchmarks do not currently appear to promote better college outcomes, but in the absence of more detailed test score information they offer a simple heuristic to predict short-run college enrollment and persistence among GED® graduates, particularly for those who identify educational gain as a primary reason for testing. The results highlight the promise and challenges associated with building pathways for non-traditional students to earn credit for prior learning.
Under the Weather? The Effects of Temperature on Student Test Performance
As students are exposed to extreme temperatures with ever-increasing frequency, it is important to understand how such exposure affects student learning. In this paper we draw upon detailed student achievement data, combined with high-resolution weather records, to paint a clear portrait of the effect of temperature on student learning across a six-year period for students in Tulsa, Oklahoma. The detailed, longitudinal nature of our data allows us to estimate the effects of both test-day and longer-term temperature on student test performance, and to examine how the effects of both temperature measures vary across seasons, student background, and the distribution of student achievement. Our results show that test-day temperature has no significant effect on student test performance in fall or winter, but a clear negative effect on students’ spring performance, particularly in math. Second, we find that summer temperature has a positive, statistically significant, and substantively meaningful effect on student performance on the fall MAP assessment—these effects appear in both math and reading. The results also illustrate that 90-day temperature affects math performance in winter and spring, but these estimates are modest in substantive magnitude.
On the Margin: Who Receives a Juvenile Referral in School and What Effect Does It Have?
Involvement with the juvenile justice system carries immense consequences both to detained youth and to society more broadly. Extant research on the “school-to-prison pipeline” often focuses on school disciplinary practices such as suspension with less attention on understanding the impact of school referrals to the juvenile justice system on students. Using novel administrative data from North Carolina, we link three years of individual educational and disciplinary infraction records to juvenile justice system records to identify the effect of juvenile justice referrals for school-based offenses on academic and behavioral outcomes. We find that, even for the same offense type and circumstance, relative to students only punished internally in the school, students referred to juvenile justice experience lower academic achievement, increased absenteeism, and are more likely to be involved in future disciplinary infractions and juvenile system contact. We show that these juvenile referrals are not inevitable and instead reflect a series of discretionary choices made by school administrators and law enforcement. Moreover, we find that female students, Black students, and economically disadvantaged students are more likely to receive referrals even for the same offense type and circumstances.
Does Feedback on Talk Time Increase Student Engagement? Evidence from a Randomized Controlled Trial on a Math Tutoring Platform
Providing ample opportunities for students to express their thinking is pivotal to their learning of mathematical concepts. We introduce the Talk Meter, which provides in-the-moment automated feedback on student-teacher talk ratios. We conduct a randomized controlled trial on a virtual math tutoring platform (n=742 tutors) to evaluate the effectiveness of the Talk Meter at increasing student talk. In one treatment arm, we show the Talk Meter only to the tutor, while in the other arm we show it to both the student and the tutor. We find that the Talk Meter increases student talk ratios in both treatment conditions by 13-14%; this trend is driven by the tutor talking less in the tutor-facing condition, whereas in the student-facing condition it is driven by the student expressing significantly more mathematical thinking. Through interviews with tutors, we find the student-facing Talk Meter was more motivating to students, especially those with introverted personalities, and was effective at encouraging joint effort towards balanced talk time. These results demonstrate the promise of in-the-moment joint talk time feedback to both teachers and students as a low cost, engaging, and scalable way to increase students' mathematical reasoning.
Who becomes a teacher when entry requirements are reduced? An analysis of emergency licenses in Massachusetts
The COVID-19 pandemic disrupted teacher candidates’ capacity to complete licensure requirements. In response, many states temporarily reduced professional entry requirements to prevent a pandemic-induced teacher shortage. Using mixed methods, we examine the role of the emergency teaching license in Massachusetts, which provided an opportunity for individuals to enter the public school teacher workforce with only a bachelor’s degree. Our results show that emergency licenses increased the supply of teachers in two ways by: 1) providing an entry point for individuals who previously wanted to become teachers but could not meet traditional licensure requirements and 2) expanding the pool of individuals interested in the profession. Among those teachers hired with an emergency license, we find that they were substantially more ethnoracially diverse than their peers with traditional licenses, and they overwhelmingly intend to obtain permanent licensure and remain in the profession. These results suggest that rethinking initial entry requirements may be an effective policy tool to increase the supply of teachers, particularly among teachers of color.