Search for EdWorkingPapers here by author, title, or keywords.
Research suggests that earning college credits in high school increases the likelihood of postsecondary progress and graduation. In this study, we measure the impact of dual enrollment in high school and college courses through the College Now (CN) program on college enrollment for students in New York City. We use a regression discontinuity design (RDD) that estimates the causal local average effect of the treatment — eligibility for dual enrollment in college classes while in high school — on college enrollment. We find that being eligible for CN leads to a 7% point increase in the likelihood of college enrollment and an 8.6% point increase in the likelihood of enrollment in a four-year college. Students who were eligible for CN and enrolled in CN were 20% points more likely to enroll in college.
Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen’s standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In this paper, I present five broad guidelines for interpreting effect sizes that are applicable across the social sciences. I then propose a more structured schema with new empirical benchmarks for interpreting a specific class of studies: causal research on education interventions with standardized achievement outcomes. Together, these tools provide a practical approach for incorporating study features, cost, and scalability into the process of interpreting the policy importance of effect sizes.
Do nudge interventions that have generated positive impacts at a local level maintain efficacy when scaled state or nationwide? What specific mechanisms explain the positive impacts of promising smaller-scale nudges? We investigate, through two randomized controlled trials, the impact of a national and state-level campaign to encourage students to apply for financial aid for college. The campaigns collectively reached over 800,000 students, with multiple treatment arms to investigate different potential mechanisms. We find no impacts on financial aid receipt or college enrollment overall or for any student subgroups. We find no evidence that different approaches to message framing, delivery, or timing, or access to one-on-one advising affected campaign efficacy. We discuss why nudge strategies that work locally may be hard to scale effectively.
In this paper we investigate the impact of a statewide program aimed at better aligning K-12 to higher education and improving college readiness. We replicate an earlier study focused on the effects of this program at one campus by employing detailed administrative data on the census of California students that enroll at all twenty-three campuses of the California State University (CSU) system. We evaluate whether the program has reduced remediation rates at CSU statewide and investigate whether program effects differ by student background. We find that participation in the Early Assessment Program reduces the average student’s probability of needing remediation at California State University by about 2-3 percentage points overall. Investigating heterogeneous treatment effects, we find the program effects are largely concentrated among students at the margin of remediation risk.
The Milwaukee Parental Choice Program (MPCP), the first modern private school choice program in the United States, has grown from 341 students attending 7 private schools in 1990 to 27,857 students attending 126 private schools in 2019. The MPCP has been subject to extensive study focused largely on student performance on standardized tests. This study presents new data on the college enrollment, persistence, and graduation of MPCP and MPS students who were tracked over 12 years beginning in 2006. MPCP participants are compared with a matched sample of MPS students who lived in the same neighborhood and had similar demographic characteristics and test scores at the beginning of the study. The collective evidence in this paper indicates that students in the MPCP program have greater educational attainment than the comparison group, as measured by college experience and outcomes. Most of the college attainment benefits of the MPCP are clear for both students who were in ninth grade at the beginning of the study, for whom positive attainment effects have previously been reported, and students who were initially enrolled in grades three through eight, who we examine here for the first time. As of 2018, MPCP students have spent more total years in a four-year college than their MPS peers. The MPCP students in the grade three through eight sample attained college degrees at rates that are statistically significantly higher than their matched MPS peers.
Is there democratic accountability to the public at the local level, and if so, how does it work? We know that a major part of democratic ability depends on citizens being able to properly evaluate government based on government performance, particularly at the local level. However, we know much less about all of the potential pathways to get from performance to evaluations and vice versa. This study argues that establishing a "deliberative culture" of routine discourse in public meetings can help explain public evaluations and government performance. With a focus on public education, I find evidence that residents of districts with a more deliberative culture are more likely to give positive evaluations of their schools, particularly when residents lack access to information or live in low-performing districts. I also find that in school districts with a more deliberative culture, students - on average - show a higher proficiency in reading and math. This trend also holds true for vulnerable sub- populations: poor students, Black students, and Latinx students. These results suggest that deliberative democracy plays an important role in local and urban politics.
We examine the effect of admission to 16 stand-alone technical high schools within the Connecticut Technical High School System (CTHSS) on student educational and labor market outcomes. To identify the causal effect of admission on student outcomes, we exploit the fact that CTHSS utilizes a score-based admissions system and identify the effect of admission using a regression discontinuity approach. We find that male students attending one of the technical high schools are approximately 10 percentage points more likely to graduate from high school and 8 percentage points less likely to attend college, although there is some evidence that the negative effects on college attendance fade over time. We also find that male students attending a technical high school have quarterly earnings that are approximately 31% higher. Analyses of potential mechanisms behind these results reveal that male students that attend a technical high school have higher 9th grade attendance rates and higher 10th grade test scores. We find little evidence that attending a technical high school affects the educational or labor outcomes of women. These effects appear relatively broad based across different types of students in that we find little evidence of heterogeneity in these effects over student attributes like race and ethnicity, free lunch eligibility or residence in a poor, central city school district. However, when distinguishing between students based on the Career and Technical Education (CTE) offerings of the high school that these students likely would have attended, we find that the effects of admission to a CTHSS school are noticeably larger when the counterfactual high school has less CTE offerings.
In a flipped classroom, an increasingly popular pedagogical model, students view a video lecture at home and work on exercises with the instructor during class time. Advocates of the flipped classroom claim the practice not only improves student achievement, but also ameliorates the achievement gap. We conduct a randomized controlled trial at West Point and find that the flipped classroom produced short term gains in Math and no effect in Economics, but that the flipped model broadened the achievement gap: effects are driven by white, male, and higher achieving students. We find no long term average effects on student learning, but the widened achievement gap persists. Our findings demonstrate feasibility for the flipped classroom to induce short term gains in student learning; however, the exacerbation of the achievement gap, the effect fade-out, and the null effects in Economics suggest that educators should exercise caution when considering the model.
This paper uses Advanced Placement (AP) exams to examine how receiving college credit in high school alters students’ subsequent human capital investment. Using data from one large state, I link high school students to postsecondary transcripts from in-state, public institutions and estimate causal impacts using a regression discontinuity that compares students with essentially identical AP performance but who receive different offers of college credit. I find that female students who earn credit from STEM exams take higher-level STEM courses, significantly increasing their depth of study, with no observed impacts for males. As a result, the male-female gap in STEM courses taken shrinks by roughly one-third to two-thirds, depending on the outcome studied. Earning non-STEM AP credit increases overall coursework in non-STEM courses and increases the breadth of study across departments. Early credit policies help assist colleges to produce graduates whose skills aligns with commonly cited social or economic priorities, such as developing STEM graduates with stronger skills, particularly among traditionally underrepresented groups.
Policymakers are increasingly including early-career earnings data in consumer-facing college search tools to help students and families make more informed post-secondary education decisions. We offer new evidence on the degree to which existing college-specific earnings data equips consumers with useful information by documenting the level of selection bias in the earnings metrics reported in the U.S. Department of Education’s College Scorecard. Given growing interest in reporting earnings by college and major, we focus on the degree to which earnings differences across four-year colleges and universities can be explained by differences in major composition across institutions. We estimate that more than three-quarters of the variation in median earnings across institutions is explained by observable factors, and accounting for differences in major composition explains over 30 percent of the residual variation in earnings after controlling for institutional selectivity, student composition, and local cost of living differences. We also identify large variations in the distribution of earnings within colleges; as a result, comparisons of early-career earnings can be extremely sensitive to whether the median, 25th, or 75th percentiles are presented. Taken together, our findings indicate that consumers can easily draw misleading conclusions about institutional quality when using publicly available earnings data to compare institutions.