Search for EdWorkingPapers here by author, title, or keywords.
We examine U.S. children whose parents won the lottery to trace out the effect of financial resources on college attendance. The analysis leverages federal tax and financial aid records and substantial variation in win size and timing. While per-dollar effects are modest, the relationship is weakly concave, with a high upper bound for amounts greatly exceeding college costs. Effects are smaller among low-SES households, not sensitive to how early in adolescence the shock occurs, and not moderated by financial aid crowd-out. The results imply that households derive consumption value from college and household financial constraints alone do not inhibit attendance.
Growing experimental evidence demonstrates that low-touch informational, nudge, and virtual advising interventions are ineffective at improving postsecondary educational outcomes for economically-disadvantaged students at scale. Intensive in-person college advising programs are a considerably higher-touch and more resource intensive strategy; some programs provide students with dozen of hours of individualized assistance starting in high school and continuing through college, and can cost thousands of dollars per student served. Despite the magnitude of this investment, causal evidence on these programs' impact is quite limited, particularly for programs that serve Hispanic students, the fastest growing segment of U.S. college enrollees. We contribute new evidence on the impact of intensive college advising programs through a multi-cohort RCT of College Forward, which provides individualized advising from junior year of high school through college for a majority Hispanic student population in Texas. College Forward leads to a 7.5 percentage point increase in enrollment in college, driven entirely by increased enrollment at four-year universities. Students who receive College Forward advising are nearly 12 percentage points more likely to persist to their third year of college. While more costly and harder to scale than low-touch interventions, back of the envelope calculations suggest that the benefit from increased college graduation likely induced by the program outweighs operating costs in less than two years following college completion.
This article asks whether small changes to community college courses and programs can help improve student outcomes. We use administrative data from the California Community College system, including millions of student records and detailed course-level information for most career-technical education programs in the state. We construct a summary measure of each program’s flexibility, incorporating many components of the availability and scheduling of its courses. We show considerable variation in this flexibility measure across programs and over time. An increase in a program’s flexibility is associated with increases in enrollment and completions, but not with changes in its completion rate.
Academic origins in economics departments, defined as the universities at which tenure-track faculty completed their doctoral studies, may have implications for how the department’s undergraduate and PhD students are trained and placed, as well as the type of research produced. In this project, we use roster data on the academic origins of the tenure-track faculty at 96 U.S. economics departments with graduate degrees. We use these data to document patterns in academic origins across several dimensions, including department ranking, gender, rank (Assistant, Associate, Full Professor), and geography. We find that 1) over half of the faculty of each of eight top departments received their PhD from one of these same universities; 2) at least half of faculty from all top-25 departments come from top-15 universities; 3) over half of Harvard and MIT faculty received their PhD at either Harvard or MIT; and 4) over half of all faculty in the study come from top-15 universities, with Harvard, MIT, and the rest of the top six disproportionately represented. The first and third findings are more pronounced for female faculty.
For years Georgia's HOPE Scholarship program provided full tuition scholarships to high achieving students. State budgetary shortfalls reduced its generosity in 2011. Under the new rules, only students meeting more rigorous merit-based criteria would retain the original scholarship covering full tuition, now called Zell Miller, with other students seeing aid reductions of approximately 15 percent. We exploit the fact that two of the criteria were high school GPA and SAT/ACT score, which students could not manipulate when the change took place. We compare already-enrolled students just above and below these cutoffs, making use of advances in multi-dimensional regression discontinuity, to estimate effects of partial aid loss. We show that, after the changes, aid flowed disproportionately to wealthier students, and find no evidence that the financial aid reduction affected persistence or graduation for these students. The results suggest that high-achieving students, particularly those already in college, may be less price sensitive than their peers.
One frequently cited yet understudied channel through which money matters for college students is course availability- colleges may respond to budgetary pressure by reducing course offerings. Open admissions policies, binding class size constraints, and heavy reliance on state funding may make this channel especially salient at community colleges, which enroll 47% of U.S. undergraduates in public colleges and 55% of underrepresented minority students. We use administrative course registration data from a large community college in California to test this mechanism. By exploiting discontinuities in course admissions created by waitlists, we find that students stuck on a waitlist and shut out of a course section were 25% more likely to take zero courses that term relative to a baseline of 10%. Shutouts also increased transfer rates to nearby, but potentially lower quality, two-year colleges. These results document that course availability- even through a relatively small friction- can interrupt and distort community college students’ educational trajectories.
Recent interest to promote and support replication efforts assume that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our general approach is derived from the Causal Replication Framework (CRF), which formalizes the assumptions under which replication success can be expected. The assumptions may be understood broadly as replication design requirements and individual study design requirements. Replication failure occurs when one or more CRF assumptions are violated. In design-based approaches to replication, CRF assumptions are systematically tested to evaluate the replicability of effects, as well as to identify sources of effect variation when replication failure is observed. In direct replication designs, replication failure is evidence of bias or incorrect reporting in individual study estimates, while in conceptual replication designs, replication failure occurs because of effect variation due to differences in treatments, outcomes, settings, and participant characteristics. The paper demonstrates how multiple research designs may be combined in systematic replication studies, as well as how diagnostic measures may be used to assess the extent to which CRF assumptions are met in field settings.
Researchers are rarely satisfied to learn only whether an intervention works, they also want to understand why and under what circumstances interventions produce their intended effects. These questions have led to increasing calls for implementation research to be included in high quality studies with strong causal claims. Of critical importance is determining whether an intervention can be delivered with adherence to a standardized protocol, and the extent to which an intervention protocol can be replicated across sessions, sites, and studies. When an intervention protocol is highly standardized and delivered through verbal interactions with participants, a set of natural language processing (NLP) techniques termed semantic similarity can be used to provide quantitative summary measures of how closely intervention sessions adhere to a standardized protocol, as well as how consistently the protocol is replicated across sessions. Given the intense methodological, budgetary and logistical challenges for conducting implementation research, semantic similarity approaches have the benefit of being low-cost, scalable, and context agnostic for use. In this paper, we demonstrate how semantic similarity approaches may be utilized in an experimental evaluation of a coaching protocol on teacher pedagogical skills in a simulated classroom environment. We discuss strengths and limitations of the approach, and the most appropriate contexts for applying this method.
Most public colleges and universities rely heavily on state financial support. As state budgets have tightened in recent decades, appropriations for higher education have declined substantially. Despite concerns expressed by policymakers and scholars that the declines in state support have reduced the return to education investment for public sector students, little evidence exists that can identify the causal effect of these funds on long-run outcomes. We present the first such analysis in the literature using new data that leverages the merger of two rich datasets: consumer credit records from the New York Fed's Consumer Credit Panel (CCP), sourced from Equifax, and administrative college enrollment and attainment data from the National Student Clearinghouse. We overcome identification concerns related to the endogeneity of state appropriation variation using an instrument that interacts the baseline share of total revenue that comes from state appropriations at each public institution with yearly variation in state-level appropriations. Our analysis is conducted separately for two-year and four-year students, and we analyze individuals into their mid-30s. For four-year students, we find that state appropriation increases lead to substantially lower student debt originations. They also react to appropriation increases by shortening their time to degree, but we find little effect on other outcomes. In the two-year sector, state appropriation increases lead to more collegiate and post-collegiate educational attainment, more educational debt consistent with the increased educational attainment, but lower likelihood of delinquency and default. State support also leads to more car and home ownership with lower adverse debt outcomes, and these students experience substantial increases in their credit score and in the affluence of the neighborhood in which they live. Examining mechanisms, we find state appropriations are passed on to students in the form of lower tuition in the four-year sector with no institutional spending response. For community colleges, we find evidence of both price and quality mechanisms, the latter captured in higher educational resources in key spending categories. These results are consistent with the different pattern of effects we document in the four-year and two-year sectors. Our results underscore the importance of state support for higher education in driving student debt outcomes and the long-run returns to postsecondary investments that students experience.
We replicate and extend prior work on Florida’s Bright Futures merit aid scholarship to consider its effect on college enrollment and degree completion. We estimate causal impacts using a regression discontinuity design to exploit SAT thresholds that strongly determine eligibility. We find no positive impacts on attendance or attainment, and instrumental variable results generally reject estimates as small as 1-2 percentage points. Across subgroups, we do find that eligibility slightly reduces six-year associate degree attainment for lower-SES students and may induce small enrollment shifts among Hispanic and White students. Our findings of these minimal-at-best impacts contrast those of prior works, attributable in part to methodological improvements and more robust data, and further underscore the importance of study replication. (JEL: H75, I21, I22, I23, I28)