Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.


Todd R. Jones, Daniel Kreisman, Ross Rubenstein, Cynthia Searcy, Rachana Bhatt.

For years Georgia's HOPE Scholarship program provided full tuition scholarships to high achieving students. State budgetary shortfalls reduced its generosity in 2011. Under the new rules, only students meeting more rigorous merit-based criteria would retain the original scholarship covering full tuition, now called Zell Miller, with other students seeing aid reductions of approximately 15 percent. We exploit the fact that two of the criteria were high school GPA and SAT/ACT score, which students could not manipulate when the change took place. We compare already-enrolled students just above and below these cutoffs, making use of advances in multi-dimensional regression discontinuity, to estimate effects of partial aid loss. We show that, after the changes, aid flowed disproportionately to wealthier students, and find no evidence that the financial aid reduction affected persistence or graduation for these students. The results suggest that high-achieving students, particularly those already in college, may be less price sensitive than their peers.

More →

Katharine Meyer, Kelli A. Bird, Benjamin L. Castleman.
With rapid technological transformations to the labor market along with COVID-19 related economic disruptions, many working adults return to college to obtain additional training or credentials. Using a comparative individual fixed effects strategy and an administrative panel dataset of enrollment and employment in Virginia, we provide the first causal estimates of credential “stacking” among working adults. We find stacking increases employment by four percentage points and quarterly wages by $570 (seven percent). Returns are larger for individuals whose first credential is a short-term certificate and in Health and Business.

More →

Mark J. Chin.

In this paper I study the impact of court-mandated school desegregation, which began in the late 1950s, on White individuals’ racial attitudes and politics in adulthood. Using geocoded nationwide data from the General Social Survey, I compare outcomes between respondents living in the same county who were differentially exposed to desegregated schools, based on respondent age and the year of court-mandated integration. With this differences-in-differences approach, I find that exposure to desegregated schools increased White individuals’ conservatism and negatively impacted their racial attitudes and support for policies promoting racial equity, such as affirmative action. Heterogeneity analyses indicate that effects are particularly pronounced in counties where opposition to integration was strongest: Southern counties desegregating after the passage of the Civil Rights Act of 1964 and counties where support for the Democratic presidential candidate between the 1960 and 1968 elections substantially decreased. My study provides causal evidence for key tenets of the contact hypothesis, which theorizes that Black-White contact in integrated schools can improve outgroup racial attitudes only under certain conditions, including when this intergroup contact has institutional support.

More →

Heather C. Hill, Erica Litke, Kathleen Lynch.

For nearly three decades, policy-makers and researchers in the United States have promoted more intellectually rigorous standards for mathematics teaching and learning. Yet, to date, we have limited descriptive evidence on the extent to which reform-oriented instruction has been enacted at scale.

The purpose of the study is to examine the prevalence of reform-aligned mathematics instructional practices in five U.S. school districts. We also seek to describe the range of instruction students experience by presenting case studies of teachers at high, medium and low levels of reform alignment.

We draw on 1,735 video-recorded lessons from 329 elementary teachers in these five U.S. urban districts.

Research Design:
We present descriptive analyses of lesson scores on a mathematics-focused classroom observation instrument. We also draw upon interviews with district personnel, rater-written lesson summaries, and lesson video in order to develop case studies of instructional practice.

We find that teachers in our sample do use reform-aligned instructional practices, but that they do so within the confines of traditional lesson formats. We also find that the implementation of these instructional practices varies in quality. Furthermore, the prevalence and strength of these practices corresponds to the coherence of district efforts at instructional reform.

Our findings suggest that unlike other studies in which reform-oriented instruction rarely occurred (e.g. Kane & Staiger, 2012), reform practices do appear to some degree in study classrooms. In addition, our analyses suggest that implementation of these reform practices corresponds to the strength and coherence of district efforts to change instruction.

More →

Jason B. Cook, Stéphane Lavertu, Corbin Miller.

We explore how teachers unions affect education production by comparing outcomes between districts allocating new tax revenue amidst collective bargaining negotiations and districts allocating tax revenue well before. Districts facing union pressure increase teacher salaries and benefits, spend down reserves, and experience no student achievement gains. Conversely, districts facing less pressure hire more teachers (instead of increasing compensation) and realize significant student achievement gains. We interpret these results as causal evidence of the negative impact of teacher rent seeking on education production, as the timing of district tax elections relative to collective bargaining appears to be as good as random.

More →

Silvia Robles, Max Gross, Robert W. Fairlie.

One frequently cited yet understudied channel through which money matters for college students is course availability- colleges may respond to budgetary pressure by reducing course offerings. Open admissions policies, binding class size constraints, and heavy reliance on state funding may make this channel especially salient at community colleges, which enroll 47% of U.S. undergraduates in public colleges and 55% of underrepresented minority students. We use administrative course registration data from a large community college in California to test this mechanism. By exploiting discontinuities in course admissions created by waitlists, we find that students stuck on a waitlist and shut out of a course section were 25% more likely to take zero courses that term relative to a baseline of 10%. Shutouts also increased transfer rates to nearby, but potentially lower quality, two-year colleges. These results document that course availability- even through a relatively small friction- can interrupt and distort community college students’ educational trajectories.

More →

Dillon Fuchsman, Josh B. McGee, Gema Zamarro.

Many states have recently made or are considering changes to their teacher retirement systems. However, little is known about how teachers value various elements of their retirement benefits versus other aspects of their jobs and compensation. To help alleviate this gap, we use a discrete choice stated preferences experiment embedded in a nationally representative survey of teachers to estimate their willingness-to-pay for various retirement plan characteristics and other non-salary job components. We find that teachers would be indifferent between a traditional pension and alternative retirement plan designs if the alternatives were paired with 2 to 3 percent salary increases. Our results indicate that experience is a significant mediator of retirement plan preferences. While more experienced teachers are willing to pay more to keep their traditional pension plans, inexperienced teachers do not have strong preferences around retirement plan type. However, teachers’ willingness-to-pay for traditional pension plans is less than their willingness-to-pay for many other elements of their compensation, including the value of retirement benefits, retirement age, salary growth, healthcare coverage, and Social Security enrollment.

More →

Vivian C. Wong, Peter M. Steiner, Kylie L. Anglin.

Recent interest to promote and support replication efforts assume that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our general approach is derived from the Causal Replication Framework (CRF), which formalizes the assumptions under which replication success can be expected. The assumptions may be understood broadly as replication design requirements and individual study design requirements. Replication failure occurs when one or more CRF assumptions are violated. In design-based approaches to replication, CRF assumptions are systematically tested to evaluate the replicability of effects, as well as to identify sources of effect variation when replication failure is observed. In direct replication designs, replication failure is evidence of bias or incorrect reporting in individual study estimates, while in conceptual replication designs, replication failure occurs because of effect variation due to differences in treatments, outcomes, settings, and participant characteristics. The paper demonstrates how multiple research designs may be combined in systematic replication studies, as well as how diagnostic measures may be used to assess the extent to which CRF assumptions are met in field settings.    

More →

Kylie L. Anglin, Vivian C. Wong.

Researchers are rarely satisfied to learn only whether an intervention works, they also want to understand why and under what circumstances interventions produce their intended effects. These questions have led to increasing calls for implementation research to be included in high quality studies with strong causal claims. Of critical importance is determining whether an intervention can be delivered with adherence to a standardized protocol, and the extent to which an intervention protocol can be replicated across sessions, sites, and studies. When an intervention protocol is highly standardized and delivered through verbal interactions with participants, a set of natural language processing (NLP) techniques termed semantic similarity can be used to provide quantitative summary measures of how closely intervention sessions adhere to a standardized protocol, as well as how consistently the protocol is replicated across sessions. Given the intense methodological, budgetary and logistical challenges for conducting implementation research, semantic similarity approaches have the benefit of being low-cost, scalable, and context agnostic for use. In this paper, we demonstrate how semantic similarity approaches may be utilized in an experimental evaluation of a coaching protocol on teacher pedagogical skills in a simulated classroom environment. We discuss strengths and limitations of the approach, and the most appropriate contexts for applying this method.

More →

Christopher Doss, Hans Fricke, Susanna Loeb.

This study assesses the effects of two text-messaging programs for parents that aim to support the development of math skills in prekindergarten students. One program focuses purely on math, while the other takes an identical approach but focuses on a combination of math, literacy, and social-emotional skills. We find no evidence that the math-only program benefits children’s development. However, the combination program shows greater promise, particularly for girls. Quantile regressions indicate that the effects are concentrated in the lower half of the outcome distribution. Results imply that girls may have started the year behind boys in math and caught up to and even surpassed boys when their parents have access to the program that combines topics. Our results also provide evidence that the structure of behavioral interventions can affect who benefits from the program, sometimes in unexpected ways, to produce meaningful differences in outcomes. We discuss and provide evidence for various hypotheses that could explain these differences.

More →