Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

EdWorkingPapers

Vladimir Kogan.

How do adult "culture wars" in education affect student learning in the classroom? I explore this question by combining information on nearly 500 school district political controversies with data on state test scores. Leveraging variation in the location and timing of these events as the basis for a difference-in-differences design, I show that student achievement declines in the wake of adult political battles. The effects are concentrated in math achievement -- the equivalent of approximately 10 days of lost learning -- and persist for at least four years. The declines are particularly pronounced for controversies surrounding racial issues and the teaching of evolution. These results suggest that well-intentioned education advocacy efforts focused on salient social justice issues may backfire, producing in unintended negative impacts on student achievement, and raise new questions about the adequacy of local democratic processes for the governance of public schools.

More →


Sarah Guthery, Lauren P. Bailes.

Texas reduced new teacher preparation requirements in 2001 to allow more alternate paths to licensure. Within five years, this policy change resulted in over half the state’s new teachers being alternatively licensed. Using a series of first difference models, this study examines the relationship between the increased supply of new teachers in Texas and new teacher salaries prior to the policy change and in the fifteen years thereafter. We find that the policy change did increase the supply of new teachers via alternative licensing, but pay for new EC-6 teachers declined by 2 to 13 percent with differential effects based on the rate at which districts hired alternatively licensed teachers.

More →


Heather McCambly, Quinn Mulroy.

Public discussions of racial inclusion and equal opportunity initiatives in the U.S. are often met with claims that expanding access to an institution, space, or public good is likely to diminish its quality. Examples of this pattern include: anticipated (and real) property value declines when predominantly white neighborhoods become more racially diverse; fears that the excellence of white schools will decline when the population of Black and brown students grows; apprehensions that equitable hiring practices necessarily entail lower standards for job candidates. In this paper, we examine how a federal agency, the Fund for the Improvement of Postsecondary Education (FIPSE), charged with addressing the aftermath of the ‘access wave’ of new college students promulgated by the Higher Education Act of 1965, came to reconcile its commitments to educational equity and quality. Through a novel examination of the historical development of what we term (e)quality politics in the administration of civil rights policy in higher education, we trace how two concepts - equity and quality – became discursively linked and contested in American politics. (E)quality politics refers to the introduction of a policy paradigm that reframes equity discussions and goals around the professed need to preserve and advance institutional “quality” using measures and standards that are, importantly, defined and instantiated under the era of segregation that precedes equal access policies. In particular, we uncover the discursive patterns by which the perceived threats to “quality” posed by racial diversity can prompt administrators to compensate, protect, and maintain the prerogatives of high-status institutions or groups that benefited under previous eras of exclusion. Understood as part of a backlash to egalitarian reforms, we argue, these quality measures undermine equity goals.

More →


Taylor Odle, Lauren C. Russell.

Reverse transfer associate degrees are credentials retroactively awarded to current bachelor’s degree seekers that combine current four-year credits with credits previously earned at a community college. Providing students with an associate degree may not only increase motivation and persistence en route to completing a bachelor’s but may also provide important labor market benefits by way of increased marketability and earnings potential. Despite the proliferation of reverse transfer policies across at least 15 states to date, there is no causal evidence documenting their effect on students’ outcomes. Leveraging administrative data from Tennessee matched with records on its statewide reverse transfer program and a difference-in-differences design, we find reverse transfer degrees generally have little impact on students’ short- and intermediate-term academic and labor market outcomes. Our results point to suggestive yet small positive gains in GPA and short-term employment for recipients, but these estimates accompany no impacts on bachelor’s degree attainment and estimates that confidently reject any meaningful impacts on recipients’ earnings. Our findings contrast those of existing descriptive works on reverse transfer that reported large benefits for students, due in part to our methodological improvements and more robust data. These findings should guide policymakers considering the adoption, design, and ongoing operation of reverse transfer programs.

More →


Brian Heseung Kim, Katharine Meyer, Alice Choe.

Interactive, text message-based advising programs have become an increasingly common strategy to support college access and success for underrepresented student populations. Despite the proliferation of these programs, we know relatively little about how students engage in these text-based advising opportunities and whether that relates to stronger student outcomes – factors that could help explain why we’ve seen relatively mixed evidence about their efficacy to date. In this paper, we use data from a large-scale, two-way text advising experiment focused on improving college completion to explore variation in student engagement using nuanced interaction metrics and automated text analysis techniques (i.e., natural language processing). We then explore whether student engagement patterns are associated with key outcomes including persistence, GPA, credit accumulation, and degree completion. Our results reveal substantial variation in engagement measures across students, indicating the importance of analyzing engagement as a multi-dimensional construct. We moreover find that many of these nuanced engagement measures have strong correlations with student outcomes, even after controlling for student baseline characteristics and academic performance. Especially as virtual advising interventions proliferate across higher education institutions, we show the value of applying a more codified, comprehensive lens for examining student engagement in these programs and chart a path to potentially improving the efficacy of these programs in the future.

Open source code on GitHub.

More →


Matthew A. Kraft, John A. List, Jeffrey A. Livingston, Sally Sadoff.

A substantial body of experimental evidence demonstrates that in-person tutoring programs can have large impacts on K-12 student achievement. However, such programs typically are costly and constrained by a limited local supply of tutors. In partnership with CovEducation (CovEd), we conduct a pilot program that has potential to ease both of these concerns. We conduct an experiment where volunteer tutors from all over the country meet 1-on-1 with middle school students online during the school day. We find that the program produces consistently positive (0.07σ for math and 0.04σ for reading) but statistically insignificant effects on student achievement. While these estimates are notably smaller than those found in many higher-dosage in-person tutoring programs, they are from a significantly lower-cost program that was delivered within the challenging context of the COVID-19 pandemic. We provide evidence that is consistent with a dosage model of tutoring where additional hours result in larger effects.

More →


Matthew A. Kraft, Joshua Bleiberg.

Economic downturns can cause major funding shortfalls for U.S. public schools, often forcing districts to make difficult budget cuts including teacher layoffs. In this brief, we synthesize the empirical literature on the widespread teacher layoffs caused by the Great Recession. Studies find that teacher layoffs harmed student achievement and were inequitably distributed across schools, teachers, and students. Research suggests that specific elements of the layoff process can exacerbate these negative effects. Seniority-based policies disproportionately concentrate layoffs among teachers of color who are more likely to be early career teachers. These “last-in first-out” policies also disproportionately affect disadvantaged students because these students are more likely to be taught by early career teachers. The common practice of widely distributing pink slips warning about a potential job loss also appears to increase teacher churn and negatively impact teacher performance. Drawing on this evidence, we outline a set of policy recommendations to minimize the need for teacher layoffs during economic downturns and ensure that the burden of any unavoidable job cuts does not continue to be borne by students of color and students from low-income backgrounds.

More →


Taylor Odle.

Promoting equality in college enrollment and completion must start early in students’ college-going journeys, including with their expectations to first earn a college degree. With a nationally representative sample of high school students, I evaluate the ability of a recent collection of college access policies (place-based “promise” scholarships or “free” college programs) to increase students’ college expectations and test the heterogeneity of these impacts across students’ race and family income. Evidence from a difference-in-differences design and lagged-dependent-variable regressions suggest the introduction of promise programs increased the likelihood a student expected to attain an associate degree or higher by 8.5 to 15.0 percentage points by the end of high school, with larger effects for low-income and racially minoritized students. This study is the first to test the power of “free” college in shaping pre-college students’ educational plans, and, in doing so, not only addresses an existing gap in the literature but also identifies a key mechanism through which many of the positive college-going impacts observed across promise programs in the current literature may in fact originate. Given the rapid proliferation of promise programs across the nation, this study provides policymakers with a fuller view of the potential impacts of these programs, particularly concerning how they influence students’ outcomes along dimensions of race and income.

More →


Christine Mulhern, Isaac M. Opper.

There is an emerging consensus that teachers impact multiple student outcomes, but it remains unclear how to measure and summarize the multiple dimensions of teacher effectiveness into simple metrics for research or personnel decisions. We present a multidimensional empirical Bayes framework and illustrate how to use noisy estimates of teacher effectiveness to assess the dimensionality and predictive power of teachers' true effects. We find that it is possible to efficiently summarize many dimensions of effectiveness and most summary measures lead to similar teacher rankings; however, focusing on any one specific measure alone misses important dimensions of teacher quality.

More →


Michael F. Lovenheim, Jonathan Smith.

Early research on the returns to higher education treated the postsecondary system as a monolith.  In reality, postsecondary education in the United States and around the world is highly differentiated, with a variety of options that differ by credential (associates degree, bachelor’s degree, diploma, certificate, graduate degree), the control of the institution (public, private not-for-profit, private for-profit), the quality/resources of the institution, field of study, and exposure to remedial education. In this Chapter, we review the literature on the returns to these different types of higher education investments, which has received increasing attention in recent decades. We first provide an overview of the structure of higher education in the U.S. and around the world, followed by a model that helps clarify and articulate the assumptions employed by different estimators used in the literature. We then discuss the research on the return to institution type, focusing on the return to two-year, four-year, and for-profit institutions as well as the return to college quality within and across these institution types. We also present the research on the return to different educational programs, including vocational credentials, remedial education, field of study, and graduate school. The wide variation in the returns to different postsecondary investments that we document leads to the question of how students from different backgrounds sort into these different institutions and programs. We discuss the emerging research showing that lower-SES students, especially in the U.S., are more likely to sort into colleges and programs with lower returns as well as results from recent U.S.-based interventions and policies designed to support success among students from disadvantaged backgrounds. The Chapter concludes with some broad directions for future research.

More →