Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

K-12 Education

Edward J. Kim.

This study introduces the signal weighted teacher value-added model (SW VAM), a value-added model that weights student-level observations based on each student’s capacity to signal their assigned teacher’s quality. Specifically, the model leverages the repeated appearance of a given student to estimate student reliability and sensitivity parameters, whereas traditional VAMs represent a special case where all students exhibit identical parameters. Simulation study results indicate that SW VAMs outperform traditional VAMs at recovering true teacher quality when the assumption of student parameter invariance is met but have mixed performance under alternative assumptions of the true data generating process depending on data availability and the choice of priors. Evidence using an empirical data set suggests that SW VAM and traditional VAM results may disagree meaningfully in practice. These findings suggest that SW VAMs have promising potential to recover true teacher value-added in practical applications and, as a version of value-added models that attends to student differences, can be used to test the validity of traditional VAM assumptions in empirical contexts.

More →

Tammy Kolbe, Elizabeth Dhuey, Sara Menlove Doutre.

The formula used to allocate federal funding for state and local special education programs is one of the Individual with Disabilities Act’s most critical components. The formula not only serves as the primary mechanism for dividing available federal dollars among states, it also represents policymakers’ intent to equalize educational opportunities for students with disabilities nationwide. In this study, we evaluate the distribution of IDEA Part B(611) funding in the wake of changes to the formula that were instituted at the law’s 1997 reauthorization. We find that the revised formula generated large and concerning disparities among states in federal special education dollars. We find that, on average, states with proportionally larger populations of children and children living in poverty, children identified for special education, and non-White and Black children receive fewer federal dollars, both per pupil and per student receiving special education. We present policy simulations that illustrate how changes to the existing formula might improve the fairness and efficiency with which federal IDEA Part B funding is allocated to states.

More →

Umair Ali.

Over the past few decades, the U.S. has received a consistent and increasing influx of immigrants into the nation. Immigration poses challenges relating to diversity, inclusion and cohesion in education systems, including K-12 education. In the context of immigration, the theory of native flight argues that U.S. born populations move away from neighborhoods when an increasing number of immigrants move in. I test the theory of native flight in the context of K-12 school enrollments, by examining the impact of immigrant influx on public, private and public charter school enrollments, differentiating across U.S. born races and ethnicities. To do so, I merge yearly school enrollment measures from the common core of data (CCD) with immigration data from the American Community Survey (ACS) over the years 2005-2019. Using an instrumental variables approach (2SLS) to address potentially endogenous settlement patterns of immigrants into Metropolitan Statistical Areas (MSAs), I find that students of U.S. born race/ethnicities display heterogeneous enrollment responses to immigrant influx. Shares of White students and Black students in public non-charter schools decrease significantly in response to an increase in immigration. At the same time, the shares of Hispanic students and Asian students increase significantly in public non-charter schools. Analogous estimates for native flight into private schools lend further credence to public school estimates. Across private schools, the share of White students increases significantly in response to immigration. The share of Black students decreases across private schools as well, signaling a crowding-out effect. There are two key implications. First, significant White flight from the public-school system still exists over the past decade and a half. Second, while the increasing shares of White students in private schools might compensate for White students leaving the public school system, the shares of Black students are dropping across private and public schools.

More →

Ana P. Cañedo, Paul T. von Hippel.

Von Hippel & Cañedo (2021) reported that US kindergarten teachers placed girls, Asian-Americans, and children from families of high socioeconomic status (SES) into higher ability groups than their test scores alone would warrant. The results fit the view that teachers were biased.

This comment asks whether parents’ lobbying for higher placement might explain these results. The answer, for the most part, is no. Measures of parent-teacher contact explained little variation in children’s ability group placement, and did not account for the higher placement of girls, Asian-Americans, or high-SES children. In fact, Asian-American parents had less teacher contact than did white children. It appears that the biases observed by von Hippel & Cañedo resided primarily in teachers, not in parents.

We also ask whether teachers who used more objective assessment techniques were less biased in placing children into higher and lower ability groups. The answer, again, was no. Unfortunately, biases persisted in the face of objective information about students’ skill. Fortunately, the biases were not terribly large.

More →

David M. Houston, Matthew P. Steinberg.

In spring 2020, nearly every U.S. public school closed at the onset of the Covid-19 pandemic. Existing evidence suggests that local political partisanship and teachers union strength were better predictors of fall 2020 school re-opening status than Covid case and death rates. We replicate and extend these analyses using data collected over the 2020-21 academic year. We demonstrate that Covid case and death rates were meaningfully associated with initial rates of in-person instruction. We also show that all three factors—Covid, partisanship, and teachers unions—became less predictive of in-person instruction as the school year continued. We then leverage data from two nationally representative surveys of Americans’ attitudes toward education and identify an as-yet undiscussed factor that predicts in-person instruction: public support for increasing teacher salaries. We speculate that education leaders were better able to manage the logistical and political complexities of school re-openings in communities with greater support for educators.

More →

Andrew Bacher-Hicks, Olivia L. Chi, Alexis Orellana.

The unprecedented challenges of teaching during COVID-19 prompted fears of a mass exodus from the profession. We examine the extent to which these fears were realized using administrative records of Massachusetts teachers between 2015-16 and 2021-22. Relative to pre-pandemic levels, average turnover rates were similar going into the fall of 2020 but increased by 17 percent going into the fall of 2021. The fall 2021 increases were particularly high among newly hired teachers (31 percent increase), but were lower among Black and Hispanic/Latinx teachers (5 percent increases among both groups). Ethnoracial diversity of new hires increased during the pandemic, in part due to reduced professional licensure requirements. Together, these changes led to small increases in the overall ethnoracial diversity of Massachusetts teachers, but improvements to early-career retention will be needed to ensure long-term stability and diversity within the workforce.

More →

David Blazar, Doug McNamara, Genine Blue.

Instructional coaching is an attractive alternative to one-size-fits-all teacher training and development in part because it is purposefully differentiated: programming is aligned to individual teachers’ needs and implemented by an individual coach. But, how much of the benefit of coaching as an instructional improvement model depends on the specific coach with whom a teacher works? Collaborating with a national teacher training and development organization, TNTP, we find substantial variability in effectiveness across coaches in terms of changes in teachers’ classroom practice (0.43 standard deviations). The magnitude of coach effectiveness heterogeneity is close to average coaching program effects identified in other research. These findings suggest that identifying, recruiting, and supporting highly skilled coaches will be key to scaling instructional coaching programs.

More →

Sarah Guthery, Lauren P. Bailes.

Texas reduced new teacher preparation requirements in 2001 to allow more alternate paths to licensure. Within five years, this policy change resulted in over half the state’s new teachers being alternatively licensed. Using a series of first difference models, this study examines the relationship between the increased supply of new teachers in Texas and new teacher salaries prior to the policy change and in the fifteen years thereafter. We find that the policy change did increase the supply of new teachers via alternative licensing, but pay for new EC-6 teachers declined by 2 to 13 percent with differential effects based on the rate at which districts hired alternatively licensed teachers.

More →

Vladimir Kogan.

How do adult "culture wars" in education affect student learning in the classroom? I explore this question by combining information on nearly 500 school district political controversies with data on state test scores. Leveraging variation in the location and timing of these events as the basis for a difference-in-differences design, I show that student achievement declines in the wake of adult political battles. The effects are concentrated in math achievement -- the equivalent of approximately 10 days of lost learning -- and persist for at least four years. The declines are particularly pronounced for controversies surrounding racial issues and the teaching of evolution. These results suggest that well-intentioned education advocacy efforts focused on salient social justice issues may backfire, producing in unintended negative impacts on student achievement, and raise new questions about the adequacy of local democratic processes for the governance of public schools.

More →

Matthew A. Kraft, John A. List, Jeffrey A. Livingston, Sally Sadoff.

A substantial body of experimental evidence demonstrates that in-person tutoring programs can have large impacts on K-12 student achievement. However, such programs typically are costly and constrained by a limited local supply of tutors. In partnership with CovEducation (CovEd), we conduct a pilot program that has potential to ease both of these concerns. We conduct an experiment where volunteer tutors from all over the country meet 1-on-1 with middle school students online during the school day. We find that the program produces consistently positive (0.07σ for math and 0.04σ for reading) but statistically insignificant effects on student achievement. While these estimates are notably smaller than those found in many higher-dosage in-person tutoring programs, they are from a significantly lower-cost program that was delivered within the challenging context of the COVID-19 pandemic. We provide evidence that is consistent with a dosage model of tutoring where additional hours result in larger effects.

More →