Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

Multiple outcomes of education

Jing Liu, Julie Cohen.

Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers, but conventional classroom observations are costly, prone to rater bias, and hard to implement at scale. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel text-as-data methods to develop automated, objective measures of teaching to complement classroom observations. This approach is free of rater bias and enables the detection of three instructional factors that are well aligned with commonly used observation protocols: classroom management, interactive instruction, and teacher-centered instruction. The teacher-centered instruction factor is a consistent negative predictor of value-added scores, even after controlling for teachers’ average classroom observation scores. The interactive instruction factor predicts positive value-added scores.

More →

Jonathan Smith, Joshua Goodman, Michael Hurwitz.

We provide the first estimated economic impacts of students’ access to an entire sector of public higher education in the U.S. Approximately half of Georgia high school graduates who enroll in college do so in the state’s public four-year sector, which requires minimum SAT scores for admission. Regression discontinuity estimates show enrollment in public four-year institutions boosts students’ household income around age 30 by 20 percent, and has even larger impacts for those from low income high schools. Access to this sector has little clear impact on student loan balances or other measures of financial health. For the marginal student, enrollment in such institutions has large private returns even in the short run and positive returns to state budgets in the long run.

More →

Matthew A. Kraft.

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen’s standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In this paper, I present five broad guidelines for interpreting effect sizes that are applicable across the social sciences. I then propose a more structured schema with new empirical benchmarks for interpreting a specific class of studies: causal research on education interventions with standardized achievement outcomes. Together, these tools provide a practical approach for incorporating study features, cost, and scalability into the process of interpreting the policy importance of effect sizes.

More →

Download PDF808.62 KB

Andrew McEachin, Douglas L. Lauen, Sarah C. Fuller, Rachel M. Perera.

The vast majority of literature on school choice, and charter schools in particular, focus on attending an elementary or middle school grades and often focus on test scores or other proximal outcomes. Much less is known about the long-term effects of attending a charter school in 9th grade. It is important to fill this information void for a few reasons. First, schools in general affect more than just students’ test scores. Second, secondary schools (including grades 9 to 12) make up a larger share of the charter sector. Third, school choice depends on freely available information for parents and students to make informed decisions about where to attend, including potential long-term benefits. We add to the empirical research on charter school effects by using a doubly-robust inverse probability weighted approach to evaluate the impacts of secondary charter school attendance on 9th grade behavioral outcomes and individuals propensity to commit crime and participate in elections as young adults in North Carolina, a state with a large and growing charter school sector.

More →

Joshua Bleiberg.

Policymakers have sought to increase the rigor of content standards since the 1990s. However, the literature examining the effects of reforms to content standards on student outcomes is still developing. This study examines the extent to which the Common Core State Content Standards (CC) affected student achievement and the size of achievement gaps. To identify the effect of CC I compare early implementors of the CC to late implementors of the CC in a Difference-in-Differences framework. I conducted a document analysis to measure preparation for and implementation of the CC standards, which I merge together with the National Assessment of Educational Progress student-level data. I then exploit variation in the timing of state implementation of the CC to identify its effect on students overall and academically vulnerable groups. I find that the CC has a positive effect on math scores in 4th and 8th grade, but not in reading. The CC had a large positive effect on economically advantaged students, but a null effect for economically disadvantaged students. Demanding better results without addressing the structural issues burdening economically disadvantaged students may result in unintended consequences.

More →

Eric A. Hanushek, Paul E. Peterson, Laura M. Talpey, Ludger Woessmann.

Rising inequality in the United States has raised concerns about potentially widening gaps in educational achievement by socio-economic status (SES). Using assessments from LTT-NAEP, Main-NAEP, TIMSS, and PISA that are psychometrically linked over time, we trace trends in achievement for U.S. student cohorts born between 1954 and 2001. Achievement gaps between the top and bottom quartiles of the SES distribution have been large and remarkably constant for a near half century. These unwavering gaps have not been offset by improved achievement levels, which have risen at age 14 but have remained unchanged at age 17 for the past quarter century.

More →

Corey A. DeAngelis.

Public charter schools could theoretically experience fewer school climate problems than district-run public schools because of additional competitive pressures, autonomy, and improved matches between schools and students. Using publicly available data from the New York State Education Department, I analyze differences in 13 school climate problems between public charter school and district-run public school sectors. After controlling for observable differences in students and schools between sectors, I find that public charter schools tend to report fewer school climate problems than district-run public schools in New York state in the 2017-18 school year. Specifically, public charter schools report fewer assaults with physical injuries, assaults with serious physical injuries, forcible sex offenses, other sex offenses, weapons possessions resulting from routine security checks, other weapons possessions, and false alarms than district-run public schools; however, public charter schools tend to report more cyberbullying than district-run public schools. The charter school climate advantages tend to be more pronounced in New York City than the rest of the state.

More →

Mark J. Chin, David M. Quinn, Tasminda K. Dhaliwal, Virginia S. Lovison.

Theory suggests that teachers’ implicit racial attitudes affect their students, but we lack large-scale evidence on US teachers’ implicit biases and their correlates. Using nationwide data from Project Implicit, we find that teachers’ implicit White/Black biases (as measured by the implicit association test) vary by teacher gender and race. Teachers’ adjusted bias levels are lower in counties with larger shares of Black students. In the aggregate, counties in which teachers hold higher levels of implicit and explicit racial bias have larger adjusted White/Black test score inequalities and White/Black suspension disparities.

More →

Helen F. Ladd, Mavzuna Turaeva.

We use information on the charter school choices made by North Carolina families, separately by race, who switched their child from a traditional public school (TPS) to a charter school in 2015-16 to explore how such choices affect racial segregation between schools and racial isolation within charter schools. We find that the movement of white switchers, but not minority switchers to charter schools increases racial segregation between schools. In addition, using a conditional logit model to estimate revealed preferences, we find that the value parents place on the racial composition of individual charter schools differs by the race and income of the switchers. As a result, even after we control for other valued aspects of charter schools -- such as distance from the previous traditional public school and the charter school’s mission, academic performance and services offered -- the differential preferences of the switchers leads to substantial racial isolation within charter schools.

More →

Bernardo Lara E., Kenneth A. Shores.

Revealed preferences for equal college access may be due to beliefs that equal access increases societal income or income equality. To isolate preferences for those goods, we implement an online discrete choice experiment using social statistics generated from true variation among commuting zones. We find that, ceteris paribus, the average income that individuals are willing to sacrifice is (i) $4,984 dollars to increase higher education (HE) enrollment by 1 standard deviation (14%); (ii) $1,168 dollars to decrease rich/poor gaps in HE enrollment by 1 standard deviation (8%); (iii) $2,900 to decrease the 90/10 income inequality ratio by 1 standard deviation (1.66). In addition, we find that political affiliation is an important moderator of preferences for equality. While both Democrats and Republicans are willing to trade over $4,000 dollars to increase HE enrollment by 1 standard deviation, Democrats are willing to sacrifice nearly three times more income to decrease either rich/poor gaps in HE enrollment or the 90/10 income inequality ratio by 1 standard deviation.

More →