Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

Multiple outcomes of education

Andrew McEachin, Douglas L. Lauen, Sarah C. Fuller, Rachel M. Perera.

The vast majority of literature on school choice, and charter schools in particular, focus on attending an elementary or middle school and often focus on test scores or other proximal outcomes. Much less is known about the long-term effects of attending a charter high school. It is important to fill this information void for a few reasons. First, schools in general affect more than just students’ test scores. Second, high schools make up a larger share of the charter sector. Third, school choice depends on freely available information for parents and students to make informed decisions about where to attend, including potential long-term benefits. We add to the empirical research on charter school effects by using a doubly-robust regression-adjusted propensity score matching approach to evaluate the impacts of charter high school attendance on 9th grade behavioral outcomes and individuals propensity to commit crime and participate in elections as young adults in North Carolina, a state with a large and growing charter school sector.

More →

Andrew C. Barr, Kelli A. Bird, Ben Castleman.

Student loan borrowing for higher education has emerged as a top policy concern. Policy makers at the institutional, state, and federal levels have pursued a variety of strategies to inform students about loan origination processes and how much a student has cumulatively borrowed, and to provide students with greater access to loan counseling. We conducted an experiment to evaluate the impact of an outreach campaign that prompted loan applicants at a large community college to make informed and active borrowing decisions and that offered them access to remote, one-onone assistance from a loan counselor. The intervention led students to reduce their unsubsidized loan borrowing by 7 percent, resulted in worse academic performance, and increased the likelihood of loan default during the three years after the intervention occurred. Our results suggest policy makers and higher education leaders should carefully examine the potential unintended consequences of efforts to reduce student borrowing, particularly in light of growing evidence regarding the counter-intuitive positive relationship between reduced borrowing levels and worse student academic and financial outcomes.

More →

Jeffrey T. Denning, Richard Murphy, Felix Weinhardt.

This paper considers an unavoidable feature of the school environment – what are the long run effects of a student’s ordinal rank in elementary school? Using administrative data from all public school students in Texas, we show that students with a higher third grade academic rank, conditional on ability and classroom fixed effects, have higher subsequent test scores, are more likely to take AP classes, to graduate high school, and to enroll in college, and ultimately have higher earnings 19 years later. The paper concludes by exploring the tradeoff between higher quality schools and higher rank in the presence of these rank-based peer effects.

More →

Alex Eble, Feng Hu.

We study the transmission of beliefs about gender differences in math ability from adults to children and how this affects girls’ math performance relative to boys. We exploit randomly assigned variation in the proportion of a child’s middle school classmates whose parents believe boys are better than girls at learning math. An increase in exposure to peers whose parents report this belief increases a child’s likelihood of believing it, with similar effects for boys and girls and greater effects from peers of the same gender. This exposure also affects children’s perceived difficulty of math, aspirations, and academic performance, generating gains for boys and losses for girls. These effects are not driven by other sources of peer effects, such as peer cognitive ability, peer parent traits such as education and income, or the gender composition of the classroom.

More →

Angela R. Watson, Jay P. Greene, Heidi H. Erickson, Molly I. Beck.

In recent decades, institutions, teachers, and students report a decline in field trip attendance. The impact of this decline on educational and societal outcomes such as social-emotional skill acquisition is unknown. Social-emotional learning (SEL) are skills thought to be important to life and relationship success and are associated with better long-term student outcomes. This study describes the results of the first-ever longitudinal experiment of the effects of multiple arts-related field trips on elementary school students of color in a large urban school district. Treated students attended three field trips to an art museum, a live theater production, and a symphony performance. We find significant educational benefits from attending multiple arts field trips on social-emotional outcomes, including increased feelings of tolerance and social perspective taking. Our findings also suggest that female treatment students exhibit increased conscientiousness as compared to their control group peers; however, these effects dissipate when treatment ceases. Further, female students who receive three additional field trips in a second treatment year act more conscientious than in the prior year of treatment. Increased exposure to the arts through field trip experiences does not, however, appear to increase students’ desire to consume or participate in the arts, nor do we find an impact of treatment on empathy. These findings suggest that arts-related field trips elicit meaningful changes in students’ social-emotional attitudes and actions and that a decline in field trip attendance may be detrimental.

More →

Jay P. Greene, Heidi H. Erickson, Angela R. Watson, Molly I. Beck.

Field trips to see theater performances are a long-standing educational practice, however, there is little systematic evidence demonstrating educational benefits. This article describes the results of five random assignment experiments spanning two years where school groups were assigned by lottery to attend a live theater performance, or for some groups, watch a movie-version of the same story. We find significant educational benefits from seeing live theater, including higher levels of tolerance, social perspective taking, and stronger command of the plot and vocabulary of those plays. Students randomly assigned to watch a movie did not experience these benefits. Our findings also suggest that theater field trips may cultivate the desire among students to frequent the theater in the future.

More →

Christina Ciocca Eller.

The rise of accountability standards has pressed higher education organizations to oversee the production and publication of data on student outcomes more closely than in the past. However, the most common measure of student outcomes, average bachelor's degree completion rates, potentially provides little information about the direct impacts of colleges and universities on student success. Extending scholarship in the new institutionalist tradition, I hypothesize that higher education organizations today exist as, “superficially coupled systems,” where colleges closely oversee their technical outputs but where those technical outputs provide limited insight into the direct role of colleges and universities in producing them. I test this hypothesis using administrative data from the largest, public, urban university system in the United States together with fixed effects regression and entropy balancing techniques, allowing me to isolate organizational effects. My results provide evidence for superficial coupling, suggesting that inequality in college effectiveness exists both between colleges and within colleges, given students' racial background and family income. They also indicate that institutionalized norms surrounding accountability have backfired, enabling higher education organizations, and other bureaucratic organizations like them, to maintain legitimacy without identifying and addressing inequality.

More →

Emily Rauscher.

Educational assortative mating patterns in the U.S. have changed since the 1960s, but we know little about the effects of these patterns on children, particularly on infant health.  Rising educational homogamy may alter prenatal contexts through parental stress and resources, with implications for inequality. Using 1969-1994 NVSS birth data and aggregate cohort-state census measures of spousal similarity of education and labor force participation as instrumental variables (IV), this study estimates effects of parental educational similarity on infant health.  Controlling for both maternal and paternal education, results support family systems theory and suggest that parental educational homogamy is beneficial for infant health while hypergamy is detrimental.  These effects are stronger in later cohorts and are generally limited to mothers with more education.  Hypogamy estimates are stable by cohort, suggesting that rising female hypogamy may have limited effect on infant health.  In contrast, rising educational homogamy could have increasing implications for infant health.  Effects of parental homogamy on infant health could help explain racial inequality of infant health and may offer a potential mechanism through which inequality is transmitted between generations.

More →

Matthew Kraft.

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen’s standards are often large in the context of field-based education interventions. This focus on magnitude also obscures important differences in study features, program costs, and scalability. In this paper, I propose a new framework for interpreting effect sizes of education interventions, which consists of five broadly applicable guidelines and a detailed schema for interpreting effects from causal studies with standardized achievement outcomes. The schema introduces new effect-size and cost benchmarks, while also considering program scalability. Together, the framework provides scholars and research consumers with an empirically-based, practical approach for interpreting the policy importance of effect sizes from education interventions.

More →