Search EdWorkingPapers

Search for EdWorkingPapers here by author, title, or keywords.

EdWorkingPapers

Dorottya Demszky, Jing Liu, Zid Mancenido, Julie Cohen, Heather C. Hill, Dan Jurafsky, Tatsunori Hashimoto.

In conversation, uptake happens when a speaker builds on the contribution of their interlocutor by, for example, acknowledging, repeating or reformulating what they have said. In education, teachers' uptake of student contributions has been linked to higher student achievement. Yet measuring and improving teachers' uptake at scale is challenging, as existing methods require expensive annotation by experts. We propose a framework for computationally measuring uptake, by (1) releasing a dataset of student-teacher exchanges extracted from US math classroom transcripts annotated for uptake by experts; (2) formalizing uptake as pointwise Jensen-Shannon Divergence (pJSD), estimated via next utterance classification; (3) conducting a linguistically-motivated comparison of different unsupervised measures and (4) correlating these measures with educational outcomes. We find that although repetition captures a significant part of uptake, pJSD outperforms repetition-based baselines, as it is capable of identifying a wider range of uptake phenomena like question answering and reformulation. We apply our uptake measure to three different educational datasets with outcome indicators. Unlike baseline measures, pJSD correlates significantly with instruction quality in all three, providing evidence for its generalizability and for its potential to serve as an automated professional development tool for teachers.

More →


Daniel Kreisman, Jonathan Smith, Bondi Arifin.

How do college non-completers list schooling on their resumes? The negative signal of not completing might outweigh the positive signal of attending but not persisting. If so, job-seekers might hide non-completed schooling on their resumes. To test this we match resumes from an online jobs board to administrative educational records. We find that fully one in three job-seekers who attended college but did not earn a degree omit their only post-secondary schooling from their resumes. We further show that these are not casual omissions but are strategic decisions systematically related to schooling characteristics, such as selectivity and years of enrollment. We also find evidence of lying, and show which degrees listed on resumes are most likely untrue. Lastly, we discuss implications. We show not only that this implies a commonly held assumption, that employers perfectly observe schooling, does not hold, but also that we can learn about which college experiences students believe are most valued by employers.

More →


Kaitlin Anderson, Bashir Sadat, Raquel Sosa.

Advanced course-taking in high school sends an important signal to college admissions officers, helps reduce the cost and time to complete a post-secondary degree, and increases educational attainment and future earnings. However, Black and Hispanic students in the U.S. are underrepresented in Advanced Placement coursework and dual enrollment (i.e. early college). In this paper, we systematically examine the social, demographic, economic, and policy factors that are predictive of racial gaps in AP enrollment and access to DE across the U.S. We find that many of the same factors that predict higher AP access overall also predict higher racial/ethnic gaps in AP, suggesting that policies aimed at increasing AP access need to specifically attend to the inequitable access, rather than simply focusing on increasing access overall. We also find evidence that that might indicate opportunity hoarding by White families contributes to AP gaps – but not DE gaps – suggesting that DE acts as a more equitable avenue for access to college coursework. Our most novel contribution to the literature is our analysis of policies aimed at reducing teacher shortages in high needs areas, in which we find no evidence that the disparities in access to advanced coursework were reduced following implementation of these policies.

More →


Sophie Litschwartz, Luke Miratrix.

In multisite experiments, we can quantify treatment effect variation with the cross-site treatment effect variance. However, there is no standard method for estimating cross-site treatment effect variance in multisite regression discontinuity designs (RDD). This research rectifies this gap in the literature by systematically exploring and evaluating methods for estimating the cross-site treatment effect variance in multisite RDDs. Specifically, we formalize a fixed intercepts/random coefficients (FIRC) RDD model and develop a random effects meta-analysis (Meta) RDD model for estimating cross-site treatment effect variance. We find that a restricted FIRC model works best when the running variables' relationship to the outcome is stable across sites but can be biased otherwise. In those instances, we recommend using either the unrestricted FIRC model or the meta-analysis model; with the unrestricted FIRC model generally performing better when the average number of in-bandwidth observations is less than 120 and the meta-analysis model performing better when the average number of in-bandwidth observations is above 120. We apply our models to a high school exit exam policy in Massachusetts that required students who passed the high school exit exam but were still determined to be nonproficient to complete an ``Education Proficiency Plan" (EPP). We find the EPP policy had a positive local average treatment effect on whether students completed a math course their senior year on average across sites, but that the impact varied enough such that a third of schools could have had a negative impact.

More →


Ilana Umansky, Manuel Vazquez Cano, Lorna Porter.

Federal law defines eligibility for English learner (EL) classification differently for Indigenous students compared to non-Indigenous students. Indigenous students, unlike non-Indigenous students, are not required to have a non-English home or primary language. A critical question, therefore, is how EL classification impacts Indigenous students’ educational outcomes. This study explores this question for Alaska Native students, drawing on data from five Alaska school districts. Using a regression discontinuity design, we find evidence that among students who score near the EL classification threshold in kindergarten, EL classification has a large negative impact on Alaska Native students’ academic outcomes, especially in the 3rd and 4th grades. Negative impacts are not found for non-Alaska Native students in the same districts.

More →


Matthew A. Kraft, Alvin Christian.

A core motivation for the widespread teacher evaluation reforms of the last decade was the belief that these new systems would promote teacher development through high-quality feedback. We examine this theory by studying teachers’ perceptions of evaluation feedback in Boston Public Schools and evaluating the district’s efforts to improve feedback through an administrator training program. Teachers generally reported that evaluators were trustworthy, fair, and accurate, but that they struggled to provide high-quality feedback. We find little evidence the training program improved perceived feedback quality, classroom instruction, teacher self-efficacy, or student achievement. Our results illustrate the challenges of using evaluation systems as engines for professional growth when administrators lack the time and skill necessary to provide frequent, high-quality feedback.

More →


S. Michael Gaddis, Joseph Murphy.

Scholars debate whether cultural capital reproduces existing inequalities or provides a path to upward mobility. Most studies, however, focus only on cross-sectional associations and are unclear about how disadvantaged adolescents can increase their amounts of cultural capital. Adolescents may be able to increase cultural capital through ties to adults with high educational attainment. We investigate this topic using experimental longitudinal data on mentoring relationships. We find that mentors with a college degree or greater have positive effects on cultural capital, but primarily for adolescents with a parent with some college or greater. Thus, cultural capital may not be an engine of social mobility if adolescents from low-SES households cannot obtain or increase their cultural capital.

More →


Benjamin W. Arold, M. Danish Shakeel.

From 2010 onwards, most US states have aligned their education standards by adopting the Common Core State Standards (CCSS) for math and English Language Arts. The CCSS did not target other subjects such as science and social studies. We estimate spillovers of the CCSS on student achievement in non-targeted subjects in models with state and year fixed effects. Using student achievement data from the NAEP, we show that the CCSS had a negative effect on student achievement in non-targeted subjects. This negative effect is largest for underprivileged students, exacerbating racial and socioeconomic student achievement gaps. Using teacher surveys, we show that the CCSS caused a reduction in instructional focus on nontargeted subjects.

More →


Riley Acton.

In the competitive U.S. higher education market, institutions differentiate themselves to attract both students and tuition dollars. One understudied example of this differentiation is the increasing trend of "colleges" becoming "universities" by changing their names. Leveraging variation in the timing of such conversions in an event study framework, I show that becoming a university increases enrollments at both the undergraduate and graduate levels, which leads to an increase in degree production and total revenues. I further find that these effects are largest when institutions are the first in their market to convert to a university and can lead to negative spillover effects on non-converting colleges.

More →


Robert M. Costrell.

The ongoing crisis in teacher pension funding has led states to consider various reforms in plan design, to replace the traditional benefit formulas, based on years of service and final average salary (FAS).  One such design is a cash balance (CB) plan, long deployed in the private sector, and increasingly considered, but rarely yet adopted for teachers.  Such plans are structured with individual 401(k)-type retirement accounts, but with guaranteed returns.  In this paper I examine how the nation’s first CB plan for teachers, in Kansas, has played out for system costs, and the level and distribution of individual benefits, compared to the FAS plan it replaced.  My key findings are:  (1) employer-funded benefits were modestly reduced, despite the surface appearance of more generous employer contribution matches; (2) more importantly, the cost of the pension guarantee, which is off-the-books under standard actuarial accounting, was reduced quite substantially.  In addition, benefits are more equitably distributed between short termers and career teachers than under the back-loaded structure of benefits characteristic of FAS plans.   The key to the plan’s cost reduction is that the guaranteed return approximates a low-risk market return, considerably lower than the assumed return on risky assets.   

More →