University of Virginia
Is Engaging Online Learning Possible? A Study of an Innovative National Virtual Summer Program
We study an early effort amid the Covid-19 pandemic to develop new approaches to virtually serving students, supporting teachers, and promoting equity. This five-week, largely synchronous, summer program served 11,769 rising 4th-9thgraders. “Mentor teachers” provided PD and videos of themselves… more →
Using Semantic Similarity to Assess Adherence and Replicability of Intervention Delivery
Researchers are rarely satisfied to learn only whether an intervention works, they also want to understand why and under what circumstances interventions produce their intended effects. These questions have led to increasing calls for implementation research to be… more →
Nudges Don’t Work When the Benefits Are Ambiguous: Evidence from a High-Stakes Education Program
The Post-9/11 GI Bill allows service members to transfer generous education benefits to a dependent. We run a large scale experiment that encourages service members to consider the transfer option among a population that includes individuals for whom the transfer benefits are clear and… more →
Improving Low-Performing Schools: A Meta-Analysis of Impact Evaluation Studies
The public narrative surrounding efforts to improve low-performing K-12 schools in the U.S. has been notably gloomy. Observers argue that either nothing works or we don’t know what works. At the same time, the federal government is asking localities to implement evidence-based interventions. But… more →
Measuring Teaching Practices at Scale: A Novel Application of Text-as-Data Methods
Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers, but conventional classroom observations are costly, prone to rater bias, and hard to implement at scale. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th… more →
The Forgotten 20 Percent: Achievement and Growth in Rural Schools Across the Nation
Nearly one in five U.S. students attends a rural school, yet we know very little about achievement gaps and academic growth in rural schools. This study leverages a unique dataset that includes longitudinal test scores for more than five million 3rd to 8th grade students in approximately 17,000… more →
Teacher Evaluation, Ambitious Mathematics Instruction, and Mathematical Knowledge for Teaching: Evidence from Early Career Teachers
While teacher evaluation policies have been central to efforts to enhance teaching quality over the past decade, little is known about how teachers change their instructional practices in response to such policies. To address this question, this paper drew on classroom observation and survey… more →
Projecting the potential impacts of COVID-19 school closures on academic achievement
With 55 million students in the United States out of school due to the COVID-19 pandemic, education systems are scrambling to meet the needs of schools and families, including planning how best to approach instruction in the fall given students may be farther… more →
The learning curve: Revisiting the assumption of linear growth across the school year
Important educational policy decisions, like whether to shorten or extend the school year, often require accurate estimates of how much students learn during the year. Yet, related research relies on a mostly untested assumption: that growth in achievement is linear throughout the entire… more →
Can Camp Get You Into a Good Secondary School? A Field Experiment of Targeted Instruction in Kenya
Access to quality secondary schooling can be life-changing for students in developing contexts. In Kenya, entrance to such schools has historically been determined by performance on a high-stakes exam. Understandably then, preparation for this exam is a high priority for Kenyan families and… more →
Do Response Styles Affect Estimates of Growth on Social-emotional Constructs? Evidence from Four Years of Longitudinal Survey Scores
Survey respondents use different response styles when they use the categories of the Likert scale differently despite having the same true score on the construct of interest. For example, respondents may be more likely to use the extremes of the response scale independent of their true… more →
Estimating Student Growth on Psychological and Social-emotional Constructs: A Comparison of Multiple Scoring Approaches
A huge portion of what we know about how humans develop, learn, behave, and interact is based on survey data. Researchers use longitudinal growth modeling to understand the development of students on psychological and social-emotional learning constructs across elementary and middle school. In… more →
Trends in Children’s Academic Skills at School Entry: 2010 to 2017
Students’ level of academic skills at school entry are a strong predictor of later academic success, and focusing on improving these skills during the preschool years has been a priority during the past ten years. Evidence from two prior nationally representative studies indicated that incoming… more →
Is Effective Teacher Evaluation Sustainable? Evidence from DCPS
Ten years ago, many policymakers viewed the reform of teacher evaluation as a highly promising mechanism to improve teacher effectiveness and student achievement. Recently, that enthusiasm has dimmed as the available evidence suggests the subsequent reforms had a mixed record of implementation… more →
Teacher Evaluation and Teacher Turnover, New Evidence from District of Columbia Public Schools
Few topics in education policy have received more attention than teacher turnover—and rightly so. The cost of losing a good teacher can be substantial and is born most directly by students. It is now widely recognized that teachers differ considerably in their ability to improve student outcomes… more →
Nearly three decades into the charter school movement, what has research told us about charter schools?
When charter schools first entered the landscape, the debate was contentious, with both advocates and critics using strong rhetoric. Advocates often sold charter schools as a silver bullet solution for not only the students who attend these schools, but the broader traditional public school… more →
Federalism, Race, and the Politics of Turnaround: U.S. Public Opinion on Improving Low-Performing Schools and Districts
Public support for school improvement policies can increase the success and durability of those reforms. However, little is known about public views on turnaround. We deployed questions and embedded experiments in a nationally representative 2017 survey (n=4,214) to uncover opinions regarding (a… more →
Nudging at Scale: Experimental Evidence from FAFSA Completion Campaigns
Do nudge interventions that have generated positive impacts at a local level maintain efficacy when scaled state or nationwide? What specific mechanisms explain the positive impacts of promising smaller-scale nudges? We investigate, through two randomized controlled trials, the impact of a… more →
Helping Parents Navigate the Early Childhood Enrollment Process: Experimental Evidence from New Orleans
The early childhood enrollment process involves searching for programs, applying, verifying eligibility(for publicly funded seats), and enrolling. Many families do not complete the process. We conducted a randomized controlled trial to assess strategies for communicating with families as they… more →
The Effect of Reduced Student Loan Borrowing on Academic Performance and Default: Evidence from a Loan Counseling Experiment
Student loan borrowing for higher education has emerged as a top policy concern. Policy makers at the institutional, state, and federal levels have pursued a variety of strategies to inform students about loan origination processes and how much a student has cumulatively borrowed, and to provide… more →