Search EdWorkingPapers

Search EdWorkingPapers by author, title, or keywords.

Carly D. Robinson

Carly D. Robinson, Cynthia Pollard, Sarah Novicoff, Sara White, Susanna Loeb.

In-person tutoring has been shown to improve academic achievement. Though less well-researched, virtual tutoring has also shown a positive effect on achievement but has only been studied in grade five or above. We present findings from the first randomized controlled trial of virtual tutoring for young children (grades K-2). Students were assigned to 1:1 tutoring, 2:1 tutoring, or a control group. Assignment to any virtual tutoring increased early literacy skills by 0.05-0.08 SD with the largest effects for 1:1 tutoring (0.07-0.12 SD). Students initially scoring well below benchmark and first graders experienced the largest gains from 1:1 tutoring (0.15 and 0.20 SD, respectively). Effects are smaller than typically seen from in-person early literacy tutoring programs but still positive and statistically significant, suggesting promise particularly in communities with in-person staffing challenges.

More →

Carly D. Robinson, Katharine Meyer, Chasity Bailey-Fakhoury, Amirpasha Zandieh, Susanna Loeb.

College students make job decisions without complete information. As a result, they may rely on misleading heuristics (“interesting jobs pay badly”) and pursue options misaligned with their goals. We test whether highlighting job characteristics changes decision making. We find increasing the salience of a job’s monetary benefits increases the likelihood college students apply by 196%. In contrast, emphasizing prosocial, career, or social benefits has no effect, despite students identifying these benefits as primary motivators for applying. The study highlights the detrimental incongruencies in students’ decision making alongside a simple strategy for recruiting college students to jobs that offer enriching experiences.

More →

Kalena E. Cortes, Karen Kortecamp, Susanna Loeb, Carly D. Robinson.

This paper presents the results from a randomized controlled trial of Chapter One, an early elementary reading tutoring program that embeds part-time tutors into the classroom to provide short bursts of 1:1 instruction. Eligible kindergarten students were randomly assigned to receive supplementary tutoring during the 2021-22 school year (N=818). The study occurred in a large Southeastern district serving predominantly Black and Hispanic students. Students assigned to the program were over two times more likely to reach the program’s target reading level by the end of kindergarten (70% vs. 32%). The results were largely homogenous across student populations and extended to district-administered assessments. These findings provide promising evidence of an affordable and sustainable approach for delivering personalized reading tutoring at scale.

More →

Carly D. Robinson, Biraj Bisht, Susanna Loeb.

Billions of dollars are invested in opt-in, educational resources to accelerate students’ learning. Although advertised to support struggling, marginalized students, there is no guarantee these students will opt in. We report results from a school system’s implementation of on-demand tutoring. The take up was low. At baseline, only 19% of students ever accessed the platform, and struggling students were far less likely to opt in than their more engaged and higher achieving peers. We conducted a randomized controlled trial (N=4,763) testing behaviorally-informed approaches to increase take-up. Communications to parents and students together increase the likelihood students access tutoring by 46%, which led to a four-percentage point decrease in course failures. Nonetheless, take-up remained low, showing concerns that opt-in resources can increase—instead of reduce—inequality are valid. Without targeted investments, opt-in educational resources are unlikely to reach many students who could benefit.

More →

Carly D. Robinson.

Few question the value of teacher-student relationships (TSRs) for educational outcomes. TSRs are positively associated with students’ achievement and engagement, as well as teachers’ well-being. Building and maintaining these crucial classroom relationships, however, is not easy. Drawing on prominent motivation theories in educational psychology, I present the Motivating Teacher-Student Relationships framework for understanding what motivates teachers to build positive TSRs. In particular, I focus on how teachers’ motivational beliefs about TSRs energize, direct, and sustain their efforts to engage in relationship-building behaviors and, thus, lead to positive relationships with their students. To build positive TSRs, teachers must believe it is their role to build TSRs, value TSRs, and believe they can successfully build TSRs (i.e., have relational self-efficacy). These beliefs are shaped by teachers’ sociocultural contexts and can facilitate or undermine the development of these learning relationships. With a greater understanding of how motivational beliefs influence social relationships, the field of education can more effectively develop theoretically grounded interventions to improve TSRs and mitigate inequality.

More →

Carly D. Robinson, Raj Chande, Simon Burgess, Todd Rogers.

Many educational interventions encourage parents to engage in their child’s education as if parental time and attention is limitless. Sadly, though, it is not. Successfully encouraging certain parental investments may crowd out other productive behaviors. A randomized field experiment (N = 2,212) assessed the impact of an intervention in which parents of middle and high school students received multiple text messages per week encouraging them to ask their children specific questions tied to their science curriculum. The intervention increased parent-child at-home conversations about science but did not detectably impact science test scores. At the same time, the intervention decreased parent engagement in other, potentially productive, behaviors, such as turning off the television or monitoring their child’s studying. These findings illustrate that parent engagement interventions are not costless: there are opportunity costs to shifting parental effort.

More →

Carly D. Robinson, Susanna Loeb.

Research consistently demonstrates that tutoring interventions have substantial positive effects on student learning. As a result, tutoring has emerged as a promising strategy for addressing COVID-related learning loss and affording greater educational opportunities for students living in poverty. The effectiveness of tutoring programs, however, varies greatly, and these variations may drive differential gains in student learning. Therefore, determining the program characteristics that do and do not drive positive student outcomes will be key to providing guidance for policymakers and practitioners who want to implement high-impact tutoring at scale. Our goal is to highlight the programs, characteristics, and conditions that evidence suggests make for effective tutoring and to create an evidence-based framework for delivering and evaluating tutoring interventions. In addition, we identify promising questions for future research.

More →

Jessica Lasky-Fink, Carly D. Robinson, Hedy Chang, Todd Rogers.

Many states mandate districts or schools notify parents when students have missed multiple unexcused days of school. We report a  randomized experiment (N = 131,312) evaluating the impact of sending parents truancy notifications modified to target behavioral barriers that can hinder effective parental engagement. Modified truancy notifications that used simplified language, emphasized parental efficacy, and highlighted the negative incremental effects of missing school reduced absences by 0.07 days compared to the standard, legalistic, and punitively-worded notification—an estimated 40% improvement over the standard truancy notification. This work illustrates how behavioral insights and randomized experiments can be used to improve administrative communications in education.

More →