Search EdWorkingPapers

Susanna Loeb

Carly D. Robinson, Katharine Meyer, Chasity Bailey-Fakhoury, Amirpasha Zandieh, Susanna Loeb.

College students make job decisions without complete information. As a result, they may rely on misleading heuristics (“interesting jobs pay badly”) and pursue options misaligned with their goals. We test whether highlighting job characteristics changes decision making. We find increasing the salience of a job’s monetary benefits increases the likelihood college students apply by 196%. In contrast, emphasizing prosocial, career, or social benefits has no effect, despite students identifying these benefits as primary motivators for applying. The study highlights the detrimental incongruencies in students’ decision making alongside a simple strategy for recruiting college students to jobs that offer enriching experiences.

More →

Carly D. Robinson, Cynthia Pollard, Sarah Novicoff, Sara White, Susanna Loeb.

In-person tutoring has been shown to improve academic achievement. Though less well-researched, virtual tutoring has also shown a positive effect on achievement but has only been studied in grade five or above. We present findings from the first randomized controlled trial of virtual tutoring for young children (grades K-2). Students were assigned to 1:1 tutoring, 2:1 tutoring, or a control group. Assignment to any virtual tutoring increased early literacy skills by 0.05-0.08 SD with the largest effects for 1:1 tutoring (0.07-0.12 SD). Students initially scoring well below benchmark and first graders experienced the largest gains from 1:1 tutoring (0.15 and 0.20 SD, respectively). Effects are smaller than typically seen from in-person early literacy tutoring programs but still positive and statistically significant, suggesting promise particularly in communities with in-person staffing challenges.

More →

Alvin Makori, Patricia Burch, Susanna Loeb.

High-impact tutoring has emerged as a primary school district investment for addressing learning loss that occurred during the COVID-19 pandemic. While existing research shows that high-impact tutoring is effective for accelerating student learning, this study examined the school-level facilitators and barriers to scaling high-impact tutoring. Situated in an urban traditional school district and an urban charter management organization, we collected survey and interview data from teachers and administrators to identify scaling challenges. Major barriers to scaling included time and space constraints, tutor supply and quality, updated data systems, and school level costs, while a key facilitator was teacher buy-in. We end the paper with recommendations for how districts can strategically grow their high-impact tutoring efforts.

More →

Kathleen Lynch, Monica Lee, Susanna Loeb.

The COVID-19 pandemic’s impact on preschool children’s school readiness skills remains understudied. This research investigates Head Start preschool children’s early numeracy, literacy, and executive function outcomes during a pandemic-affected school year. Study children (N = 336 assessed at fall baseline; N = 237-250 assessed in spring depending on outcome; fall baseline sample: mean age = 51 months; 46% Hispanic; 36% Black Non-Hispanic; 52% female) in a network of Head Start centers in four states (Nevada, New Jersey, Pennsylvania, and Wisconsin) experienced low in-person preschool exposure compared to national pre-pandemic norms. Children experienced fall to spring score gains during the pandemic-affected year of 0.05 SD in executive function, 0.27 SD in print knowledge, and 0.45-0.71 SD in early numeracy skills. Descriptively, for two of the three early numeracy domains measured, spring test score outcomes were stronger among children who attended more in-person preschool. We discuss implications for future research and policy.

More →

Kalena E. Cortes, Karen Kortecamp, Susanna Loeb, Carly D. Robinson.

This paper presents the results from a randomized controlled trial of Chapter One, an early elementary reading tutoring program that embeds part-time tutors into the classroom to provide short bursts of 1:1 instruction. Eligible kindergarten students were randomly assigned to receive supplementary tutoring during the 2021-22 school year (N=818). The study occurred in a large Southeastern district serving predominantly Black and Hispanic students. Students assigned to the program were over two times more likely to reach the program’s target reading level by the end of kindergarten (70% vs. 32%). The results were largely homogenous across student populations and extended to district-administered assessments. These findings provide promising evidence of an affordable and sustainable approach for delivering personalized reading tutoring at scale.

More →

Sara White, Leiah Groom-Thomas, Susanna Loeb.

Tutoring has emerged as an especially promising strategy for supporting students academically. This study synthesizes 33 articles on the implementation of tutoring, defined as one-to-one or small-group instruction in which a human tutor supports students grades K-12 in an academic subject, to better understand the facilitators and barriers to program success. We find that policies influenced tutoring implementation through the allocation of federal funding and stipulation of program design. Tutoring program launch has often been facilitated by strategic relationships between schools and external tutoring providers and strengthened by transparent assessments of program quality and effectiveness. Successful implementation hinged on the support of school leaders with the power to direct school funding, space, and time. Tutoring setting and schedule, recruitment and training, and curriculum influenced whether students are able to access quality tutoring and instruction. Ultimately, evidence suggests that tutoring was most meaningful when tutors fostered positive student-tutor relationships which they drew upon to target instruction toward students’ strengths and needs.

More →

Carly D. Robinson, Biraj Bisht, Susanna Loeb.

Billions of dollars are invested in opt-in, educational resources to accelerate students’ learning. Although advertised to support struggling, marginalized students, there is no guarantee these students will opt in. We report results from a school system’s implementation of on-demand tutoring. The take up was low. At baseline, only 19% of students ever accessed the platform, and struggling students were far less likely to opt in than their more engaged and higher achieving peers. We conducted a randomized controlled trial (N=4,763) testing behaviorally-informed approaches to increase take-up. Communications to parents and students together increase the likelihood students access tutoring by 46%, which led to a four-percentage point decrease in course failures. Nonetheless, take-up remained low, showing concerns that opt-in resources can increase—instead of reduce—inequality are valid. Without targeted investments, opt-in educational resources are unlikely to reach many students who could benefit.

More →

Christopher Doss, Hans Fricke, Susanna Loeb, Justin B. Doromal.

This study assesses the effects of two text messaging programs for parents that aim to support the development of math skills in prekindergarten students. One program focuses purely on math, while the other takes an identical approach but focuses on a combination of math, literacy, and social-emotional skills. We find no evidence that the math-only program benefits children’s math development. However, the combination program shows greater promise, particularly for girls. Quantile regressions indicate that the effects are concentrated in the lower half of the outcome distribution. We discuss and provide evidence for various hypotheses that could explain these differences.


  • We test the effects of two text messaging curricula that leverage behavioral economics principles to help parents support the math development of prekindergarteners in the home.
  • We find that a program that cycles through literacy, mathematics, and social-emotional skills increases math achievement for girls, while a program focusing solely on mathematics has no effects.
  • Benefits for girls are concentrated on those with weaker performance on mathematics assessments.
  • We posit potential mechanisms based on the literature.

More →

Leiah Groom-Thomas, Monica Lee, Cate Smith Todd, Kathleen Lynch, Susanna Loeb, Scott McConnell, Lydia Carlis.

Many preschool agencies nationwide continue to experience closures and/or conversions to virtual or hybrid instruction due to the ongoing COVID-19 pandemic. Despite the importance of understanding young children’s learning and development during the COVID emergency, limited knowledge exists on adaptable practices of assessing young children during the pandemic. We detail practices used to assess learning in 336 Head Start children across four states during three different time periods in the 2020-21 school year, using adaptation of traditionally in-person assessments of early numeracy, early literacy, and executive functioning. In doing so, we distill early lessons for the field from the application of a novel, virtual assessment method with the early childhood population. The paper describes adaptations of assessment administration for virtual implementation and incorporation of feedback into continued virtual delivery of assessments. Applications and limitations in broader contexts are discussed.

More →

Biraj Bisht, Zachary LeClair, Susanna Loeb, Min Sun.

Paraeducators perform multiple roles in U.S. classrooms, including among others preparing classroom activities, working with students individually and in small groups, supporting individualized programming for students with disabilities, managing classroom behavior, and engaging with parents and communities. Yet, little research provides insights into this key group of educators. This study combines an analysis of national administrative data to describe the paraeducator labor market with a systematic review of collective bargaining agreements and other job-defining documents in ten case-study districts. We find a large and expanding labor market of paraeducators, far more diverse along ethnic and racial lines than certified teachers but with far lower wages, fewer performance incentives, less professional development, and fewer opportunities for advancement within the profession.

More →