Search and Filter
Instructional technology
Is Big Data Better? LMS Data and Predictive Analytic Performance in Postsecondary Education
Tags: Instructional technologyColleges have increasingly turned to data science applications to improve student outcomes. One prominent application is to predict students’ risk of failing a course. In this paper, we investigate whether incorporating data from learning management systems (LMS)--which captures detailed… more →
Online Tutoring by College Volunteers: Experimental Evidence from a Pilot Program
Topics: Student LearningTags: Tutoring, Instructional technologyA substantial body of experimental evidence demonstrates that in-person tutoring programs can have large impacts on K-12 student achievement. However, such programs typically are costly and constrained by a limited local supply of tutors. In partnership with CovEducation (CovEd), we conduct a… more →
Let’s Chat: Leveraging Chatbot Outreach for Improved Course Performance
Katharine Meyer, Lindsay C. Page, Catherine Mata, Eric N. Smith, B. Tyler Walsh, C. Lindsey Fifield, Michelle Tyson, Amy Eremionkhale, Michael Evans, Shelby Frost, Eye Eoun Jung.Tags: Instructional technologyThis study reports on the causal effects of using a non-generative artificial intelligence (AI) chatbot to provide course-specific, proactive outreach and support to students in large-enrollment undergraduate courses. Across both an American Government and Microeconomics course, students… more →
Navigating Remote Delivery of Assessments for Head Start Children During the COVID-19 Pandemic
Leiah Groom-Thomas, Monica G. Lee, Cate Smith Todd, Kathleen Lynch, Susanna Loeb, Scott McConnell, Lydia Carlis.Many preschool agencies nationwide continue to experience closures and/or conversions to virtual or hybrid instruction due to the ongoing COVID-19 pandemic. Despite the importance of understanding young children’s learning and development during the COVID emergency, limited knowledge exists on… more →
Learning-Mode Choice, Student Engagement, and Achievement Growth During the COVID-19 Pandemic
Topics: Student LearningThe COVID-19 pandemic initially resulted in an unanticipated and near-universal shift from in-person to virtual instruction in spring 2020. During the 2020-21 school year, schools began to re-open and families were faced with decisions regarding the instructional mode for their children. We… more →
Bridging human and machine scoring in experimental assessments of writing: tools, tips, and lessons learned from a field trial in education
Topics: MethodsIn a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the… more →
The Uncertain Role of Educational Software in Remediating Student Learning: Regression discontinuity evidence from three local education agencies
Topics: Student LearningEducators must balance the needs of students who start the school year behind grade level with their obligation to teach grade-appropriate content to all students. Educational software could help educators strike this balance by targeting content to students’ differing levels of mastery. Using a… more →
Can Automated Feedback Improve Teachers’ Uptake of Student Ideas? Evidence From a Randomized Controlled Trial In a Large-Scale Online Course
Topics: Teacher and Leader DevelopmentProviding consistent, individualized feedback to teachers is essential for improving instruction but can be prohibitively resource-intensive in most educational contexts. We develop M-Powering Teachers, an automated tool based on natural language processing to give teachers feedback on their… more →
Bringing Transparency to Predictive Analytics: A Systematic Comparison of Predictive Modeling Methods in Higher Education
Topics: MethodsColleges have increasingly turned to predictive analytics to target at-risk students for additional support. Most of the predictive analytic applications in higher education are proprietary, with private companies offering little transparency about their underlying models.
A Cautionary Tale of Tutoring Hard-to-Reach Students in Kenya
Topics: Student LearningCovid-19-induced school closures generated great interest in tutoring as a strategy to make up for lost learning time. Tutoring is backed by a rigorous body of research, but it is unclear whether it can be delivered effectively remotely. We study the effect of teacher-student phone call… more →
Increasing success in higher education: The relationships of online course taking with college completion and time-to-degree
Online courses provide flexible learning opportunities, but research suggests that students may learn less and persist at lower rates compared to face-to-face settings. However, few research studies have investigated more distal effects of online education. In this study we analyzed six years of… more →
Mobilizing Developmental Education: The Causal Effect of Mobile App Courseware on the College Outcomes of Developmental Education Students
Developmental education, in which college students deemed unprepared for college-level coursework enroll in non-credit bearing courses, is widespread in American higher education. The current study evaluates the effect of mobile app courseware on the college outcomes of developmental education… more →
Is Engaging Online Learning Possible? A Study of an Innovative National Virtual Summer Program
We study an early effort amid the Covid-19 pandemic to develop new approaches to virtually serving students, supporting teachers, and promoting equity. This five-week, largely synchronous, summer program served 11,769 rising 4th-9thgraders. “Mentor teachers” provided PD and videos of themselves… more →
Engaging Girls in Math: The Unequal Effects of Text Messaging to Help Parents Support Early Math Development
Topics: Student LearningThis study assesses the effects of two text messaging programs for parents that aim to support the development of math skills in prekindergarten students. One program focuses purely on math, while the other takes an identical approach but focuses on a combination of math, literacy, and social-… more →
The Economic Impacts of Learning Losses
Topics: Student LearningThe worldwide school closures in early 2020 led to losses in learning that will not easily be made up for even if schools quickly return to their prior performance levels. These losses will have lasting economic impacts both on the affected students and on each nation unless they are effectively… more →
Online Course-Taking and Expansion of Curricular Options in High Schools
Topics: Student LearningA common rationale for offering online courses in K-12 schools is that they allow students to take courses not offered at their schools; however, there has been little research on how online courses are used to expand curricular options when operating at scale. We assess the extent to which… more →
Inequality in Household Adaptation to Schooling Shocks: Covid-Induced Online Learning Engagement in Real Time
We use high frequency internet search data to study in real time how US households sought out online learning resources as schools closed due to the Covid-19 pandemic. By April 2020, nationwide search intensity for both school- and parent-centered online learning resources had roughly doubled… more →
Proactive student support using artificially intelligent conversational chatbots: The importance of targeting the technology
We examine through a field experiment whether outreach and support provided through an AI-enabled chatbot can reduce summer melt and improve first-year college enrollment at a four-year university and at a community college. At the four-year college, the chatbot increased overall success with… more →
Can Technology Transform Communication between Schools, Teachers, and Parents? Evidence from a Randomized Field Trial
Topics: Families and CommunitiesWe study the adoption and implementation of a new mobile communication app among a sample of 132 New York City public schools. The app provides a platform for sharing general announcements and news as well as engaging in personalized two-way communication with individual parents. We provide… more →
Does Online Course-taking Increase High School Completion and Open Pathways to Postsecondary Education Opportunities?
Recent increases in high school graduation rates have been linked anecdotally to online course-taking for credit recovery. Online course-taking that supports high school completion could open opportunities for postsecondary education pursuits. Alternatively, poorer quality online instruction… more →