Search and Filter
Generative artificial intelligence (AI) in education
The New Kid on the Tutoring Block: Definitions, Developments, and Future Directions for Hybrid Human-AI Tutoring
Topics: Student LearningHuman tutoring is among the most effective educational interventions, yet high costs and intensive resource demands make it difficult to provide broadly and at scale. We conceptualize this tension as an “iron triangle” of tradeoffs between effectiveness, affordability, and scalable reach. This… more →
Early Evidence on Employer Responses to College Student Use of Generative AI
Topics: Policy, Politics, and GovernanceTags: Generative artificial intelligence (AI) in education, Higher education, Returns to education and skillsWe conduct a survey experiment on professionals with hiring experience to investigate how employers respond to students' use of generative AI in higher education. Prior to respondents reviewing two resumes, they were randomized into a control group or one of two treatment groups. One treatment… more →
The Effects of Course-Integrated AI Tutoring on Student Performance and Engagement: A Randomized University Trial
Jing Liu, Tracy Sweet, Marty Haoyuan Chen, Jonathan Engelberg, Megan Masters, Martyn Clark, Axel Persaud, Alia Lancaster, Jeffrey Hollingsworth, Jennifer King Rice.Topics: Student LearningWe evaluate access to a course-integrated generative AI (GenAI) tutor in a randomized controlled trial involving 2,379 undergraduate students and 30 instructors across multiple disciplines in a large U.S. public university. Among sections of the same course, tutor access reduced final grades by… more →
How Colleges and Universities are Adopting AI in Higher Education: A Global Comparative Analysis
Topics: Policy, Politics, and GovernanceTags: Generative artificial intelligence (AI) in education, Higher education, International and comparativeArtificial intelligence (AI) and generative AI have become central strategic priorities for universities worldwide, yet the extent to which institutions formally embed AI into their governance, academic, and policy structures remains unclear. This study examines the institutionalization of AI… more →
When Youth Enter The Chat: An Epistemic Shift in the Validation of LLM-Based Measures of Student Talk
Topics: MethodsLarge Language Models (LLMs) are being used increasingly to measure aspects of student discourse (e.g. talk moves, collaboration, equity of voice) at scale. Typically, LLM-based measures of student talk use transcriptions of classroom conversations that only include verbal contributions, which… more →
Making AI Tutoring Productive: Evidence from a Mastery-Based Math Practice Experiment
Topics: Student LearningLarge language models (LLMs) can make tutoring more scalable, but only if students use them to reason through mistakes rather than avoid effort. We study this question in a randomized field experiment with more than 6,000 middle-school students in Hamilton County Schools using NUMI, a research-… more →
One Click Away: AI Tutoring with Khanmigo in a Two-Year School Experiment
Topics: Student LearningGenerative AI has been promoted as the technology that could transform education by providing every student a personal tutor. We provide some of the first large-scale experimental evidence, from a two-year cluster randomized trial in 18 Tennessee middle schools in which randomly assigned… more →
Conditional Hypothesis Generation for LLM-Based Text Analysis with Researcher-Specified Covariates
Topics: MethodsA core goal of computational social science is to discover interpretable differences in how language varies across outcomes of interest, such as political affiliation or instructional quality. Recent LLM-based hypothesis generation methods describe such differences in natural language, but… more →
Practitioner Voices Summit: How Teachers Evaluate AI Tools through Deliberative Sensemaking
Topics: Teacher and Leader DevelopmentTags: Generative artificial intelligence (AI) in education, Instructional technology, Professional developmentTeachers face growing pressure to integrate AI tools into their classrooms, yet are rarely positioned as agentic decision-makers in this process. Understanding the criteria teachers use to evaluate AI tools, and the conditions that support such reasoning, is essential for responsible AI… more →
Sustaining AI-Enabled Student Support: A Four-Year Implementation and Impact Study
Topics: Student Well-BeingAI-enabled chatbots are increasingly used to support student success, yet evidence on their long-term sustainability and impacts remains limited. We examine the implementation of an AI-enabled text-messaging chatbot at a large, urban public university. Drawing on system observation, discussions… more →
Leveraging Large Language Models to Assess Short Text Responses
Topics: MethodsEducational practitioners and researchers often score short, unstructured text for the presence or strength of domain-specific constructs. Manual scoring, however, faces limitations, including time- and labor-intensiveness. Large language models (LLMs) offer an automated alternative to manual… more →
Selling Student Success: A Critical Analysis of Predictive Analytics Vendors in Higher Education
Tags: Culturally responsive schooling, Generative artificial intelligence (AI) in education, Higher educationAs predictive analytics become increasingly embedded in higher education, commercial vendors offering these tools play a growing role in shaping institutional decision making, particularly through identifying students deemed “at risk.” In this qualitative study, we analyzed 132 publicly… more →
ChatGPT vs. Machine Learning: Assessing the Efficacy and Accuracy of Large Language Models for Automated Essay Scoring
Topics: MethodsAutomated Essay Scoring (AES) is a critical tool in education that aims to enhance the efficiency and objectivity of educational assessments. Recent advancements in Large Language Models (LLMs), such as ChatGPT, have sparked interest in their potential for AES. However, comprehensive comparisons… more →
A Framework for Building High-Quality Education Data for R&D in the Age of AI: The EDSI Dataset and Expert Insights
Topics: MethodsThe Gates Foundation, the Walton Family Foundation, and the Chan Zuckerberg Initiative have launched a series of collaborative investments in building large-scale datasets that can support and accelerate data infrastructure for AI R&D efforts in education. In partnership with researchers… more →
Separation of Church and State Curricula? Public Standards, Private Values, and Textbook Content
Tags: Belonging, Culturally responsive schooling, Curriculum, Elementary schools, Equity, Generative artificial intelligence (AI) in education, Human capital, Instructional design, Instructional practices, Instructional technology, LGBTQIA+ students, Parenting, Race, ethnicity, and education, Reading and literacy education, School reform, Science education, Social studies educationCurricula are a critical site of cultural transmission, yet we know little about the values conveyed in textbooks across educational settings or the forces that shape them. We examine textbooks from Texas and California public schools and religious-private and home schools spanning 1980-2022,… more →
Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise
Topics: Student LearningTags: Generative artificial intelligence (AI) in education, Instructional design, Instructional practices, Student engagement, Student supportsGenerative AI, particularly Large Language Models (LLMs), can expand access to expert guidance in domains like education, where such support is often limited. We introduce Tutor CoPilot, a Human-AI system that models expert thinking to assist tutors in real time. In a randomized controlled trial… more →