Search and Filter

Measures Still Matter: Replicating and Extending a Meta-Analysis of the Effects of Educational Apps on Children's Reading and Math Skills with Six Years of New Data

 

This study replicates and extends a meta-analysis of 36 studies of educational apps (Kim et al., 2021) with six years of new data. We synthesize 841 effect sizes from 141 studies evaluating the effectiveness of educational apps on reading and math skills of students ages 3-9. Replicating the original study, we find a moderate positive pooled effect size with substantial heterogeneity (d = .40, 95% CI = [.32,.49], τ = .37). We replicate the findings that effect sizes are larger on researcher-developed outcome measures and outcomes that measure constrained skills, and that app dosage and quality ratings do not predict effect sizes. We also find lower effect sizes for randomized controlled trial designs and studies with larger samples. Our results provide strong evidence that educational apps can serve as useful tools to support student learning, but caution that evidence of app effectiveness at scale and with long-term followup remains limited.

Education level
Document Object Identifier (DOI)
10.26300/d9yw-r226
EdWorkingPaper suggested citation:
Gilbert, Joshua B., William S. Young, and James S. Kim. (). Measures Still Matter: Replicating and Extending a Meta-Analysis of the Effects of Educational Apps on Children's Reading and Math Skills with Six Years of New Data. (EdWorkingPaper: -1579). Retrieved from Annenberg Institute at Brown University: https://doi.org/10.26300/d9yw-r226

Machine-readable bibliographic record: RIS, BibTeX