Evidence-Based Practices For Assessing Students’ Social And Emotional Well-Being
Category: Student Well-Being and Mental Health
A significant share of education and development research uses data collected by workers called “enumerators.” It is well-documented that “enumerator effects”—or inconsistent practices between the individual people who administer measurement tools— can be a key source of error in survey data collection. However, it is less understood whether this is a problem for academic assessments or performance tasks. We leverage a remote phone-based mathematics assessment of primary school students and survey of their parents in Kenya. Enumerators were randomized to students to study the presence of enumerator effects. We find that both the academic assessment and survey was prone to enumerator effects and use simulation to show that these effects were large enough to lead to spurious results at a troubling rate in the context of impact evaluation. We therefore recommend assessment administrators randomize enumerators at the student level and focus on training enumerators to minimize bias.
Keywords
Enumerator effects, impact evaluations, remote assessments, education in developing countries
Education level
Topics
Document Object Identifier (DOI)
10.26300/hfgf-3404
