Search and Filter

The Reliability of Classroom Observations and Student Surveys in Non-Research Settings: Evidence from a Middle-Income Country

We present one of the first Generalizability studies of non-test measures of teaching effectiveness administered by practitioners in a middle-income country. The reliability of observations varies widely (from 0 to 0.75 on a 0-1 scale) and depends upon their context (whether they are conducted during training or on the job) and rater assignment configurations. The reliability of surveys varies substantially, coinciding with a change in which students were sampled across occasions. Our estimates are comparable to the reliability from research in highincome countries, but the variation within our estimates and between them and those from individual studies suggests that practitioners should conduct their own reliability analyses. We offer guidance on leveraging such analyses to improve the reliability of their measures.

Education level
Document Object Identifier (DOI)
10.26300/c9zp-p565
EdWorkingPaper suggested citation:
Ganimian, Alejandro J., Andrew D. Ho, and Alejandra Campos Quintero. (). The Reliability of Classroom Observations and Student Surveys in Non-Research Settings: Evidence from a Middle-Income Country. (EdWorkingPaper: -1442). Retrieved from Annenberg Institute at Brown University: https://doi.org/10.26300/c9zp-p565

Machine-readable bibliographic record: RIS, BibTeX