Valid and reliable measurements of teaching quality facilitate school-level decision-making and policies pertaining to teachers, but conventional classroom observations are costly, prone to rater bias, and hard to implement at scale. Using nearly 1,000 word-to-word transcriptions of 4th- and 5th-grade English language arts classes, we apply novel text-as-data methods to develop automated, objective measures of teaching to complement classroom observations. This approach is free of rater bias and enables the detection of three instructional factors that are well aligned with commonly used observation protocols: classroom management, interactive instruction, and teacher-centered instruction. The teacher-centered instruction factor is a consistent negative predictor of value-added scores, even after controlling for teachers’ average classroom observation scores. The interactive instruction factor predicts positive value-added scores.
Measuring Teaching Practices at Scale: A Novel Application of Text-as-Data Methods
Education level
Topics
Document Object Identifier (DOI)
10.26300/b8cd-ds52
EdWorkingPaper suggested citation:
Liu, Jing, and Julie Cohen. (). Measuring Teaching Practices at Scale: A Novel Application of Text-as-Data Methods. (EdWorkingPaper:
-239). Retrieved from
Annenberg Institute at Brown University: https://doi.org/10.26300/b8cd-ds52Related Resources from the EdExchange
A library of instruments for education research and school improvement
A new model for informed decision-making in education