Search and Filter

Submit a paper

Not yet affiliated? Have a paper you wish to post? Check out the EdWorkingPapers' scope and FAQs, and then submit your manuscript here.

How Much Teacher Is in Teacher Rating Scales?

Teacher rating scales (TRS) are often used to make service eligibility decisions for exceptional learners. Although TRS are regularly used to identify student exceptionalism either as part of an informal nomination process or through behavioral rating scales, there is little research documenting the between-teacher variance in teacher ratings or the consequences of such rater dependence. To evaluate the possible benefits or disadvantages of using TRS as part of a gifted identification process, we examined the student-, teacher-, and school-level variance in TRS controlling for student ability and achievement to determine the unique information, consistency, and potential bias in TRS. Between 10% and 25% of a students’ TRS score can be attributed to the teacher doing the rating, and between-teacher standard deviations represent an effect size of one-third to one-half standard deviation unit. Our results suggest that TRS are not easily comparable across teachers, making it impossible to set a cut score for admission into a program (or for further screening) that functions equitably across teachers.

Keywords
Gifted, Teacher Rating Scales, Teacher Nominations, Bias
Education level
Document Object Identifier (DOI)
10.26300/6vpz-en33
EdWorkingPaper suggested citation:
McCoach, D. Betsy, Anthony J. Gambino, Scott J. Peters, Daniel Long, and Del Siegle. (). How Much Teacher Is in Teacher Rating Scales?. (EdWorkingPaper: -828). Retrieved from Annenberg Institute at Brown University: https://doi.org/10.26300/6vpz-en33

Machine-readable bibliographic record: RIS, BibTeX