Reliability of Ratings of Multidimensional Fluency Scale with Many-Facet Rasch Model

Authors : Çiğdem AKIN ARIKAN, Pınar KANIK UYSAL, Huzeyfe BİLGE, Kasım YILDIRIM

Pages : 470-491

Doi:10.21449/ijate.974214

View : 31 | Download : 12

Publication Date : 2022-06-26

Article Type : Research Paper

Abstract :The aim of this study was to determine whether the reliability of raters was provided by assessing reading prosody using the Multidimensional Fluency Scale insert ignore into journalissuearticles values(MDFS);. The study was completed with a cross-sectional design, and in line with this, the prosodic reading skills of 41 fifth-grade students were rated by elementary school classroom teachers and Turkish language arts teachers using the MDFS. Data obtained from the ratings were analyzed with the many-facet Rasch model insert ignore into journalissuearticles values(MFRM);. When the findings are investigated, the reading prosody rubric used in the research served the purposes of the reading prosody criteria, the sub-dimensions of the rubric could be reliably differentiated, the determined criteria were reliable, and the criteria categories appear to be adequate. Additionally, the severity and leniency of raters were found to differ, and Turkish language arts teachers were found to perform more severe ratings than classroom teachers. It was found that raters were ranked reliably in terms of severity/leniency, and that their levels of severity/leniency differed from each other. Another result obtained is that the prosody criterion that students completed with the most difficulty was phrasing. Therefore, it was concluded that the MDFS is a reliable rubric and that researchers and teachers can reliably use it to assess prosodic reading skills.
Keywords : Rater bias, Rubric, Reading fluency, Prosody, Many facet Rasch model, Rater reliability