An Investigation of Item Bias of English Test: The Case of 2016 Year Undergraduate Placement Exam in Turkey

Authors : Rabia AKCAN, Kübra ATALAY KABASAKAL

Pages : 48-62

Doi:10.21449/ijate.508581

View : 24 | Download : 10

Publication Date : 2019-03-21

Article Type : Research Paper

Abstract :The purpose of this study is to determine whether English test items of Undergraduate Placement Exam insert ignore into journalissuearticles values(UPE); in 2016 contain differential item functioning insert ignore into journalissuearticles values(DIF); and differential bundle functioning insert ignore into journalissuearticles values(DBF); in terms of gender and school type and examine the possible sources of bias of DIF items. Mantel Haenszel insert ignore into journalissuearticles values(MH);, Simultaneous Item Bias Test insert ignore into journalissuearticles values(SIBTEST); and Multiple Indicator and Multiple Causes insert ignore into journalissuearticles values(MIMIC); methods were used for DIF analyses. DBF analyses were conducted by MIMIC and SIBTEST methods. Expert opinions were consulted to determine the sources of bias. Data set of the study consisted of responses of 59818 students to 2016 UPE English test. As a result of the analyses carried out on 60 items, it was seen that one item in translation subtest contained DIF favoring male students. In school type based analyses, it was concluded that there were nine DIF items in vocabulary and grammar knowledge subtest, six DIF items in reading comprehension subtest and four DIF items in translation subtest. Experts stated that one item containing DIF by gender was unbiased, and evidence of bias was found in thirteen of nineteen items that contained DIF by school type. According to DBF analyses, it was found that some item bundles contained DBF with respect to gender and school type. As a result of research, it was discovered that there were differences with regard to the number of DIF items identified by three methods and the level of DIF that the items contained; however, methods were consistent in detecting uniform DIF.
Keywords : Undergraduate Placement Exam, differential item functioning, differential bundle functioning, item bias, MIMIC