Comparison of Passing Scores Determined by The Angoff Method in Different Item Samples

Hakan KARA; Sevda ÇETİN

doi:https://doi.org/10.21449/ijate.699479

Makale detayları

Comparison of Passing Scores Determined by The Angoff Method in Different Item Samples

Yazarlar:

Hakan KARA | Sevda ÇETİN

Yayıncı:

İzzet KARA

Ana Başlıklar:

Eğitim

Dergi:

International Journal of Assessment Tools in Education 2020 Vol.7 Issue 1, pp.80-97

Belge Tipi:

Makale

Yayın Tarihi:

3/2020

Belge Dili:

İngilizce

Document ID (Org No.):

2000718643

Sıklık:

Üç Aylık

eISSN:

2148-7456

DOI:

https://doi.org/10.21449/ijate.699479

Özet:

 


In this study, the efficiency of various random sampling methods to reduce the number of items rated by judges in an Angoff standard-setting study was examined and the methods were compared with each other. Firstly, the full-length test was formed by combining Placement Test 2012 and 2013 mathematics subsets. After then, simple random sampling (SRS), content stratified (C-SRS), item-difficulty stratified (D-SRS) and content-by-difficulty random sampling (CD-SRS) methods were used to constitute different length of subsets (30%, 40%, 50%, 70%) from the full-test. In total, 16 different study conditions (4 methods x 4 subsets) were investigated. In data analysis part, ANOVA analysis was conducted to examine whether minimum passing scores (MPSs) for the subsets were significantly different from the MPSs of the full-length test. As a follow-up analysis, RMSE and SEE (Standard Error of Estimation) values were calculated for each study condition. Results indicated that the estimated Angoff MPSs were significantly different from the full-test Angoff MPS (45.12) only in the study conditions of 30%-C-SRS, 40% C-SRS, 30% D-SRS and 30%-CD-SRS. According to RMSE values, the C-SRS method had the smallest error while the SRS method had the biggest one. Moreover, SEE examinations revealed that to achieve estimations similar to the full-test Angoff MPS (within one SEE), it is sufficient to get 50% of items with the C-SRS method. C-SRS method was the more effective one compared to the others in reducing the number of items rated by judges in MPS setting studies conducted with the Angoff method.

.

Makale detayları

Comparison of Passing Scores Determined by The Angoff Method in Different Item Samples

Yazarlar: Hakan KARA | Sevda ÇETİN

Yayıncı: İzzet KARA

Ana Başlıklar: Eğitim

Dergi: International Journal of Assessment Tools in Education 2020 Vol.7 Issue 1, pp.80-97

Belge Tipi: Makale

Yayın Tarihi: 3/2020

Belge Dili: İngilizce

Document ID (Org No.): 2000718643

Sıklık: Üç Aylık

eISSN: 2148-7456

DOI: https://doi.org/10.21449/ijate.699479

Sayı

Yazarlar:

Hakan KARA | Sevda ÇETİN

Yayıncı:

İzzet KARA

Ana Başlıklar:

Eğitim

Dergi:

International Journal of Assessment Tools in Education 2020 Vol.7 Issue 1, pp.80-97

Belge Tipi:

Makale

Yayın Tarihi:

3/2020

Belge Dili:

İngilizce

Document ID (Org No.):

2000718643

Sıklık:

Üç Aylık

eISSN:

2148-7456

DOI:

https://doi.org/10.21449/ijate.699479