Effect of random item ordering in multiple choice tests on the academic achievement of online learners

Necati Taşkın; Bülent Kandemir

Makale detayları

Effect of random item ordering in multiple choice tests on the academic achievement of online learners

Yazarlar:

Necati Taşkın | Bülent Kandemir

Yayıncı:

Ordu University

Ana Başlıklar:

Eğitimde Ölçme ve Değerlendirme (Diğer)

Dergi:

Ordu Üniversitesi Sosyal Bilimler Enstitüsü Sosyal Bilimler Araştırmaları Dergisi Vol.15 Issue 2, pp.1254-1266

Belge Tipi:

Makale

Yayın Tarihi:

6/2025

Belge Dili:

İngilizce

Document ID (Org No.):

2001343387

pISSN:

1309-9302

Anahtar kelimeler:

Özet:

 This study examined the effect of randomly ordered multiple-choice test forms on students academic achievement. This study was carried out with a true experimental design. All students participating in the study received their training through online learning. The study group of the research consists of 2932 freshman university students studying at different faculties of a state university in the Fall Semester of the 2023-2024 academic year. A 20-item multiple-choice test was used to measure the students academic achievement. Four different test forms were generated by randomly ordering the items. One-way ANOVA was used to test whether there was a significant difference between the mean scores of the students who took different test forms. Additionally, test statistics of different test forms were examined. The findings showed no significant difference between the students mean scores in different test forms 1 and that the score distributions were balanced 2. These findings indicate that the different test forms generated by random ordering are equivalent. The similarity of the test statistics of the different test forms also supports these findings. As a result of this study, different test forms were created through random ordering do not affect students academic achievements. This study suggests educators, test developers, and administrators create different test forms through randomization as a cheating prevention method in multiple-choice tests.

 This study examined the effect of randomly ordered multiple-choice test forms on students academic achievement. This study was carried out with a true experimental design. All students participating in the study received their training through online learning. The study group of the research consists of 2932 freshman university students studying at different faculties of a state university in the Fall Semester of the 2023-2024 academic year. A 20-item multiple-choice test was used to measure the students academic achievement. Four different test forms were generated by randomly ordering the items. One-way ANOVA was used to test whether there was a significant difference between the mean scores of the students who took different test forms. Additionally, test statistics of different test forms were examined. The findings showed no significant difference between the students mean scores in different test forms 1 and that the score distributions were balanced 2. These findings indicate that the different test forms generated by random ordering are equivalent. The similarity of the test statistics of the different test forms also supports these findings. As a result of this study, different test forms were created through random ordering do not affect students academic achievements. This study suggests educators, test developers, and administrators create different test forms through randomization as a cheating prevention method in multiple-choice tests.

 This study examined the effect of randomly ordered multiple-choice test forms on students academic achievement. This study was carried out with a true experimental design. All students participating in the study received their training through online learning. The study group of the research consists of 2932 freshman university students studying at different faculties of a state university in the Fall Semester of the 2023-2024 academic year. A 20-item multiple-choice test was used to measure the students academic achievement. Four different test forms were generated by randomly ordering the items. One-way ANOVA was used to test whether there was a significant difference between the mean scores of the students who took different test forms. Additionally, test statistics of different test forms were examined. The findings showed no significant difference between the students mean scores in different test forms 1 and that the score distributions were balanced 2. These findings indicate that the different test forms generated by random ordering are equivalent. The similarity of the test statistics of the different test forms also supports these findings. As a result of this study, different test forms were created through random ordering do not affect students academic achievements. This study suggests educators, test developers, and administrators create different test forms through randomization as a cheating prevention method in multiple-choice tests.

 Bu çalışmada, rastgele sıralanmış çoktan seçmeli test formlarının öğrencilerin akademik başarılarına etkisi incelenmiştir. Çalışma gerçek deneyselde gerçekleştirilmiştir. Çalışmaya katılan tüm öğrenciler eğitimlerini çevrimiçi öğrenme yoluyla almıştır. Araştırmanın çalışma grubunu, 2023-2024 eğitim-öğretim yılı güz yarıyılında bir devlet üniversitesinin farklı fakültelerinde öğrenim gören 2932 birinci sınıf üniversite öğrencisi oluşturmaktadır. Öğrencinin akademik başarısını ölçmek için 20 soruluk çoktan seçmeli test kullanılmıştır. Maddeler rastgele sıralanarak dört farklı test formu oluşturulmuştur. Farklı test formlarını dolduran öğrencilerin ortalama puanları arasında anlamlı bir fark olup olmadığını test etmek için One-way ANOVA kullanılmıştır. Ayrıca farklı test formlarının test istatistikleri incelenmiştir. Bulgular, öğrencilerin farklı test formlarındaki ortalama puanları arasında anlamlı bir fark olmadığını 1 ve puan dağılımlarının dengeli olduğunu 2 göstermiştir. Bu bulgular, rastgele sıralamayla oluşturulan farklı test formlarının eşdeğer olduğunu göstermektedir. Farklı formlar ait test istatistikleri de bu bulguları desteklemektedir. Bu çalışmanın sonucunda, rastgele sıralama yoluyla oluşturulan farklı test formlarının öğrencilerin akademik başarılarını etkilemediği ortaya çıkmıştır. Bu çalışma, eğitimcilere, test geliştiricilere ve yöneticilere, çoktan seçmeli testlerde güvenli bir değerlendirme sağlamak için rastgele sıralama yoluyla farklı test formları oluşturmalarını önermektedir.

Makale detayları

Effect of random item ordering in multiple choice tests on the academic achievement of online learners

Yazarlar:

Necati Taşkın | Bülent Kandemir

Yayıncı:

Ordu University

Ana Başlıklar:

Eğitimde Ölçme ve Değerlendirme (Diğer)

Dergi:

Ordu Üniversitesi Sosyal Bilimler Enstitüsü Sosyal Bilimler Araştırmaları Dergisi Vol.15 Issue 2, pp.1254-1266

Belge Tipi:

Makale

Yayın Tarihi:

6/2025

Belge Dili:

İngilizce

Document ID (Org No.):

2001343387

pISSN:

1309-9302

Assessment

multiple-choice tests

random ordering

academic achievementDeğerlendirme

çoktan seçmeli testler

rastgele sıralama

akademik başarı

Sayı

Makale detayları

Yazarlar: Necati Taşkın | Bülent Kandemir

Yayıncı: Ordu University

Ana Başlıklar: Eğitimde Ölçme ve Değerlendirme (Diğer)

Dergi: Ordu Üniversitesi Sosyal Bilimler Enstitüsü Sosyal Bilimler Araştırmaları Dergisi Vol.15 Issue 2, pp.1254-1266

Belge Tipi: Makale

Yayın Tarihi: 6/2025

Belge Dili: İngilizce

Document ID (Org No.): 2001343387

pISSN: 1309-9302

Sayı

Yazarlar:

Necati Taşkın | Bülent Kandemir

Yayıncı:

Ordu University

Ana Başlıklar:

Eğitimde Ölçme ve Değerlendirme (Diğer)

Dergi:

Ordu Üniversitesi Sosyal Bilimler Enstitüsü Sosyal Bilimler Araştırmaları Dergisi Vol.15 Issue 2, pp.1254-1266

Belge Tipi:

Makale

Yayın Tarihi:

6/2025

Belge Dili:

İngilizce

Document ID (Org No.):

2001343387

pISSN:

1309-9302