Comparison of the methods of examining measurement equivalence under different conditions in terms of statistical power ratios

Alperen Yandı

Makale detayları

Comparison of the methods of examining measurement equivalence under different conditions in terms of statistical power ratios

Yazarlar:

Alperen Yandı

Yayıncı:

Bartin University

Ana Başlıklar:

Other Fields of Education

Dergi:

Bartın University Journal of Faculty of Education Vol.12 Issue 1, pp.146-166

Belge Tipi:

Makale

Yayın Tarihi:

1/2023

Belge Dili:

İngilizce

Document ID (Org No.):

2001282455

pISSN:

1308-7177

Anahtar kelimeler:

Özet:

 Validity is the most important psychometric feature that should be found in a measurement tool. Measurement equivalence is one of the evidences for the validity of measurement tools. Providing information to the researchers about the methods of identifying measurement equivalence may contribute to present a complete validity evidence. The purpose of this study is to compare the statistical power ratios of methods used for examining the measurement equivalence based on structural equation modeling and item response theory on the artificial data sets generated by diversifying variables of sample size, number of items, and the ratios of the items having differential item function. In accordance with this purpose, the variables have been varied to include three different levels. In the analysis, multi-group confirmatory factor analysis was used which is among the methods based on the structural equation modeling, and likelihood ratio test and comparison of the item parameters methods were used which are among the methods based on item response theory. Multi-group group confirmatory factor analysis 93,50 and likelihood ratio test 96,75 methods have reached the highest statistical power ratio in the condition that the sample size is 10001000, the number of items is 40 items and the ratios of the items having differential item function is 10. The method of comparing the item parameters 94,50 has reached the highest statistical power ratio in the condition of sample size is 10001000, the number of items is 20 and the ratios of the items having differential item function are 10-20.

 Validity is the most important psychometric feature that should be found in a measurement tool. Measurement equivalence is one of the evidences for the validity of measurement tools. Providing information to the researchers about the methods of identifying measurement equivalence may contribute to present a complete validity evidence. The purpose of this study is to compare the statistical power ratios of methods used for examining the measurement equivalence based on structural equation modeling and item response theory on the artificial data sets generated by diversifying variables of sample size, number of items, and the ratios of the items having differential item function. In accordance with this purpose, the variables have been varied to include three different levels. In the analysis, multi-group confirmatory factor analysis was used which is among the methods based on the structural equation modeling, and likelihood ratio test and comparison of the item parameters methods were used which are among the methods based on item response theory. Multi-group group confirmatory factor analysis 93,50 and likelihood ratio test 96,75 methods have reached the highest statistical power ratio in the condition that the sample size is 10001000, the number of items is 40 items and the ratios of the items having differential item function is 10. The method of comparing the item parameters 94,50 has reached the highest statistical power ratio in the condition of sample size is 10001000, the number of items is 20 and the ratios of the items having differential item function are 10-20.

 Validity is the most important psychometric feature that should be found in a measurement tool. Measurement equivalence is one of the evidences for the validity of measurement tools. Providing information to the researchers about the methods of identifying measurement equivalence may contribute to present a complete validity evidence. The purpose of this study is to compare the statistical power ratios of methods used for examining the measurement equivalence based on structural equation modeling and item response theory on the artificial data sets generated by diversifying variables of sample size, number of items, and the ratios of the items having differential item function. In accordance with this purpose, the variables have been varied to include three different levels. In the analysis, multi-group confirmatory factor analysis was used which is among the methods based on the structural equation modeling, and likelihood ratio test and comparison of the item parameters methods were used which are among the methods based on item response theory. Multi-group group confirmatory factor analysis 93,50 and likelihood ratio test 96,75 methods have reached the highest statistical power ratio in the condition that the sample size is 10001000, the number of items is 40 items and the ratios of the items having differential item function is 10. The method of comparing the item parameters 94,50 has reached the highest statistical power ratio in the condition of sample size is 10001000, the number of items is 20 and the ratios of the items having differential item function are 10-20.

 Geçerlilik, bir ölçme aracında bulunması gereken en önemli psikometrik özelliktir. Ölçme eşdeğerliği, ölçme araçlarının geçerliliğinin kanıtlarından biridir. Araştırmacılara ölçme eşdeğerliğini belirleme yöntemleri hakkında bilgi verilmesi, tam bir geçerlilik kanıtı sunulmasına katkı sağlayabilir. Bu çalışmanın amacı, yapısal eşitlik modellemesi ve madde tepki kuramına dayalı ölçme eşdeğerliğini incelemek için kullanılan yöntemlerin istatistiksel güç oranlarını, örneklem büyüklüğü, madde sayısı ve değişen madde fonksiyonu içeren madde oranı değişkenleri değişimlenerek oluşturulan yapay veri setleri üzerinde karşılaştırmaktır. Bu amaç doğrultusunda değişkenler üç farklı düzeyi olacak şekilde değişimlenmiştir. Analizde yapısal eşitlik modellemesine dayalı yöntemlerden çok gruplu doğrulayıcı faktör analizi, madde yanıt teorisine dayalı yöntemlerden olabilirlik oranı testi ve madde parametrelerinin karşılaştırılması yöntemleri kullanılmıştır. Örneklem büyüklüğü 10001000, madde sayısının 40 olduğu ve değişen madde fonksiyonuna sahip maddelerin oranları ise 10 koşulda çok gruplu grup doğrulayıcı faktör analizi 93,50 ve olabilirlik oran testi 96,75 yöntemleri en yüksek istatistiksel güç oranına ulaşmıştır. Madde parametrelerinin karşılaştırılması yöntemi 94,50 örneklem büyüklüğünün 10001000 olması, madde sayısının 20 olması ve diferansiyel madde fonksiyonuna sahip maddelerin oranlarının 10-20 olması durumunda en yüksek istatistiksel güce ulaşmıştır.

Makale detayları

Comparison of the methods of examining measurement equivalence under different conditions in terms of statistical power ratios

Yazarlar:

Alperen Yandı

Yayıncı:

Bartin University

Ana Başlıklar:

Other Fields of Education

Dergi:

Bartın University Journal of Faculty of Education Vol.12 Issue 1, pp.146-166

Belge Tipi:

Makale

Yayın Tarihi:

1/2023

Belge Dili:

İngilizce

Document ID (Org No.):

2001282455

pISSN:

1308-7177

Measurement equivalence

statistical power ratios

multi-group confirmatory factor analysis

likelihood ratio test

comparison of the item parameters method

Ölçüm eşdeğerliği

istatistiksel güç oranları

çoklu grup doğrulayıcı faktör analizi

olabilirlik oranı testi

madde parametrelerinin karşılaştırılması yöntemi

Sayı

Makale detayları

Yazarlar: Alperen Yandı

Yayıncı: Bartin University

Ana Başlıklar: Other Fields of Education

Dergi: Bartın University Journal of Faculty of Education Vol.12 Issue 1, pp.146-166

Belge Tipi: Makale

Yayın Tarihi: 1/2023

Belge Dili: İngilizce

Document ID (Org No.): 2001282455

pISSN: 1308-7177

Sayı

Yazarlar:

Alperen Yandı

Yayıncı:

Bartin University

Ana Başlıklar:

Other Fields of Education

Dergi:

Bartın University Journal of Faculty of Education Vol.12 Issue 1, pp.146-166

Belge Tipi:

Makale

Yayın Tarihi:

1/2023

Belge Dili:

İngilizce

Document ID (Org No.):

2001282455

pISSN:

1308-7177