A dialectic on validity: Explanation-focused and the many ways of being human

Bruno D. Zumbo

Makale detayları

A dialectic on validity: Explanation-focused and the many ways of being human

Yazarlar:

Bruno D. Zumbo

Yayıncı:

İzzet KARA

Ana Başlıklar:

Measurement Theories and Applications in Education and Psychology | Scale Development | Psychological Methodology | Design and Analysis

Dergi:

International Journal of Assessment Tools in Education Vol.10 Issue Special Issue, pp.1-96

Belge Tipi:

Makale

Yayın Tarihi:

12/2023

Belge Dili:

İngilizce

Document ID (Org No.):

2001303803

pISSN:

2148-7456

Anahtar kelimeler:

Özet:

 In line with the journal volumes theme, this essay considers lessons from the past and visions for the future of test validity. In the first part of the essay, a description of historical trends in test validity since the early 1900s leads to the natural question of whether the discipline has progressed in its definition and description of test validity. There is no single agreed-upon definition of test validity; however, there is a marked coalescing of explanation-centered views at the meta-level. The second part of the essay focuses on the authors development of an explanation-focused view of validity theory with aligned validation methods. The confluence of ideas that motivated and influenced the development of a coherent view of test validity as the explanation for the test score variation and validation is the process of developing and testing the explanation guided by abductive methods and inference to the best explanation. This description also includes a new re-interpretation of true scores in classical test theory afforded by the authors measure-theoretic mental test theory developmentfor a particular test-taker, the variation in observed test-taker scores includes measurement error and variation attributable to the different ecological testing settings, which aligns with the explanation-focused view wherein item and test performance are the object of explanatory analyses. The final main section of the essay describes several methodological innovations in explanation-focused validity that are in response to the tensions and changes in assessment in the last 25 years.

 In line with the journal volumes theme, this essay considers lessons from the past and visions for the future of test validity. In the first part of the essay, a description of historical trends in test validity since the early 1900s leads to the natural question of whether the discipline has progressed in its definition and description of test validity. There is no single agreed-upon definition of test validity; however, there is a marked coalescing of explanation-centered views at the meta-level. The second part of the essay focuses on the authors development of an explanation-focused view of validity theory with aligned validation methods. The confluence of ideas that motivated and influenced the development of a coherent view of test validity as the explanation for the test score variation and validation is the process of developing and testing the explanation guided by abductive methods and inference to the best explanation. This description also includes a new re-interpretation of true scores in classical test theory afforded by the authors measure-theoretic mental test theory developmentfor a particular test-taker, the variation in observed test-taker scores includes measurement error and variation attributable to the different ecological testing settings, which aligns with the explanation-focused view wherein item and test performance are the object of explanatory analyses. The final main section of the essay describes several methodological innovations in explanation-focused validity that are in response to the tensions and changes in assessment in the last 25 years.

 In line with the journal volumes theme, this essay considers lessons from the past and visions for the future of test validity. In the first part of the essay, a description of historical trends in test validity since the early 1900s leads to the natural question of whether the discipline has progressed in its definition and description of test validity. There is no single agreed-upon definition of test validity; however, there is a marked coalescing of explanation-centered views at the meta-level. The second part of the essay focuses on the authors development of an explanation-focused view of validity theory with aligned validation methods. The confluence of ideas that motivated and influenced the development of a coherent view of test validity as the explanation for the test score variation and validation is the process of developing and testing the explanation guided by abductive methods and inference to the best explanation. This description also includes a new re-interpretation of true scores in classical test theory afforded by the authors measure-theoretic mental test theory developmentfor a particular test-taker, the variation in observed test-taker scores includes measurement error and variation attributable to the different ecological testing settings, which aligns with the explanation-focused view wherein item and test performance are the object of explanatory analyses. The final main section of the essay describes several methodological innovations in explanation-focused validity that are in response to the tensions and changes in assessment in the last 25 years.

 In line with the journal volumes theme, this essay considers lessons from the past and visions for the future of test validity. In the first part of the essay, a description of historical trends in test validity since the early 1900s leads to the natural question of whether the discipline has progressed in its definition and description of test validity. There is no single agreed-upon definition of test validity; however, there is a marked coalescing of explanation-centered views at the meta-level. The second part of the essay focuses on the authors development of an explanation-focused view of validity theory with aligned validation methods. The confluence of ideas that motivated and influenced the development of a coherent view of test validity as the explanation for the test score variation and validation is the process of developing and testing the explanation guided by abductive methods and inference to the best explanation. This description also includes a new re-interpretation of true scores in classical test theory afforded by the authors measure-theoretic mental test theory developmentfor a particular test-taker, the variation in observed test-taker scores includes measurement error and variation attributable to the different ecological testing settings, which aligns with the explanation-focused view wherein item and test performance are the object of explanatory analyses. The final main section of the essay describes several methodological innovations in explanation-focused validity that are in response to the tensions and changes in assessment in the last 25 years.

Makale detayları

A dialectic on validity: Explanation-focused and the many ways of being human

Yazarlar:

Bruno D. Zumbo

Yayıncı:

İzzet KARA

Ana Başlıklar:

Measurement Theories and Applications in Education and Psychology | Scale Development | Psychological Methodology | Design and Analysis

Dergi:

International Journal of Assessment Tools in Education Vol.10 Issue Special Issue, pp.1-96

Belge Tipi:

Makale

Yayın Tarihi:

12/2023

Belge Dili:

İngilizce

Document ID (Org No.):

2001303803

pISSN:

2148-7456

Validity

Validation

Test Theory

Assessment Consequences

True ScoresValidity

Validation

Test theory

Assessment consequences

True score

Sayı

Makale detayları

Yazarlar: Bruno D. Zumbo

Yayıncı: İzzet KARA

Ana Başlıklar: Measurement Theories and Applications in Education and Psychology | Scale Development | Psychological Methodology | Design and Analysis

Dergi: International Journal of Assessment Tools in Education Vol.10 Issue Special Issue, pp.1-96

Belge Tipi: Makale

Yayın Tarihi: 12/2023

Belge Dili: İngilizce

Document ID (Org No.): 2001303803

pISSN: 2148-7456

Sayı

Yazarlar:

Bruno D. Zumbo

Yayıncı:

İzzet KARA

Ana Başlıklar:

Measurement Theories and Applications in Education and Psychology | Scale Development | Psychological Methodology | Design and Analysis

Dergi:

International Journal of Assessment Tools in Education Vol.10 Issue Special Issue, pp.1-96

Belge Tipi:

Makale

Yayın Tarihi:

12/2023

Belge Dili:

İngilizce

Document ID (Org No.):

2001303803

pISSN:

2148-7456