دورية أكاديمية

Estimating Classification Accuracy and Consistency Indices for Multiple Measures with the Simple Structure MIRT Model

التفاصيل البيبلوغرافية
العنوان: Estimating Classification Accuracy and Consistency Indices for Multiple Measures with the Simple Structure MIRT Model
اللغة: English
المؤلفون: Park, Seohee, Kim, Kyung Yong (ORCID 0000-0001-7549-5800), Lee, Won-Chan
المصدر: Journal of Educational Measurement. Spr 2023 60(1):106-125.
الإتاحة: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 20
تاريخ النشر: 2023
نوع الوثيقة: Journal Articles
Reports - Research
Descriptors: Testing, Computation, Classification, Accuracy, Item Response Theory, Evaluation Methods, Decision Making, Alternative Assessment
DOI: 10.1111/jedm.12338
تدمد: 0022-0655
1745-3984
مستخلص: Multiple measures, such as multiple content domains or multiple types of performance, are used in various testing programs to classify examinees for screening or selection. Despite the popular usages of multiple measures, there is little research on classification consistency and accuracy of multiple measures. Accordingly, this study introduces an approach to estimate classification consistency and accuracy indices for multiple measures under four possible decision rules: (1) complementary, (2) conjunctive, (3) compensatory, and (4) pairwise combinations of the three. The current study uses the IRT-recursive-based approach with the simple-structure multidimensional IRT model (SS-MIRT) to estimate the classification consistency and accuracy for multiple measures. Theoretical formulations of the four decision rules with a binary decision (Pass/Fail) are presented. The estimation procedures are illustrated using an empirical data example based on SS-MIRT. In addition, this study applies the estimation procedures to the unidimensional IRT (UIRT) context, considering that UIRT is practically used more. This application shows that the proposed procedure of classification consistency and accuracy could be used with a UIRT model for individual measures as an alternative method of SS-MIRT.
Abstractor: As Provided
Entry Date: 2023
رقم الأكسشن: EJ1371500
قاعدة البيانات: ERIC
الوصف
تدمد:0022-0655
1745-3984
DOI:10.1111/jedm.12338