The Use of Item Scores and Response Times to Detect Examinees Who May Have Benefited from Item Preknowledge

التفاصيل البيبلوغرافية
العنوان: The Use of Item Scores and Response Times to Detect Examinees Who May Have Benefited from Item Preknowledge
اللغة: English
المؤلفون: Sinharay, Sandip (ORCID 0000-0003-4491-8510), Johnson, Matthew S.
المصدر: Grantee Submission. 2019.
Peer Reviewed: Y
Page Count: 38
تاريخ النشر: 2019
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305D170026
نوع الوثيقة: Reports - Research
Descriptors: Scores, Test Items, Reaction Time, Cheating, Statistical Inference, Identification, Statistical Analysis, Educational Assessment, Licensing Examinations (Professions), Item Response Theory
DOI: 10.1111/bmsp.12187
مستخلص: According to Wollack and Schoenig (2018), benefitting from item preknowledge is one of the three broad types of test fraud that occur in educational assessments. We use tools from constrained statistical inference to suggest a new statistic that is based on item scores and response times and can be used to detect the examinees who may have benefitted from item preknowledge for the case when the set of compromised items is known. The asymptotic distribution of the new statistic under no preknowledge is proved to be a simple mixture of two chi-squared distributions. We perform a detailed simulation study to show that the Type I error rate of the new statistic is very close to the nominal level and that the power of the new statistic is satisfactory in comparison to that of the existing statistics for detecting item preknowledge based on both item scores and response times. We also include a real data example to demonstrate the usefulness of the suggested statistic. [This is the online version of an article published in "British Journal of Mathematical and Statistical Psychology."]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2019
رقم الأكسشن: ED598424
قاعدة البيانات: ERIC