دورية أكاديمية

Development and Validation of a Test for Measuring Primary School Students' Effective Use of ICT: The ECC-ICT Test

التفاصيل البيبلوغرافية
العنوان: Development and Validation of a Test for Measuring Primary School Students' Effective Use of ICT: The ECC-ICT Test
اللغة: English
المؤلفون: Kevin Ackermans (ORCID 0000-0002-6311-6612), Marjoke Bakker, Pierre Gorissen, Anne-Marieke Loon, Marijke Kral, Gino Camp
المصدر: Journal of Computer Assisted Learning. 2024 40(3):960-972.
الإتاحة: Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us
Peer Reviewed: Y
Page Count: 13
تاريخ النشر: 2024
نوع الوثيقة: Journal Articles
Reports - Research
Education Level: Elementary Education
Descriptors: Test Construction, Test Validity, Measures (Individuals), Elementary School Students, Technology Uses in Education, Information Technology, Test Reliability, Digital Literacy, Test Items, Factor Analysis, Creativity, Cooperative Learning, Student Evaluation
DOI: 10.1111/jcal.12924
تدمد: 0266-4909
1365-2729
مستخلص: Background: A practical test that measures the information and communication technology (ICT) skills students need for effectively using ICT in primary education has yet to be developed (Oh et al., 2021). This paper reports on the development, validation, and reliability of a test measuring primary school students' ICT skills required for effectively using ICT (the ECC-ICT test). Objectives: Based on existing literature, three ICT use domains were identified for effectively using ICT--"Effective," "collaborative," and "creative use" of ICT. For these three domains, 24 corresponding teaching objectives were identified from a widely used digital literacy framework. Thirty-four test items cover these teaching objectives in an online test. Methods: A mixed-method approach was used for the ECC-ICT test. Four pilot rounds [superscript (n=25)] implemented qualitative interviews for cognitive validity and refining the test items, followed by a qualitative usability study[superscript (n=6)]. Confirmatory factor analysis and ANOVA provided quantitative insight into the large-scale test administration[superscript (n=575)]. Results and Conclusions: Composite reliability of our conceptual 3-factor confirmatory model showed that the test reliably measured primary school effective use of ICT ([omega] = 0.82), collaborative use of ICT ([omega] = 0.80) and creative use of ICT ([omega] = 0.64). Convergent validity (ranging from 0.41 to 0.46) was acceptable. Internal consistency (ranging from 0.84 to 0.91) and discriminant validity (HTMT values below 0.90) are good. ANOVA results show that mean test scores are higher for students in higher grade levels (p < 0.001). The post hoc Bonferroni results show that most grade-by-grade comparisons are significant (p < 0.001).
Abstractor: As Provided
ملاحظات: https://osf.io/5ecrf
Entry Date: 2024
رقم الأكسشن: EJ1424149
قاعدة البيانات: ERIC
الوصف
تدمد:0266-4909
1365-2729
DOI:10.1111/jcal.12924