Early Detection of Wheel Spinning: Comparison across Tutors, Models, Features, and Operationalizations

التفاصيل البيبلوغرافية
العنوان: Early Detection of Wheel Spinning: Comparison across Tutors, Models, Features, and Operationalizations
اللغة: English
المؤلفون: Zhang, Chuankai, Huang, Yanzun, Wang, Jingyu, Lu, Dongyang, Fang, Weiqi, Stamper, John, Fancsali, Stephen, Holstein, Kenneth, Aleven, Vincent
المصدر: International Educational Data Mining Society. 2019.
الإتاحة: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: http://www.educationaldatamining.org
Peer Reviewed: Y
Page Count: 6
تاريخ النشر: 2019
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305A180301
R305B150008
نوع الوثيقة: Speeches/Meeting Papers
Reports - Research
Descriptors: Identification, Intelligent Tutoring Systems, Academic Failure, Criteria, Algebra, Geometry, Mathematics Instruction, Models, Comparative Analysis, Knowledge Level
مستخلص: "Wheel spinning" is the phenomenon in which a student fails to master a Knowledge Component (KC), despite significant practice. Ideally, an intelligent tutoring system would detect this phenomenon early, so that the system or a teacher could try alternative instructional strategies. Prior work has put forward several criteria for wheel spinning and has demonstrated that wheel spinning can be detected reasonably early. Yet the literature lacks systematic comparisons among the multiple wheel spinning criteria, features, and models that have been proposed, across multiple evaluation criteria (e.g., earliness, precision, and generalizability) and datasets. In our experiments, we constructed six wheel spinning detectors and compared their performance under two different wheel spinning criteria with three datasets. The results show that two prominent criteria for wheel spinning diverge substantially, and that a Random Forest model has the most consistent performance in early detection of wheel spinning across datasets and wheel spinning criteria. In addition, we found that a simple model overlooked by previous research (Logistic Regression trained on a single feature) is able to detect wheel spinning at an early stage with decent performance. This work brings us closer to unifying strands of prior work on wheel spinning (e.g., understanding how different criteria compare) and to early detection of wheel spinning in educational practice. [For the corresponding grantee submission, see ED594575. For the full proceedings, see ED599096.]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2019
رقم الأكسشن: ED599222
قاعدة البيانات: ERIC