دورية أكاديمية
أعرض في EDS

Validating Parallel-Forms Tests for Assessing Anesthesia Resident Knowledge.

التفاصيل البيبلوغرافية
العنوان: Validating Parallel-Forms Tests for Assessing Anesthesia Resident Knowledge.
المؤلفون: Lee AJ; Department of Anesthesiology, Columbia University, New York, NY, USA., Goodman SR; Department of Anesthesiology, Columbia University, New York, NY, USA., Bauer MEB; Department of Anesthesiology, Duke University, Durham, NC, USA., Minehart RD; Department of Anesthesia, Critical Care and Pain Medicine, Harvard University, Boston, MA, USA., Banks S; Department of Anesthesiology, Perioperative Medicine and Pain Management, University of Miami, Miami, FL, USA., Chen Y; Teachers College, Columbia University, New York, NY, USA., Landau RL; Department of Anesthesiology, Columbia University, New York, NY, USA., Chatterji M; Teachers College, Columbia University, New York, NY, USA.
المصدر: Journal of medical education and curricular development [J Med Educ Curric Dev] 2024 Feb 12; Vol. 11, pp. 23821205241229778. Date of Electronic Publication: 2024 Feb 12 (Print Publication: 2024).
نوع المنشور: Journal Article
اللغة: English
بيانات الدورية: Publisher: SAGE Publications Country of Publication: United States NLM ID: 101690298 Publication Model: eCollection Cited Medium: Print ISSN: 2382-1205 (Print) Linking ISSN: 23821205 NLM ISO Abbreviation: J Med Educ Curric Dev Subsets: PubMed not MEDLINE
أسماء مطبوعة: Publication: <2016- > : Thousand Oaks, CA : SAGE Publications
Original Publication: Auckland, New Zealand : Libertas Academica Ltd., [2014]-
مستخلص: We created a serious game to teach first year anesthesiology (CA-1) residents to perform general anesthesia for cesarean delivery. We aimed to investigate resident knowledge gains after playing the game and having received one of 2 modalities of debriefing. We report on the development and validation of scores from parallel test forms for criterion-referenced interpretations of resident knowledge. The test forms were intended for use as pre- and posttests for the experiment. Validation of instruments measuring the study's primary outcome was considered essential for adding rigor to the planned experiment, to be able to trust the study's results. Parallel, multiple-choice test forms development steps included: (1) assessment purpose and population specification; (2) content domain specification and writing/selection of items; (3) content validation by experts of paired items by topic and cognitive level; and (4) empirical validation of scores from the parallel test forms using Classical Test Theory (CTT) techniques. Field testing involved online administration of 52 shuffled items from both test forms to 24 CA-1's, 21 second-year anesthesiology (CA-2) residents, 2 fellows, 1 attending anesthesiologist, and 1 of unknown rank at 3 US institutions. Items from each form yielded near-normal score distributions, with similar medians, ranges, and standard deviations. Evaluations of CTT item difficulty (item p values) and discrimination (D) indices indicated that most items met assumptions of criterion-referenced test design, separating experienced from novice residents. Experienced residents performed better on overall domain scores than novices ( P  < .05). Kuder-Richardson Formula 20 (KR-20) reliability estimates of both test forms were above the acceptability cut of .70, and parallel forms reliability estimate was high at .86, indicating results were consistent with theoretical expectations. Total scores of parallel test forms demonstrated item-level validity, strong internal consistency and parallel forms reliability, suggesting sufficient robustness for knowledge outcomes assessments of CA-1 residents.
Competing Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
(© The Author(s) 2024.)
References: J Grad Med Educ. 2009 Dec;1(2):287-98. (PMID: 21975994)
Simul Healthc. 2021 Jun 1;16(3):199-212. (PMID: 33196609)
Int J Obstet Anesth. 2014 Nov;23(4):341-7. (PMID: 25066817)
Anesthesiology. 2006 Aug;105(2):260-6. (PMID: 16871059)
Simul Healthc. 2015 Apr;10(2):106-15. (PMID: 25710312)
Int J Obstet Anesth. 1998 Jul;7(3):145-6. (PMID: 15321205)
Anaesthesia. 2015 Nov;70(11):1286-306. (PMID: 26449292)
J Educ Perioper Med. 2018 Apr 01;20(2):E621. (PMID: 30057932)
Anesthesiology. 2019 Jun;130(6):912-922. (PMID: 30789362)
Am J Med. 2006 Feb;119(2):166.e7-16. (PMID: 16443422)
Res Nurs Health. 2007 Aug;30(4):459-67. (PMID: 17654487)
J Educ Perioper Med. 2020 Jul 01;22(3):E645. (PMID: 33225015)
فهرسة مساهمة: Keywords: Classical Test Theory; cesarean delivery; general anesthesia; instrument validation; multiple-choice tests; parallel forms reliability
تواريخ الأحداث: Date Created: 20240215 Latest Revision: 20240216
رمز التحديث: 20240216
مُعرف محوري في PubMed: PMC10865962
DOI: 10.1177/23821205241229778
PMID: 38357687
قاعدة البيانات: MEDLINE
الوصف
تدمد:2382-1205
DOI:10.1177/23821205241229778