التفاصيل البيبلوغرافية
| العنوان: |
Inter- and Intra-Observer Variability and the Effect of Experience in Cine-MRI for Adhesion Detection. |
| المؤلفون: |
de Wilde, Bram, Joosten, Frank, Venderink, Wulphert, Davidse, Mirjam E. J., Geurts, Juliëtte, Kruijt, Hanneke, Vermeulen, Afke, Martens, Bibi, Schyns, Maxime V. P., Huige, Josephine C. B. M., de Boer, Myrte C., Tonino, Bart A. R., Zandvoort, Herman J. A., Lammert, Kirsti, Parviainen, Helka, Vuorinen, Aino-Maija, Syväranta, Suvi, Vogels, Ruben R. M., Prins, Wiesje, Coppola, Andrea |
| المصدر: |
Journal of Imaging; Mar2023, Vol. 9 Issue 3, p1-11, 11p |
| مصطلحات موضوعية: |
RECEIVER operating characteristic curves, ARTIFICIAL intelligence, STANDARDS, ABDOMINAL surgery |
| مستخلص: |
Cine-MRI for adhesion detection is a promising novel modality that can help the large group of patients developing pain after abdominal surgery. Few studies into its diagnostic accuracy are available, and none address observer variability. This retrospective study explores the inter- and intraobserver variability, diagnostic accuracy, and the effect of experience. A total of 15 observers with a variety of experience reviewed 61 sagittal cine-MRI slices, placing box annotations with a confidence score at locations suspect for adhesions. Five observers reviewed the slices again one year later. Interand intra-observer variability are quantified using Fleiss’ (inter) and Cohen’s (intra) κ and percentage agreement. Diagnostic accuracy is quantified with receiver operating characteristic (ROC) analysis based on a consensus standard. Inter-observer Fleiss’ κ values range from 0.04 to 0.34, showing poor to fair agreement. High general and cine-MRI experience led to significantly (p < 0.001) better agreement among observers. The intra-observer results show Cohen’s κ values between 0.37 and 0.53 for all observers, except one with a low κ of −0.11. Group AUC scores lie between 0.66 and 0.72, with individual observers reaching 0.78. This study confirms that cine-MRI can diagnose adhesions, with respect to a radiologist consensus panel and shows that experience improves reading cine-MRI. Observers without specific experience adapt to this modality quickly after a short online tutorial. Observer agreement is fair at best and area under the receiver operating characteristic curve (AUC) scores leave room for improvement. Consistently interpreting this novel modality needs further research, for instance, by developing reporting guidelines or artificial intelligence-based methods. [ABSTRACT FROM AUTHOR] |
|
Copyright of Journal of Imaging is the property of MDPI and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| قاعدة البيانات: |
Complementary Index |
Full Text Finder