دورية أكاديمية
Enhancing Recall in Automated Record Screening: A Resampling Algorithm
العنوان: | Enhancing Recall in Automated Record Screening: A Resampling Algorithm |
---|---|
اللغة: | English |
المؤلفون: | Zhipeng Hou (ORCID |
المصدر: | Research Synthesis Methods. 2024 15(3):372-383. |
الإتاحة: | Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://www.wiley.com/en-us |
Peer Reviewed: | Y |
Page Count: | 12 |
تاريخ النشر: | 2024 |
نوع الوثيقة: | Journal Articles Reports - Research |
Descriptors: | Meta Analysis, Research Reports, Identification, Evaluation Methods, Algorithms, Citations (References), Reliability, Probability, Mathematical Models, Scientific Research, Selection Criteria |
DOI: | 10.1002/jrsm.1690 |
تدمد: | 1759-2879 1759-2887 |
مستخلص: | Literature screening is the process of identifying all relevant records from a pool of candidate paper records in systematic review, meta-analysis, and other research synthesis tasks. This process is time consuming, expensive, and prone to human error. Screening prioritization methods attempt to help reviewers identify most relevant records while only screening a proportion of candidate records with high priority. In previous studies, screening prioritization is often referred to as automatic literature screening or automatic literature identification. Numerous screening prioritization methods have been proposed in recent years. However, there is a lack of screening prioritization methods with reliable performance. Our objective is to develop a screening prioritization algorithm with reliable performance for practical use, for example, an algorithm that guarantees an 80% chance of identifying at least 80% of the relevant records. Based on a target-based method proposed in Cormack and Grossman, we propose a screening prioritization algorithm using sampling with replacement. The algorithm is a wrapper algorithm that can work with any current screening prioritization algorithm to guarantee the performance. We prove, with mathematics and probability theory, that the algorithm guarantees the performance. We also run numeric experiments to test the performance of our algorithm when applied in practice. The numeric experiment results show this algorithm achieve reliable performance under different circumstances. The proposed screening prioritization algorithm can be reliably used in real world research synthesis tasks. |
Abstractor: | As Provided |
Entry Date: | 2024 |
رقم الأكسشن: | EJ1421859 |
قاعدة البيانات: | ERIC |
تدمد: | 1759-2879 1759-2887 |
---|---|
DOI: | 10.1002/jrsm.1690 |