دورية أكاديمية
أعرض في EDS

Ensuring the quality and specificity of preregistrations.

التفاصيل البيبلوغرافية
العنوان: Ensuring the quality and specificity of preregistrations.
المؤلفون: Bakker M; Department of Methodology and Statistics, Tilburg University, Tilburg, the Netherlands., Veldkamp CLS; Faculty of Social Sciences, Utrecht University, Utrecht, the Netherlands., van Assen MALM; Department of Methodology and Statistics, Tilburg University, Tilburg, the Netherlands.; Department of Sociology, Utrecht University, Utrecht, the Netherlands., Crompvoets EAV; Department of Methodology and Statistics, Tilburg University, Tilburg, the Netherlands.; Cito Institute for Educational Measurement, Arnhem, the Netherlands., Ong HH; Department of Social Psychology, Tilburg University, Tilburg, the Netherlands., Nosek BA; Center for Open Science, Charlottesville, Virginia, United States of America.; Department of Psychology, University of Virginia, Virginia, United States of America., Soderberg CK; Center for Open Science, Charlottesville, Virginia, United States of America., Mellor D; Center for Open Science, Charlottesville, Virginia, United States of America., Wicherts JM; Department of Methodology and Statistics, Tilburg University, Tilburg, the Netherlands.
المصدر: PLoS biology [PLoS Biol] 2020 Dec 09; Vol. 18 (12), pp. e3000937. Date of Electronic Publication: 2020 Dec 09 (Print Publication: 2020).
نوع المنشور: Journal Article; Research Support, Non-U.S. Gov't
اللغة: English
بيانات الدورية: Publisher: Public Library of Science Country of Publication: United States NLM ID: 101183755 Publication Model: eCollection Cited Medium: Internet ISSN: 1545-7885 (Electronic) Linking ISSN: 15449173 NLM ISO Abbreviation: PLoS Biol Subsets: MEDLINE
أسماء مطبوعة: Original Publication: San Francisco, CA : Public Library of Science, [2003]-
مواضيع طبية MeSH: Data Collection/*methods , Research Design/*statistics & numerical data, Data Collection/standards ; Data Collection/trends ; Humans ; Quality Control ; Registries/statistics & numerical data ; Research Design/trends
مستخلص: Researchers face many, often seemingly arbitrary, choices in formulating hypotheses, designing protocols, collecting data, analyzing data, and reporting results. Opportunistic use of "researcher degrees of freedom" aimed at obtaining statistical significance increases the likelihood of obtaining and publishing false-positive results and overestimated effect sizes. Preregistration is a mechanism for reducing such degrees of freedom by specifying designs and analysis plans before observing the research outcomes. The effectiveness of preregistration may depend, in part, on whether the process facilitates sufficiently specific articulation of such plans. In this preregistered study, we compared 2 formats of preregistration available on the OSF: Standard Pre-Data Collection Registration and Prereg Challenge Registration (now called "OSF Preregistration," http://osf.io/prereg/). The Prereg Challenge format was a "structured" workflow with detailed instructions and an independent review to confirm completeness; the "Standard" format was "unstructured" with minimal direct guidance to give researchers flexibility for what to prespecify. Results of comparing random samples of 53 preregistrations from each format indicate that the "structured" format restricted the opportunistic use of researcher degrees of freedom better (Cliff's Delta = 0.49) than the "unstructured" format, but neither eliminated all researcher degrees of freedom. We also observed very low concordance among coders about the number of hypotheses (14%), indicating that they are often not clearly stated. We conclude that effective preregistration is challenging, and registration formats that provide effective guidance may improve the quality of research.
Competing Interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: DM, CS, and BN are employees of the Center for Open Science (COS), a non-profit technology and culture change company with a mission to increase openness, integrity, and reproducibility of research. COS operates the OSF and the Prereg Challenge.
References: Clin Obes. 2017 Aug;7(4):245-254. (PMID: 28557240)
J Clin Epidemiol. 2017 Nov;91:95-110. (PMID: 28842290)
BMJ. 2017 Feb 14;356:j408. (PMID: 28196819)
JAMA. 2012 May 2;307(17):1838-47. (PMID: 22550198)
Epidemiology. 2008 Sep;19(5):640-8. (PMID: 18633328)
Proc Natl Acad Sci U S A. 2018 Mar 13;115(11):2600-2606. (PMID: 29531091)
Transl Psychiatry. 2017 Sep 12;7(9):e1232. (PMID: 28895941)
Nat Hum Behav. 2017 Jan 10;1:0021. (PMID: 33954258)
Trends Cogn Sci. 2019 Oct;23(10):815-818. (PMID: 31421987)
PLoS One. 2017 Jun 1;12(6):e0178379. (PMID: 28570573)
PLoS One. 2015 Aug 05;10(8):e0132382. (PMID: 26244868)
PLoS One. 2009 May 29;4(5):e5738. (PMID: 19478950)
Cortex. 2013 Mar;49(3):609-10. (PMID: 23347556)
PLoS Med. 2008 Nov 25;5(11):e230. (PMID: 19067481)
R Soc Open Sci. 2021 Oct 13;8(10):210155. (PMID: 34659776)
Science. 2015 Aug 28;349(6251):aac4716. (PMID: 26315443)
Perspect Psychol Sci. 2016 Sep;11(5):702-712. (PMID: 27694465)
N Engl J Med. 2017 Jan 26;376(4):383-391. (PMID: 28121511)
Am Psychol. 2015 Sep;70(6):499-514. (PMID: 26348333)
PLoS Med. 2005 Aug;2(8):e124. (PMID: 16060722)
Acta Psychol (Amst). 2014 May;148:188-94. (PMID: 24589374)
PLoS One. 2020 Jul 31;15(7):e0236079. (PMID: 32735597)
Perspect Psychol Sci. 2012 Nov;7(6):632-8. (PMID: 26168122)
Addiction. 2015 Jan;110(1):10-1. (PMID: 25515826)
Psychol Methods. 2014 Sep;19(3):409-27. (PMID: 24773354)
Psychol Sci. 2012 May 1;23(5):524-32. (PMID: 22508865)
Nature. 2016 Feb 4;530(7588):7. (PMID: 26842021)
BMJ. 2005 Apr 2;330(7494):753. (PMID: 15681569)
Front Psychol. 2016 Nov 25;7:1832. (PMID: 27933012)
PLoS One. 2018 Feb 5;13(2):e0188247. (PMID: 29401492)
Anesth Analg. 2017 Oct;125(4):1292-1300. (PMID: 28704247)
Psychometrika. 2016 Mar;81(1):33-8. (PMID: 25820978)
BMJ. 2008 Dec 04;337:a2299. (PMID: 19056791)
Trials. 2019 Feb 14;20(1):118. (PMID: 30760329)
Psychol Sci. 2011 Nov;22(11):1359-66. (PMID: 22006061)
Account Res. 2019 Apr;26(3):229-244. (PMID: 30741570)
N Engl J Med. 2004 Sep 16;351(12):1250-1. (PMID: 15356289)
Perspect Psychol Sci. 2013 Jul;8(4):424-32. (PMID: 26173121)
Behav Res Methods. 2007 May;39(2):175-91. (PMID: 17695343)
J Pers Soc Psychol. 2017 Jul;113(1):34-58. (PMID: 28447837)
PLoS One. 2017 Mar 15;12(3):e0172792. (PMID: 28296929)
PLoS One. 2008 Aug 28;3(8):e3081. (PMID: 18769481)
BMJ. 2010 Feb 15;340:c365. (PMID: 20156912)
Perspect Psychol Sci. 2019 Nov;14(6):1105-1108. (PMID: 31449761)
Nature. 2019 Sep;573(7773):187-189. (PMID: 31506624)
JAMA. 2004 May 26;291(20):2457-65. (PMID: 15161896)
تواريخ الأحداث: Date Created: 20201209 Date Completed: 20210202 Latest Revision: 20240330
رمز التحديث: 20240330
مُعرف محوري في PubMed: PMC7725296
DOI: 10.1371/journal.pbio.3000937
PMID: 33296358
قاعدة البيانات: MEDLINE
الوصف
تدمد:1545-7885
DOI:10.1371/journal.pbio.3000937