دورية أكاديمية
Better Accuracy for Better Science . . . Through Random Conclusions.
العنوان: | Better Accuracy for Better Science . . . Through Random Conclusions. |
---|---|
المؤلفون: | Davis-Stober CP; Department of Psychological Sciences, MU Institute for Data Science and Informatics, University of Missouri., Dana J; Yale School of Management, Yale University., Kellen D; Department of Psychology, Syracuse University., McMullin SD; Department of Psychological Sciences, University of Missouri., Bonifay W; Missouri Prevention Science Institute, Educational, School & Counseling Psychology, University of Missouri. |
المصدر: | Perspectives on psychological science : a journal of the Association for Psychological Science [Perspect Psychol Sci] 2024 Jan; Vol. 19 (1), pp. 223-243. Date of Electronic Publication: 2023 Jul 19. |
نوع المنشور: | Journal Article |
اللغة: | English |
بيانات الدورية: | Publisher: Sage Country of Publication: United States NLM ID: 101274347 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1745-6924 (Electronic) Linking ISSN: 17456916 NLM ISO Abbreviation: Perspect Psychol Sci Subsets: MEDLINE |
أسماء مطبوعة: | Publication: 2010- : Thousand Oaks, CA : Sage Original Publication: [Washington, D.C.] : Association for Psychological Science, 2006- |
مواضيع طبية MeSH: | Research Design* , Neurosciences*, Humans ; Sample Size |
مستخلص: | Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a baseline for interpreting effect-size estimates, in turn producing more stringent thresholds for hypothesis testing and for statistical-power calculations. An examination of recent meta-analyses in psychology, neuroscience, and medicine confirms that, even if all considered effects are real, results involving small effects are indeed indistinguishable from random conclusions. |
References: | PLoS One. 2019 May 15;14(5):e0216125. (PMID: 31091251) Psychon Bull Rev. 2018 Feb;25(1):114-127. (PMID: 28194721) Perspect Psychol Sci. 2021 Jul;16(4):789-802. (PMID: 33482070) Psychol Methods. 2016 Mar;21(1):1-12. (PMID: 26214497) Nature. 2022 Mar;603(7902):654-660. (PMID: 35296861) J Appl Psychol. 2022 Nov;107(11):2013-2039. (PMID: 34968082) Perspect Psychol Sci. 2021 Jul;16(4):767-778. (PMID: 33513319) Psychol Sci. 2011 Nov;22(11):1359-66. (PMID: 22006061) Trends Cogn Sci. 2019 Oct;23(10):815-818. (PMID: 31421987) Front Psychol. 2011 Feb 22;2:24. (PMID: 21713172) Behav Res Methods. 2014 Mar;46(1):1-14. (PMID: 23661222) Psychon Bull Rev. 2009 Apr;16(2):225-37. (PMID: 19293088) Science. 2017 Feb 10;355(6325):584-585. (PMID: 28183939) Perspect Psychol Sci. 2014 Nov;9(6):641-51. (PMID: 26186114) Multivariate Behav Res. 2011 Feb 7;46(1):1-32. (PMID: 26771579) Annu Rev Psychol. 2018 Jan 4;69:487-510. (PMID: 29300688) Am Psychol. 2015 Sep;70(6):487-98. (PMID: 26348332) Multivariate Behav Res. 2021 Mar-Apr;56(2):329-335. (PMID: 33960861) Biometrika. 1947;34(1-2):28-35. (PMID: 20287819) Psychol Methods. 2003 Sep;8(3):305-21. (PMID: 14596493) Perspect Psychol Sci. 2022 Jan;17(1):205-215. (PMID: 34213378) Perspect Psychol Sci. 2021 Jul;16(4):671-681. (PMID: 34240651) Psychol Rev. 2021 Nov;128(6):1187-1196. (PMID: 34735172) Psychon Bull Rev. 2012 Dec;19(6):1047-56. (PMID: 22869335) Psychol Methods. 2000 Jun;5(2):241-301. (PMID: 10937333) R Soc Open Sci. 2023 Mar 15;10(3):221042. (PMID: 36938532) Nat Hum Behav. 2017 Jan 10;1:0021. (PMID: 33954258) Psychometrika. 1965 Jun;30:179-85. (PMID: 14306381) Psychol Bull. 2018 Sep;144(9):885-958. (PMID: 30148379) J Speech Lang Hear Res. 2020 May 22;63(5):1572-1580. (PMID: 32343919) Trends Cogn Sci. 2020 Feb;24(2):94-95. (PMID: 31892461) J Intell. 2020 Oct 02;8(4):. (PMID: 33023250) PLoS Biol. 2017 Mar 2;15(3):e2000797. (PMID: 28253258) Anesth Analg. 2018 Mar;126(3):1068-1072. (PMID: 29337724) Psychol Sci. 2017 Nov;28(11):1547-1562. (PMID: 28902575) Perspect Psychol Sci. 2021 Jul;16(4):682-697. (PMID: 33404356) Psychol Rev. 2019 Nov;126(6):865-879. (PMID: 31414875) Nat Hum Behav. 2018 Jan;2(1):6-10. (PMID: 30980045) |
معلومات مُعتمدة: | K25 AA024182 United States AA NIAAA NIH HHS |
فهرسة مساهمة: | Keywords: benchmarks; estimation; hypothesis testing; random conclusions; t tests |
تواريخ الأحداث: | Date Created: 20230719 Date Completed: 20240116 Latest Revision: 20240218 |
رمز التحديث: | 20240218 |
مُعرف محوري في PubMed: | PMC10796851 |
DOI: | 10.1177/17456916231182097 |
PMID: | 37466102 |
قاعدة البيانات: | MEDLINE |
تدمد: | 1745-6924 |
---|---|
DOI: | 10.1177/17456916231182097 |