دورية أكاديمية
Are the attention checks embedded in delay discounting tasks a valid marker for data quality?
| العنوان: | Are the attention checks embedded in delay discounting tasks a valid marker for data quality? |
|---|---|
| المؤلفون: | Almog S; Department of Health Education and Behavior, University of Florida., Vásquez Ferreiro A; Department of Health Education and Behavior, University of Florida., Berry MS; Department of Health Education and Behavior, University of Florida., Rung JM; Department of Health Education and Behavior, University of Florida. |
| المصدر: | Experimental and clinical psychopharmacology [Exp Clin Psychopharmacol] 2023 Oct; Vol. 31 (5), pp. 908-919. Date of Electronic Publication: 2023 Mar 23. |
| نوع المنشور: | Journal Article |
| اللغة: | English |
| بيانات الدورية: | Publisher: American Psychological Association Country of Publication: United States NLM ID: 9419066 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1936-2293 (Electronic) Linking ISSN: 10641297 NLM ISO Abbreviation: Exp Clin Psychopharmacol Subsets: MEDLINE |
| أسماء مطبوعة: | Original Publication: Washington, DC : American Psychological Association, c1993- |
| مواضيع طبية MeSH: | Delay Discounting* , Crowdsourcing*, Humans ; Data Accuracy ; Surveys and Questionnaires ; Probability |
| مستخلص: | To ensure good quality delay discounting (DD) data in research recruiting via crowdsourcing platforms, including attention checks within DD tasks have become common. These attention checks are typically identical in format to the task questions but have one sensical answer (e.g., "Would you prefer $0 now or $100 in a month?"). However, the validity of these attention checks as a marker for DD or overall survey data quality has not been directly examined. To address this gap, using data from two studies (total N = 700), the validity of these DD attention checks was tested by assessing performance on other non-DD attention checks and data quality measures both specific to DD and overall survey data (e.g., providing nonsystematic DD data, responding inconsistently in questionnaires). We also tested whether failing the attention checks was associated with degree of discounting or other participant characteristics to screen for potential bias. While failing the DD attention checks was associated with a greater likelihood of nonsystematic DD data, their discriminability was inadequate, and failure was sometimes associated with individual differences (suggesting that data exclusion might introduce bias). Failing the DD attention checks was also not associated with failing other attention checks or data quality indicators. Overall, the DD attention checks do not appear to be an adequate indicator of data quality on their own, for either the DD task or surveys overall. Strategies to enhance the validity of DD attention checks and data cleaning procedures are suggested, which should be evaluated in future research. (PsycInfo Database Record (c) 2023 APA, all rights reserved). |
| References: | Exp Clin Psychopharmacol. 2021 Feb;29(1):59-72. (PMID: 32191071) Exp Clin Psychopharmacol. 2022 Oct;30(5):500-506. (PMID: 34166034) Neuropharmacology. 2014 Jan;76 Pt B:518-27. (PMID: 23806805) Exp Clin Psychopharmacol. 2008 Jun;16(3):264-74. (PMID: 18540786) Qual Life Res. 2011 Sep;20(7):1035-42. (PMID: 21243528) Drug Alcohol Depend. 2018 Oct 1;191:165-173. (PMID: 30121475) Curr Opin Psychol. 2019 Dec;30:59-64. (PMID: 30852411) J Exp Anal Behav. 2017 Jan;107(1):151-160. (PMID: 28101922) Exp Clin Psychopharmacol. 2022 Aug;30(4):409-414. (PMID: 35175071) Psychol Bull. 1975 Jul;82(4):463-96. (PMID: 1099599) Exp Clin Psychopharmacol. 2018 Jun;26(3):278-289. (PMID: 29863384) Health Qual Life Outcomes. 2013 Sep 03;11:150. (PMID: 24004726) Exp Clin Psychopharmacol. 2022 Aug;30(4):379-380. (PMID: 35862134) J Pers Soc Psychol. 1988 Jun;54(6):1063-70. (PMID: 3397865) Perspect Psychol Sci. 2018 Mar;13(2):149-154. (PMID: 29928846) Clin Psychol Sci. 2017 Jul;5(4):683-697. (PMID: 28966885) Subst Use Misuse. 2022;57(6):857-866. (PMID: 35258409) Perspect Behav Sci. 2019 Sep;42(3):397-417. (PMID: 31650104) Exp Clin Psychopharmacol. 2022 Feb;30(1):39-50. (PMID: 32757596) J Exp Anal Behav. 2001 Sep;76(2):235-43. (PMID: 11599641) Psychopharmacology (Berl). 2019 Sep;236(9):2641-2652. (PMID: 30927021) J Exp Psychol Gen. 2018 Sep;147(9):1349-1381. (PMID: 30148386) Int J Environ Res Public Health. 2021 Nov 30;18(23):. (PMID: 34886370) Psychopharmacology (Berl). 2011 Aug;216(3):305-21. (PMID: 21373791) Psychol Addict Behav. 2019 May;33(3):310-317. (PMID: 30896193) Bioinformatics. 2005 Oct 15;21(20):3940-1. (PMID: 16096348) Exp Clin Psychopharmacol. 2023 Apr;31(2):330-335. (PMID: 35708947) Psychol Addict Behav. 2020 Feb;34(1):147-155. (PMID: 31343195) Exp Clin Psychopharmacol. 2019 Feb;27(1):19-28. (PMID: 30382730) J Pers Assess. 2011 Nov;93(6):628-36. (PMID: 21999386) Exp Clin Psychopharmacol. 2019 Oct;27(5):482-495. (PMID: 30762382) Exp Clin Psychopharmacol. 2023 Oct;31(5):908-919. (PMID: 36951710) Exp Clin Psychopharmacol. 2022 Aug;30(4):381-399. (PMID: 35130007) |
| معلومات مُعتمدة: | K99 AA029732 United States AA NIAAA NIH HHS; L30 DA052084 United States DA NIDA NIH HHS; K01 DA052673 United States DA NIDA NIH HHS; T32 AA025877 United States AA NIAAA NIH HHS; T32 DA035167 United States DA NIDA NIH HHS |
| تواريخ الأحداث: | Date Created: 20230323 Date Completed: 20230922 Latest Revision: 20240330 |
| رمز التحديث: | 20240330 |
| مُعرف محوري في PubMed: | PMC10694837 |
| DOI: | 10.1037/pha0000645 |
| PMID: | 36951710 |
| قاعدة البيانات: | MEDLINE |
| تدمد: | 1936-2293 |
|---|---|
| DOI: | 10.1037/pha0000645 |