Dynamic noise estimation: A generalized method for modeling noise fluctuations in decision-making.
| العنوان: | Dynamic noise estimation: A generalized method for modeling noise fluctuations in decision-making. |
|---|---|
| المؤلفون: | Li JJ; Helen Wills Neuroscience Institute, University of California, Berkeley, 175 Li Ka Shing Center, Berkeley, 94720, CA, United States., Shi C; Department of Statistics, London School of Economics and Political Science, 69 Aldwych, London, WC2B 4RR, United Kingdom., Li L; Helen Wills Neuroscience Institute, University of California, Berkeley, 175 Li Ka Shing Center, Berkeley, 94720, CA, United States.; Department of Biostatistics and Epidemiology, University of California, Berkeley, 2121 Berkeley Way, Berkeley, 94720, CA, United States., Collins AGE; Helen Wills Neuroscience Institute, University of California, Berkeley, 175 Li Ka Shing Center, Berkeley, 94720, CA, United States.; Department of Psychology, University of California, Berkeley, Berkeley, 94720, CA, United States. |
| المصدر: | BioRxiv : the preprint server for biology [bioRxiv] 2024 Jan 26. Date of Electronic Publication: 2024 Jan 26. |
| نوع المنشور: | Preprint |
| اللغة: | English |
| بيانات الدورية: | Country of Publication: United States NLM ID: 101680187 Publication Model: Electronic Cited Medium: Internet NLM ISO Abbreviation: bioRxiv Subsets: PubMed not MEDLINE |
| مستخلص: | Computational cognitive modeling is an important tool for understanding the processes supporting human and animal decision-making. Choice data in decision-making tasks are inherently noisy, and separating noise from signal can improve the quality of computational modeling. Common approaches to model decision noise often assume constant levels of noise or exploration throughout learning (e.g., the ϵ -softmax policy). However, this assumption is not guaranteed to hold - for example, a subject might disengage and lapse into an inattentive phase for a series of trials in the middle of otherwise low-noise performance. Here, we introduce a new, computationally inexpensive method to dynamically infer the levels of noise in choice behavior, under a model assumption that agents can transition between two discrete latent states (e.g., fully engaged and random). Using simulations, we show that modeling noise levels dynamically instead of statically can substantially improve model fit and parameter estimation, especially in the presence of long periods of noisy behavior, such as prolonged attentional lapses. We further demonstrate the empirical benefits of dynamic noise estimation at the individual and group levels by validating it on four published datasets featuring diverse populations, tasks, and models. Based on the theoretical and empirical evaluation of the method reported in the current work, we expect that dynamic noise estimation will improve modeling in many decision-making paradigms over the static noise estimation method currently used in the modeling literature, while keeping additional model complexity and assumptions minimal. |
| References: | Curr Biol. 2022 Feb 7;32(3):586-599.e7. (PMID: 34936883) PLoS Comput Biol. 2016 Aug 26;12(8):e1005090. (PMID: 27564094) Nature. 2006 Jun 15;441(7095):876-9. (PMID: 16778890) Trends Cogn Sci. 2017 Jun;21(6):425-433. (PMID: 28476348) Dev Cogn Neurosci. 2020 Feb;41:100732. (PMID: 31826837) Neuroscience. 2017 Mar 14;345:12-26. (PMID: 26979052) Curr Opin Psychol. 2019 Oct;29:174-180. (PMID: 30986621) Science. 2014 Jun 27;344(6191):1481-6. (PMID: 24876345) Elife. 2019 Nov 26;8:. (PMID: 31769410) Biol Psychiatry. 1999 Nov 1;46(9):1309-20. (PMID: 10560036) Psychol Rev. 2001 Jul;108(3):624-52. (PMID: 11488380) Neuroimage. 2014 Jan 1;84:971-85. (PMID: 24018303) Curr Opin Behav Sci. 2016 Oct;11:49-54. (PMID: 27574699) Elife. 2022 Nov 04;11:. (PMID: 36331872) Hum Factors. 2008 Jun;50(3):433-41. (PMID: 18689050) Nat Neurosci. 2022 Feb;25(2):201-212. (PMID: 35132235) Eur J Neurosci. 2012 Apr;35(7):1024-35. (PMID: 22487033) Brain Res Brain Res Rev. 2003 Apr;42(1):33-84. (PMID: 12668290) J Exp Psychol Gen. 2014 Dec;143(6):2074-81. (PMID: 25347535) Psychon Bull Rev. 2005 Aug;12(4):605-21. (PMID: 16447375) Perspect Psychol Sci. 2012 Jan;7(1):18-27. (PMID: 26168419) J Cogn Neurosci. 2018 Oct;30(10):1422-1432. (PMID: 29346018) Clin Neurophysiol. 2007 Oct;118(10):2128-48. (PMID: 17573239) Trends Cogn Sci. 2014 Mar;18(3):153-61. (PMID: 24467913) PLoS Comput Biol. 2019 Jun 13;15(6):e1006989. (PMID: 31194733) Nat Neurosci. 2016 Mar;19(3):404-13. (PMID: 26906507) Curr Opin Neurobiol. 2019 Apr;55:7-14. (PMID: 30529148) PLoS Biol. 2012;10(3):e1001293. (PMID: 22479152) Front Hum Neurosci. 2014 Feb 26;8:102. (PMID: 24616689) Psychon Bull Rev. 2005 Jun;12(3):387-402. (PMID: 16235624) Curr Opin Neurobiol. 2008 Apr;18(2):185-96. (PMID: 18708140) Psychol Bull. 1997 Jan;121(1):65-94. (PMID: 9000892) Neuropsychopharmacology. 2021 Jan;46(1):3-19. (PMID: 32620005) PLoS Comput Biol. 2019 Jun 18;15(6):e1007043. (PMID: 31211783) |
| معلومات مُعتمدة: | R01 MH119383 United States MH NIMH NIH HHS |
| فهرسة مساهمة: | Keywords: attention; cognitive modeling; decision noise; decision-making; hidden Markov model; lapses; reinforcement learning; task engagement |
| تواريخ الأحداث: | Date Created: 20240208 Latest Revision: 20240216 |
| رمز التحديث: | 20240216 |
| مُعرف محوري في PubMed: | PMC10849494 |
| DOI: | 10.1101/2023.06.19.545524 |
| PMID: | 38328176 |
| قاعدة البيانات: | MEDLINE |
| DOI: | 10.1101/2023.06.19.545524 |
|---|