دورية أكاديمية

Latent motives guide structure learning during adaptive social choice.

التفاصيل البيبلوغرافية
العنوان: Latent motives guide structure learning during adaptive social choice.
المؤلفون: van Baar JM; Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI, USA.; Trimbos Institute, Netherlands Institute of Mental Health and Addiction, Utrecht, the Netherlands., Nassar MR; Department of Neuroscience, Brown University, Providence, RI, USA.; Carney Institute for Brain Science, Brown University, Providence, RI, USA., Deng W; Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI, USA., FeldmanHall O; Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI, USA. Oriel.FeldmanHall@Brown.edu.; Carney Institute for Brain Science, Brown University, Providence, RI, USA. Oriel.FeldmanHall@Brown.edu.
المصدر: Nature human behaviour [Nat Hum Behav] 2022 Mar; Vol. 6 (3), pp. 404-414. Date of Electronic Publication: 2021 Nov 08.
نوع المنشور: Journal Article; Research Support, N.I.H., Extramural
اللغة: English
بيانات الدورية: Publisher: Springer Nature Publishing Country of Publication: England NLM ID: 101697750 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 2397-3374 (Electronic) Linking ISSN: 23973374 NLM ISO Abbreviation: Nat Hum Behav Subsets: MEDLINE
أسماء مطبوعة: Original Publication: [London] : Springer Nature Publishing, [2017]-
مواضيع طبية MeSH: Cooperative Behavior* , Prisoner Dilemma*, Humans ; Learning ; Motivation
مستخلص: Predicting the behaviour of others is an essential part of social cognition. Despite its ubiquity, social prediction poses a poorly understood generalization problem: we cannot assume that others will repeat past behaviour in new settings or that their future actions are entirely unrelated to the past. We demonstrate that humans solve this challenge using a structure learning mechanism that uncovers other people's latent, unobservable motives, such as greed and risk aversion. In four studies, participants (N = 501) predicted other players' decisions across four economic games, each with different social tensions (for example, Prisoner's Dilemma and Stag Hunt). Participants achieved accurate social prediction by learning the stable motivational structure underlying a player's changing actions across games. This motive-based abstraction enabled participants to attend to information diagnostic of the player's next move and disregard irrelevant contextual cues. Participants who successfully learned another's motives were more strategic in a subsequent competitive interaction with that player in entirely new contexts, reflecting that social structure learning supports adaptive social behaviour.
(© 2021. The Author(s), under exclusive licence to Springer Nature Limited.)
References: Stewart, A. J. et al. Information gerrymandering and undemocratic decisions. Nature 573, 117–121 (2019). (PMID: 3148505810.1038/s41586-019-1507-6)
Hauser, O. P., Rand, D. G., Peysakhovich, A. & Nowak, M. A. Cooperating with the future. Nature 511, 220–223 (2014). (PMID: 2500853010.1038/nature13530)
Fraser, C., Riley, S., Anderson, R. M. & Ferguson, N. M. Factors that make an infectious disease outbreak controllable. Proc. Natl Acad. Sci. USA 101, 6146–6151 (2004). (PMID: 1507118739593710.1073/pnas.0307506101)
Tenenbaum, J. B., Kemp, C., Griffiths, T. L. & Goodman, N. D. How to grow a mind: statistics, structure, and abstraction. Science 331, 1279–1285 (2011). (PMID: 2139353610.1126/science.1192788)
Seuntjens, T. G., Zeelenberg, M., Van De Ven, N. & Breugelmans, S. M. Dispositional greed. J. Pers. Soc. Psychol. 108, 917–933 (2015). (PMID: 2566489910.1037/pspp0000031)
Fehr, E. & Schmidt, K. M. A theory of fairness, competition, and cooperation. Q. J. Econ. 114, 817–868 (1999). (PMID: 10.1162/003355399556151)
Bolton, G. & Ockenfels, A. ERC: a theory of equity, reciprocity, and competition. Am. Econ. Rev. 90, 166–193 (2000). (PMID: 10.1257/aer.90.1.166)
Weber, E. U., Blais, A.-R. & Betz, N. E. A domain-specific risk-attitude scale: measuring risk perceptions and risk behaviors. J. Behav. Decis. Mak. 15, 263–290 (2002). (PMID: 10.1002/bdm.414)
Kahneman, D. & Tversky, A. Prospect theory: an analysis of decision under risk. Econometrica 47, 263–292 (1979). (PMID: 10.2307/1914185)
Peysakhovich, A., Nowak, M. A. & Rand, D. G. Humans display a ‘cooperative phenotype’ that is domain general and temporally stable. Nat. Commun. 5, 4939 (2014). (PMID: 2522595010.1038/ncomms5939)
Van Lange, P. A. M. The pursuit of joint outcomes and equality in outcomes: an integrative model of social value orientation. J. Pers. Soc. Psychol. 77, 337–349 (1999). (PMID: 10.1037/0022-3514.77.2.337)
van Baar, J. M., Chang, L. J. & Sanfey, A. G. The computational and neural substrates of moral strategies in social decision-making. Nat. Commun. 10, 1483 (2019). (PMID: 30940815644512110.1038/s41467-019-09161-6)
Poncela-Casasnovas, J. et al. Humans display a reduced set of consistent behavioral phenotypes in dyadic games. Sci. Adv. 2, e1600451 (2016). (PMID: 27532047497555510.1126/sciadv.1600451)
van Baar, J. M., Klaassen, F. H., Ricci, F., Chang, L. J. & Sanfey, A. G. Stable distribution of reciprocity motives in a population. Sci. Rep. 10, 18164 (2020). (PMID: 33097738758466310.1038/s41598-020-74818-y)
Jara-Ettinger, J. Theory of mind as inverse reinforcement learning. Curr. Opin. Behav. Sci. 29, 105–110 (2019). (PMID: 10.1016/j.cobeha.2019.04.010)
Bridgers, S., Jara-Ettinger, J. & Gweon, H. Young children consider the expected utility of others’ learning to decide what to teach. Nat. Hum. Behav. https://doi.org/10.1038/s41562-019-0748-6 (2019).
Liu, S., Ullman, T. D., Tenenbaum, J. B. & Spelke, E. S. Ten-month-old infants infer the value of goals from the costs of actions. Science 358, 1038–1041 (2017). (PMID: 2917023210.1126/science.aag2132)
Baker, C. L., Saxe, R. & Tenenbaum, J. B. Action understanding as inverse planning. Cognition 113, 329–349 (2009). (PMID: 1972915410.1016/j.cognition.2009.07.005)
Baker, C. L., Jara-Ettinger, J., Saxe, R. & Tenenbaum, J. B. Rational quantitative attribution of beliefs, desires and percepts in human mentalizing. Nat. Hum. Behav. 1, 0064 (2017). (PMID: 10.1038/s41562-017-0064)
Nihonsugi, T., Ihara, A. & Haruno, M. Selective increase of intention-based economic decisions by noninvasive brain stimulation to the dorsolateral prefrontal cortex. J. Neurosci. 35, 3412–3419 (2015). (PMID: 25716841660555010.1523/JNEUROSCI.3885-14.2015)
Wedekind, C. & Milinski, M. Cooperation through image scoring in humans. Science 288, 850–852 (2000). (PMID: 1079700510.1126/science.288.5467.850)
Harbaugh, W. T., Mayr, U. & Burghart, D. R. Neural responses to taxation and voluntary giving reveal motives for charitable donations. Science 316, 1622–1625 (2007). (PMID: 1756986610.1126/science.1140738)
Niv, Y. et al. Reinforcement learning in multidimensional environments relies on attention mechanisms. J. Neurosci. 35, 8145–8157 (2015). (PMID: 26019331444453810.1523/JNEUROSCI.2978-14.2015)
Radulescu, A., Niv, Y. & Ballard, I. Holistic reinforcement learning: the role of structure and attention. Trends Cogn. Sci. 23, 278–292 (2019). (PMID: 30824227647295510.1016/j.tics.2019.01.010)
Leong, Y. C., Radulescu, A., Daniel, R., Dewoskin, V. & Niv, Y. Dynamic interaction between reinforcement learning and attention in multidimensional environments. Neuron 93, 451–463 (2017). (PMID: 28103483528740910.1016/j.neuron.2016.12.040)
Collins, A. G. E. & Frank, M. J. Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning. Cognition 152, 160–169 (2016). (PMID: 27082659559521810.1016/j.cognition.2016.04.002)
Schapiro, A. C., Rogers, T. T., Cordova, N. I., Turk-Browne, N. B. & Botvinick, M. M. Neural representations of events arise from temporal community structure. Nat. Neurosci. 16, 486–492 (2013). (PMID: 23416451374982310.1038/nn.3331)
Wilson, R. C. & Niv, Y. Inferring relevance in a changing world. Front. Hum. Neurosci. 5, 189 (2012). (PMID: 22291631326490210.3389/fnhum.2011.00189)
Schapiro, A. C., Turk-Browne, N. B., Norman, K. A. & Botvinick, M. M. Statistical learning of temporal community structure in the hippocampus. Hippocampus 26, 3–8 (2016). (PMID: 2633266610.1002/hipo.22523)
Gershman, S. J. & Niv, Y. Learning latent structure: carving nature at its joints. Curr. Opin. Neurobiol. 20, 251–256 (2010). (PMID: 20227271286279310.1016/j.conb.2010.02.008)
Kemp, C. & Tenenbaum, J. B. The discovery of structural form. Proc. Natl Acad. Sci. USA 105, 10687–10692 (2008). (PMID: 18669663249275610.1073/pnas.0802631105)
Heckathorn, D. D. The dynamics and dilemmas of collective action. Am. Sociol. Rev. 61, 250–277 (1996). (PMID: 10.2307/2096334)
Axelrod, R. Effective choice in the prisoner’ s dilemma. J. Conflict Resolut. 24, 3–25 (1980). (PMID: 10.1177/002200278002400101)
Fehr, E. & Fischbacher, U. Social norms and human cooperation. Trends Cogn. Sci. 8, 185–190 (2004). (PMID: 1505051510.1016/j.tics.2004.02.007)
Goeree, J. K., Holt, C. A. & Palfrey, T. R. Risk averse behavior in generalized matching pennies games. Games Econ. Behav. 45, 97–113 (2003). (PMID: 10.1016/S0899-8256(03)00052-6)
Bernoulli, D. Exposition of a new theory on the measurement of risk. Econometrica 22, 23–36 (1954). (PMID: 10.2307/1909829)
Huygens, C. The Value of All Chances in Games of Fortune (Woodward, 1714).
Schwarz, G. Estimating the dimension of a model. Ann. Stat. 6, 461–464 (1978). (PMID: 10.1214/aos/1176344136)
Hampton, A. N., Bossaerts, P. & O’Doherty, J. P. Neural correlates of mentalizing-related computations during strategic interactions in humans. Proc. Natl Acad. Sci. USA 105, 6741–6746 (2008). (PMID: 18427116237331410.1073/pnas.0711099105)
Nosenzo, D., Offerman, T., Sefton, M. & Van Der Veen, A. Discretionary sanctions and rewards in the repeated inspection game. Manage. Sci. 62, 502–517 (2016). (PMID: 10.1287/mnsc.2014.2124)
FeldmanHall, O. & Shenhav, A. Resolving uncertainty in a social world. Nat. Hum. Behav. 3, 426–435 (2019). (PMID: 31011164659439310.1038/s41562-019-0590-x)
Gershman, S. J., Pouncy, H. T. & Gweon, H. Learning the structure of social influence. Cogn. Sci. 41, 545–575 (2017). (PMID: 2829438410.1111/cogs.12480)
Shin, Y. S. & Niv, Y. Biased evaluations emerge from inferring hidden causes. Nat. Hum. Behav. 5, 1180–1189 (2021). (PMID: 33686201842385710.1038/s41562-021-01065-0)
Lau, T., Pouncy, H. T., Gershman, S. J. & Cikara, M. Discovering social groups via latent structure learning. J. Exp. Psychol. Gen. 147, 1881–1891 (2018). (PMID: 3026502510.1037/xge0000470)
Jara-Ettinger, J. Theory of mind as inverse reinforcement learning. Curr. Opin. Behav. Sci. 29, 105–110 (2019). (PMID: 10.1016/j.cobeha.2019.04.010)
Collette, S., Pauli, W. M., Bossaerts, P. & O’Doherty, J. Neural computations underlying inverse reinforcement learning in the human brain. eLife 6, e29718 (2017). (PMID: 29083301566228910.7554/eLife.29718)
Gobet, F. et al. Chunking mechanisms in human learning. Trends Cogn. Sci. 5, 236–243 (2001). (PMID: 1139029410.1016/S1364-6613(00)01662-4)
Thalmann, M., Souza, A. S. & Oberauer, K. How does chunking help working memory? J. Exp. Psychol. Learn. Mem. Cogn. 45, 37–55 (2019). (PMID: 2969804510.1037/xlm0000578)
Johnson, E. J., Camerer, C., Sen, S. & Rymon, T. Detecting failures of backward induction: monitoring information search in sequential bargaining. J. Econ. Theory 104, 16–47 (2002). (PMID: 10.1006/jeth.2001.2850)
Nagel, R. Unraveling in guessing games: an experimental study. Am. Econ. Rev. 85, 1313–1326 (1995).
Rapoport, A. Individual strategies in a market entry game. Group Decis. Negot. 4, 117–133 (1995). (PMID: 10.1007/BF01410098)
Kollock, P. Social dilemmas: the anatomy of cooperation. Annu. Rev. Sociol. 24, 183–214 (1998). (PMID: 10.1146/annurev.soc.24.1.183)
Fischbacher, U., Gächter, S. & Fehr, E. Are people conditionally cooperative? Evidence from a public goods experiment. Econ. Lett. 71, 397–404 (2001). (PMID: 10.1016/S0165-1765(01)00394-9)
Kurzban, R. & Houser, D. Experiments investigating cooperative types in humans: a complement to evolutionary theory and simulations. Proc. Natl Acad. Sci. USA 102, 1803–1807 (2005). (PMID: 1566509954786110.1073/pnas.0408759102)
Moore, T. & Zirnsak, M. Neural mechanisms of selective visual attention. Annu. Rev. Psychol. 68, 47–72 (2017). (PMID: 2805193410.1146/annurev-psych-122414-033400)
Caprariello, P. A., Cuddy, A. J. C. & Fiske, S. T. Social structure shapes cultural stereotypes and emotions: a causal test of the stereotype content model. Group Process. Intergroup Relat. 12, 147–155 (2009). (PMID: 10.1177/1368430208101053)
McCauley, C., Stitt, C. L. & Segal, M. Stereotyping: from prejudice to prediction. Psychol. Bull. 87, 195–208 (1980). (PMID: 10.1037/0033-2909.87.1.195)
Nickerson, R. S. Confirmation bias: a ubiquitous phenomenon in many guises. Rev. Gen. Psychol. 2, 175–220 (1998). (PMID: 10.1037/1089-2680.2.2.175)
Pierson, E. et al. A large-scale analysis of racial disparities in police stops across the United States. Nat. Hum. Behav. https://doi.org/10.1016/j.athoracsur.2014.09.078 (2020).
Gureckis, T. M. et al. psiTurk: an open-source framework for conducting replicable behavioral experiments online. Behav. Res. Methods 48, 829–842 (2016). (PMID: 2642891010.3758/s13428-015-0642-8)
Licht, A. N. Games commissions play: 2 × 2 games of international securities regulation. Yale J. Int. Law 24, 61–125 (1999).
Bramoullé, Y. Anti-coordination and social interactions. Games Econ. Behav. 58, 30–49 (2007). (PMID: 10.1016/j.geb.2005.12.006)
Skyrms, B. The Stag Hunt. Proc. Addresses Am. Phil. Assoc. 75, 31–41 (2001). (PMID: 10.2307/3218711)
Von Neumann, J. & Morgenstern, O. Theory of Games and Economic Behavior (Princeton Univ. Press, 1944).
Harris, C. R. et al. Array programming with NumPy. Nature 585, 357–362 (2020). (PMID: 32939066775946110.1038/s41586-020-2649-2)
McKinney, W. Data structures for statistical computing in Python. In Proc. 9th Python in Science Conf. (eds van der Walt, S. & Millman, J.) 56–61 (2010).
Virtanen, P. et al. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat. Methods 17, 261–272 (2020). (PMID: 32015543705664410.1038/s41592-019-0686-2)
Hunter, J. D. Matplotlib: a 2D graphics environment. Comput. Sci. Engineer. 9, 90–95 (2007). (PMID: 10.1109/MCSE.2007.55)
Waskom, M. seaborn: statistical data visualization. J. Open Source Softw. 6, 3021 (2021). (PMID: 10.21105/joss.03021)
Mueller, A. WordCloud for Python documentation, https://amueller.github.io/word_cloud/ (2020).
Bates, D., Mächler, M., Bolker, B. & Walker, S. Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67, 1–48 (2015). (PMID: 10.18637/jss.v067.i01)
Kuznetsova, A., Brockhoff, P. B. & Christensen, R. H. B. lmerTest package: tests in linear mixed effects models. J. Stat. Softw. 82, 1–26 (2017). (PMID: 10.18637/jss.v082.i13)
معلومات مُعتمدة: S10 OD025181 United States OD NIH HHS
تواريخ الأحداث: Date Created: 20211109 Date Completed: 20220426 Latest Revision: 20230429
رمز التحديث: 20230429
DOI: 10.1038/s41562-021-01207-4
PMID: 34750584
قاعدة البيانات: MEDLINE
الوصف
تدمد:2397-3374
DOI:10.1038/s41562-021-01207-4