Human EEG and artificial neural networks reveal disentangled representations of object real-world size in natural images.
| العنوان: | Human EEG and artificial neural networks reveal disentangled representations of object real-world size in natural images. |
|---|---|
| المؤلفون: | Lu Z; Department of Psychology, The Ohio State University, Columbus, OH 43212 USA., Golomb JD; Department of Psychology, The Ohio State University, Columbus, OH 43212 USA. |
| المصدر: | BioRxiv : the preprint server for biology [bioRxiv] 2024 Mar 21. Date of Electronic Publication: 2024 Mar 21. |
| نوع المنشور: | Preprint |
| اللغة: | English |
| بيانات الدورية: | Country of Publication: United States NLM ID: 101680187 Publication Model: Electronic Cited Medium: Internet NLM ISO Abbreviation: bioRxiv Subsets: PubMed not MEDLINE |
| مستخلص: | Remarkably, human brains have the ability to accurately perceive and process the real-world size of objects, despite vast differences in distance and perspective. While previous studies have delved into this phenomenon, distinguishing this ability from other visual perceptions, like depth, has been challenging. Using the THINGS EEG2 dataset with high time-resolution human brain recordings and more ecologically valid naturalistic stimuli, our study uses an innovative approach to disentangle neural representations of object real-world size from retinal size and perceived real-world depth in a way that was not previously possible. Leveraging this state-of-the-art dataset, our EEG representational similarity results reveal a pure representation of object real-world size in human brains. We report a representational timeline of visual object processing: object real-world depth appeared first, then retinal size, and finally, real-world size. Additionally, we input both these naturalistic images and object-only images without natural background into artificial neural networks. Consistent with the human EEG findings, we also successfully disentangled representation of object real-world size from retinal size and real-world depth in all three types of artificial neural networks (visual-only ResNet, visual-language CLIP, and language-only Word2Vec). Moreover, our multi-modal representational comparison framework across human EEG and artificial neural networks reveals real-world size as a stable and higher-level dimension in object space incorporating both visual and semantic information. Our research provides a detailed and clear characterization of the object processing process, which offers further advances and insights into our understanding of object space and the construction of more brain-like visual models. |
| References: | Curr Biol. 2020 Jul 6;30(13):2621-2627.e5. (PMID: 32531274) Behav Res Methods. 2023 Apr 24;:. (PMID: 37095326) Cognition. 2017 Nov;168:234-242. (PMID: 28732302) Sci Data. 2022 Jan 10;9(1):3. (PMID: 35013331) Commun Biol. 2022 Jul 27;5(1):749. (PMID: 35896715) iScience. 2023 Nov 22;26(12):108501. (PMID: 38089588) Front Neuroinform. 2021 Sep 22;15:679838. (PMID: 34630062) J Cogn Neurosci. 2022 Aug 1;34(9):1670-1680. (PMID: 35704550) Proc Natl Acad Sci U S A. 2018 Sep 18;115(38):E9015-E9024. (PMID: 30171168) Neuron. 2012 Dec 20;76(6):1210-24. (PMID: 23259955) Nat Neurosci. 2016 Mar;19(3):356-65. (PMID: 26906502) Nature. 2020 Jul;583(7814):103-108. (PMID: 32494012) PLoS Comput Biol. 2014 Nov 06;10(11):e1003915. (PMID: 25375136) J Neurosci. 2013 Jun 19;33(25):10235-42. (PMID: 23785139) J Cogn Neurosci. 2018 Nov;30(11):1559-1576. (PMID: 29877767) Proc Natl Acad Sci U S A. 2014 Jun 10;111(23):8619-24. (PMID: 24812127) J Neurosci. 2016 Jan 13;36(2):432-44. (PMID: 26758835) Commun Biol. 2018 Aug 8;1:107. (PMID: 30271987) J Physiol Paris. 2012 Sep-Dec;106(5-6):239-49. (PMID: 22472178) J Exp Psychol Hum Percept Perform. 2011 Feb;37(1):23-37. (PMID: 20822298) Nat Neurosci. 2022 Jan;25(1):116-126. (PMID: 34916659) J Neurosci. 2015 Jul 8;35(27):10005-14. (PMID: 26157000) Cereb Cortex. 2014 Apr;24(4):883-97. (PMID: 23211209) J Neurosci. 2023 Mar 8;43(10):1731-1741. (PMID: 36759190) PLoS One. 2019 Oct 15;14(10):e0223792. (PMID: 31613926) Neuron. 2008 Dec 26;60(6):1126-41. (PMID: 19109916) Nat Rev Neurosci. 2023 Jul;24(7):431-450. (PMID: 37253949) Proc Natl Acad Sci U S A. 2020 Nov 24;117(47):29330-29337. (PMID: 33229549) J Exp Psychol Hum Percept Perform. 2012 Jun;38(3):561-9. (PMID: 22545601) J Exp Psychol Gen. 2016 Jan;145(1):95-109. (PMID: 26709591) Neuron. 2012 Jun 21;74(6):1114-24. (PMID: 22726840) J Cogn Neurosci. 2016 May;28(5):680-92. (PMID: 26765944) Proc Natl Acad Sci U S A. 2019 Oct 22;116(43):21854-21863. (PMID: 31591217) Trends Neurosci. 2023 Mar;46(3):240-254. (PMID: 36658072) Neuroimage. 2022 Dec 1;264:119754. (PMID: 36400378) Cereb Cortex. 2023 Jun 20;33(13):8194-8217. (PMID: 36958809) Front Comput Neurosci. 2021 May 20;15:626259. (PMID: 34093154) Cognition. 2022 Aug;225:105114. (PMID: 35381479) Trends Cogn Sci. 2019 Apr;23(4):305-317. (PMID: 30795896) Sci Rep. 2016 Jun 10;6:27755. (PMID: 27282108) Front Neuroinform. 2020 Dec 23;14:563669. (PMID: 33424573) Cereb Cortex. 2017 Jan 1;27(1):310-321. (PMID: 28108492) Neural Netw. 2022 Oct;154:538-542. (PMID: 35995019) |
| معلومات مُعتمدة: | R01 EY025648 United States EY NEI NIH HHS |
| فهرسة مساهمة: | Keywords: RSA; artificial neural networks; depth perception; object recognition; real-world size |
| تواريخ الأحداث: | Date Created: 20230904 Latest Revision: 20240328 |
| رمز التحديث: | 20240329 |
| مُعرف محوري في PubMed: | PMC10473678 |
| DOI: | 10.1101/2023.08.19.553999 |
| PMID: | 37662197 |
| قاعدة البيانات: | MEDLINE |
| DOI: | 10.1101/2023.08.19.553999 |
|---|