An accurate and rapidly calibrating speech neuroprosthesis.
| العنوان: | An accurate and rapidly calibrating speech neuroprosthesis. |
|---|---|
| المؤلفون: | Card NS; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA., Wairagkar M; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA., Iacobacci C; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA., Hou X; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA.; Departments of Computer Science, University of California Davis, Davis, CA, USA., Singer-Clark T; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA.; Departments of Biomedical Engineering, University of California Davis, Davis, CA, USA., Willett FR; Departments of Neurosurgery, Stanford University, Stanford, CA, USA.; Departments of Electrical Engineering, Stanford University, Stanford, CA, USA.; Howard Hughes Medical Institute, Stanford University, Stanford, CA, USA., Kunz EM; Departments of Electrical Engineering, Stanford University, Stanford, CA, USA.; Departments of Mechanical Engineering, Stanford University, Stanford, CA, USA., Fan C; Departments of Computer Science, Stanford University, Stanford, CA, USA., Nia MV; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA.; Departments of Computer Science, University of California Davis, Davis, CA, USA., Deo DR; Departments of Neurosurgery, Stanford University, Stanford, CA, USA., Srinivasan A; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA.; Departments of Biomedical Engineering, University of California Davis, Davis, CA, USA., Choi EY; Departments of Neurosurgery, Stanford University, Stanford, CA, USA., Glasser MF; Departments of Radiology and Neuroscience, Washington University School of Medicine, Saint Louis, MO, USA., Hochberg LR; School of Engineering and Carney Institute for Brain Sciences, Brown University, Providence, RI, USA.; VA RR&D Center for Neurorestoration and Neurotechnology, VA Providence Healthcare, Providence, RI.; Center for Neurotechnology and Neurorecovery, Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA., Henderson JM; Departments of Neurosurgery, Stanford University, Stanford, CA, USA.; Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA., Shahlaie K; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA., Brandman DM; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA., Stavisky SD; Departments of Neurological Surgery, University of California Davis, Davis, CA, USA. |
| المصدر: | MedRxiv : the preprint server for health sciences [medRxiv] 2024 Apr 10. Date of Electronic Publication: 2024 Apr 10. |
| نوع المنشور: | Preprint |
| اللغة: | English |
| بيانات الدورية: | Country of Publication: United States NLM ID: 101767986 Publication Model: Electronic Cited Medium: Internet NLM ISO Abbreviation: medRxiv Subsets: PubMed not MEDLINE |
| مستخلص: | Brain-computer interfaces can enable rapid, intuitive communication for people with paralysis by transforming the cortical activity associated with attempted speech into text on a computer screen. Despite recent advances, communication with brain-computer interfaces has been restricted by extensive training data requirements and inaccurate word output. A man in his 40's with ALS with tetraparesis and severe dysarthria (ALSFRS-R = 23) was enrolled into the BrainGate2 clinical trial. He underwent surgical implantation of four microelectrode arrays into his left precentral gyrus, which recorded neural activity from 256 intracortical electrodes. We report a speech neuroprosthesis that decoded his neural activity as he attempted to speak in both prompted and unstructured conversational settings. Decoded words were displayed on a screen, then vocalized using text-to-speech software designed to sound like his pre-ALS voice. On the first day of system use, following 30 minutes of attempted speech training data, the neuroprosthesis achieved 99.6% accuracy with a 50-word vocabulary. On the second day, the size of the possible output vocabulary increased to 125,000 words, and, after 1.4 additional hours of training data, the neuroprosthesis achieved 90.2% accuracy. With further training data, the neuroprosthesis sustained 97.5% accuracy beyond eight months after surgical implantation. The participant has used the neuroprosthesis to communicate in self-paced conversations for over 248 hours. In an individual with ALS and severe dysarthria, an intracortical speech neuroprosthesis reached a level of performance suitable to restore naturalistic communication after a brief training period. |
| References: | Neurorehabil Neural Repair. 2015 Jun;29(5):462-71. (PMID: 25385765) J Neural Eng. 2018 Aug;15(4):046016. (PMID: 29553484) Adv Sci (Weinh). 2023 Dec;10(35):e2304853. (PMID: 37875404) Nat Commun. 2016 Dec 13;7:13749. (PMID: 27958268) J Neural Eng. 2023 Sep 20;20(5):. (PMID: 37467739) Nat Commun. 2022 Nov 8;13(1):6510. (PMID: 36347863) Nature. 2019 Apr;568(7753):493-498. (PMID: 31019317) Adv Neural Inf Process Syst. 2023 Dec;36:42258-42270. (PMID: 38738213) J Neural Eng. 2010 Oct;7(5):056007. (PMID: 20811093) Nat Commun. 2019 Jul 30;10(1):3096. (PMID: 31363096) Am J Phys Med Rehabil. 1993 Dec;72(6):343-9. (PMID: 8260126) J Neurosci. 2022 Nov 9;42(45):8416-8426. (PMID: 36351829) Neurology. 2023 Mar 14;100(11):e1177-e1192. (PMID: 36639237) Augment Altern Commun. 2019 Mar;35(1):13-25. (PMID: 30663899) J Neural Eng. 2013 Jun;10(3):036004. (PMID: 23574741) Sci Transl Med. 2015 Nov 11;7(313):313ra179. (PMID: 26560357) Front Psychol. 2013 Jun 18;4:360. (PMID: 23785351) Science. 2021 May 21;372(6544):831-836. (PMID: 34016775) J Neural Eng. 2021 Dec 28;18(6):. (PMID: 34847547) Neurotherapeutics. 2022 Jan;19(1):263-273. (PMID: 35099768) Nature. 2023 Aug;620(7976):1031-1036. (PMID: 37612500) PLoS One. 2009 Dec 09;4(12):e8218. (PMID: 20011034) J Neural Eng. 2014 Jun;11(3):035015. (PMID: 24836588) J Neural Eng. 2024 Apr 17;21(2):. (PMID: 38579696) Prog Brain Res. 2009;177:339-51. (PMID: 19818912) J Neural Eng. 2020 Feb 05;17(1):016049. (PMID: 32023225) Front Neurosci. 2015 Jun 12;9:217. (PMID: 26124702) Nature. 2021 May;593(7858):249-254. (PMID: 33981047) J Neural Eng. 2015 Feb;12(1):016011. (PMID: 25514320) Neuroimage. 2018 Oct 15;180(Pt A):301-311. (PMID: 28993231) Elife. 2019 Dec 10;8:. (PMID: 31820736) N Engl J Med. 2021 Jul 15;385(3):217-227. (PMID: 34260835) Nature. 2023 Aug;620(7976):1037-1046. (PMID: 37612505) Nature. 2016 Aug 11;536(7615):171-178. (PMID: 27437579) Arch Phys Med Rehabil. 1992 May;73(5):403-8. (PMID: 1580764) |
| معلومات مُعتمدة: | DP2 DC021055 United States DC NIDCD NIH HHS; U01 DC017844 United States DC NIDCD NIH HHS; U01 DC019430 United States DC NIDCD NIH HHS |
| تواريخ الأحداث: | Date Created: 20240422 Latest Revision: 20240514 |
| رمز التحديث: | 20240514 |
| مُعرف محوري في PubMed: | PMC11030484 |
| DOI: | 10.1101/2023.12.26.23300110 |
| PMID: | 38645254 |
| قاعدة البيانات: | MEDLINE |
| DOI: | 10.1101/2023.12.26.23300110 |
|---|