دورية أكاديمية

Multi-person feature fusion transfer learning-based convolutional neural network for SSVEP-based collaborative BCI

التفاصيل البيبلوغرافية
العنوان: Multi-person feature fusion transfer learning-based convolutional neural network for SSVEP-based collaborative BCI
المؤلفون: Penghai Li, Jianxian Su, Abdelkader Nasreddine Belkacem, Longlong Cheng, Chao Chen
المصدر: Frontiers in Neuroscience, Vol 16 (2022)
بيانات النشر: Frontiers Media S.A., 2022.
سنة النشر: 2022
المجموعة: LCC:Neurosciences. Biological psychiatry. Neuropsychiatry
مصطلحات موضوعية: steady-state visually evoked potential, collaborative BCI, feature fusion, convolutional neural network, transfer learning, Neurosciences. Biological psychiatry. Neuropsychiatry, RC321-571
الوصف: ObjectiveThe conventional single-person brain–computer interface (BCI) systems have some intrinsic deficiencies such as low signal-to-noise ratio, distinct individual differences, and volatile experimental effect. To solve these problems, a centralized steady-state visually evoked potential collaborative BCI system (SSVEP-cBCI), which characterizes multi-person electroencephalography (EEG) feature fusion was constructed in this paper. Furthermore, three different feature fusion methods compatible with this new system were developed and applied to EEG classification, and a comparative analysis of their classification accuracy was performed with transfer learning-based convolutional neural network (TL-CNN) approach.ApproachAn EEG-based SSVEP-cBCI system was set up to merge different individuals’ EEG features stimulated by the instructions for the same task, and three feature fusion methods were adopted, namely parallel connection, serial connection, and multi-person averaging. The fused features were then input into CNN for classification. Additionally, transfer learning (TL) was applied first to a Tsinghua University (THU) benchmark dataset, and then to a collected dataset, so as to meet the CNN training requirement with a much smaller size of collected dataset and increase the classification accuracy. Ten subjects were recruited for data collection, and both datasets were used to gauge the three fusion algorithms’ performance.Main resultsThe results predicted by TL-CNN approach in single-person mode and in multi-person mode with the three feature fusion methods were compared. The experimental results show that each multi-person mode is superior to single-person mode. Within the 3 s time window, the classification accuracy of the single-person CNN is only 90.6%, while the same measure of the two-person parallel connection fusion method can reach 96.6%, achieving better classification effect.SignificanceThe results show that the three multi-person feature fusion methods and the deep learning classification algorithm based on TL-CNN can effectively improve the SSVEP-cBCI classification performance. The feature fusion method of multi -person parallel feature connection achieves better classification results. Different feature fusion methods can be selected in different application scenarios to further optimize cBCI.
نوع الوثيقة: article
وصف الملف: electronic resource
اللغة: English
تدمد: 1662-453X
Relation: https://www.frontiersin.org/articles/10.3389/fnins.2022.971039/full; https://doaj.org/toc/1662-453X
DOI: 10.3389/fnins.2022.971039
URL الوصول: https://doaj.org/article/40a4b70d2b674bec933d10c21a73bd5d
رقم الأكسشن: edsdoj.40a4b70d2b674bec933d10c21a73bd5d
قاعدة البيانات: Directory of Open Access Journals
الوصف
تدمد:1662453X
DOI:10.3389/fnins.2022.971039