دورية أكاديمية
Deep Neural Networks Classification via Binary Error-Detecting Output Codes
| العنوان: | Deep Neural Networks Classification via Binary Error-Detecting Output Codes |
|---|---|
| المؤلفون: | Martin Klimo, Peter Lukáč, Peter Tarábek |
| المصدر: | Applied Sciences, Vol 11, Iss 8, p 3563 (2021) |
| بيانات النشر: | MDPI AG, 2021. |
| سنة النشر: | 2021 |
| المجموعة: | LCC:Technology LCC:Engineering (General). Civil engineering (General) LCC:Biology (General) LCC:Physics LCC:Chemistry |
| مصطلحات موضوعية: | deep neural network, binary coding, error-detecting output code, multi-class classification, Zadeh fuzzy logic, one-hot encoding, Technology, Engineering (General). Civil engineering (General), TA1-2040, Biology (General), QH301-705.5, Physics, QC1-999, Chemistry, QD1-999 |
| الوصف: | One-hot encoding is the prevalent method used in neural networks to represent multi-class categorical data. Its success stems from its ease of use and interpretability as a probability distribution when accompanied by a softmax activation function. However, one-hot encoding leads to very high dimensional vector representations when the categorical data’s cardinality is high. The Hamming distance in one-hot encoding is equal to two from the coding theory perspective, which does not allow detection or error-correcting capabilities. Binary coding provides more possibilities for encoding categorical data into the output codes, which mitigates the limitations of the one-hot encoding mentioned above. We propose a novel method based on Zadeh fuzzy logic to train binary output codes holistically. We study linear block codes for their possibility of separating class information from the checksum part of the codeword, showing their ability not only to detect recognition errors by calculating non-zero syndrome, but also to evaluate the truth-value of the decision. Experimental results show that the proposed approach achieves similar results as one-hot encoding with a softmax function in terms of accuracy, reliability, and out-of-distribution performance. It suggests a good foundation for future applications, mainly classification tasks with a high number of classes. |
| نوع الوثيقة: | article |
| وصف الملف: | electronic resource |
| اللغة: | English |
| تدمد: | 2076-3417 |
| Relation: | https://www.mdpi.com/2076-3417/11/8/3563; https://doaj.org/toc/2076-3417 |
| DOI: | 10.3390/app11083563 |
| URL الوصول: | https://doaj.org/article/3138d7a0e4f246df819df0ca221dce7e |
| رقم الأكسشن: | edsdoj.3138d7a0e4f246df819df0ca221dce7e |
| قاعدة البيانات: | Directory of Open Access Journals |
Full Text Finder كن أول من يترك تعليقا!