تقرير
Logic and the $2$-Simplicial Transformer
| العنوان: | Logic and the $2$-Simplicial Transformer |
|---|---|
| المؤلفون: | Clift, James, Doryn, Dmitry, Murfet, Daniel, Wallbridge, James |
| سنة النشر: | 2019 |
| المجموعة: | Computer Science Statistics |
| مصطلحات موضوعية: | Computer Science - Machine Learning, Computer Science - Logic in Computer Science, Statistics - Machine Learning |
| الوصف: | We introduce the $2$-simplicial Transformer, an extension of the Transformer which includes a form of higher-dimensional attention generalising the dot-product attention, and uses this attention to update entity representations with tensor products of value vectors. We show that this architecture is a useful inductive bias for logical reasoning in the context of deep reinforcement learning. |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/1909.00668 |
| رقم الأكسشن: | edsarx.1909.00668 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |