KAGNNs: Kolmogorov-Arnold Networks meet Graph Learning

التفاصيل البيبلوغرافية
العنوان: KAGNNs: Kolmogorov-Arnold Networks meet Graph Learning
المؤلفون: Bresson, Roman, Nikolentzos, Giannis, Panagopoulos, George, Chatzianastasis, Michail, Pang, Jun, Vazirgiannis, Michalis
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Machine Learning
الوصف: In recent years, Graph Neural Networks (GNNs) have become the de facto tool for learning node and graph representations. Most GNNs typically consist of a sequence of neighborhood aggregation (a.k.a., message passing) layers. Within each of these layers, the representation of each node is updated from an aggregation and transformation of its neighbours representations at the previous layer. The upper bound for the expressive power of message passing GNNs was reached through the use of MLPs as a transformation, due to their universal approximation capabilities. However, MLPs suffer from well-known limitations, which recently motivated the introduction of Kolmogorov-Arnold Networks (KANs). KANs rely on the Kolmogorov-Arnold representation theorem, rendering them a promising alternative to MLPs. In this work, we compare the performance of KANs against that of MLPs in graph learning tasks. We perform extensive experiments on node classification, graph classification and graph regression datasets. Our preliminary results indicate that while KANs are on-par with MLPs in classification tasks, they seem to have a clear advantage in the graph regression tasks. Code is available at https: //github.com/RomanBresson/KAGNN.
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2406.18380
رقم الأكسشن: edsarx.2406.18380
قاعدة البيانات: arXiv