Benchmarking Predictive Coding Networks -- Made Simple

التفاصيل البيبلوغرافية
العنوان: Benchmarking Predictive Coding Networks -- Made Simple
المؤلفون: Pinchetti, Luca, Qi, Chang, Lokshyn, Oleh, Olivers, Gaspard, Emde, Cornelius, Tang, Mufeng, M'Charrak, Amine, Frieder, Simon, Menzat, Bayar, Bogacz, Rafal, Lukasiewicz, Thomas, Salvatori, Tommaso
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Machine Learning, Computer Science - Computer Vision and Pattern Recognition, I.2.6
الوصف: In this work, we tackle the problems of efficiency and scalability for predictive coding networks in machine learning. To do so, we first propose a library called PCX, whose focus lies on performance and simplicity, and provides a user-friendly, deep-learning oriented interface. Second, we use PCX to implement a large set of benchmarks for the community to use for their experiments. As most works propose their own tasks and architectures, do not compare one against each other, and focus on small-scale tasks, a simple and fast open-source library adopted by the whole community would address all of these concerns. Third, we perform extensive benchmarks using multiple algorithms, setting new state-of-the-art results in multiple tasks and datasets, as well as highlighting limitations inherent to PC that should be addressed. Thanks to the efficiency of PCX, we are able to analyze larger architectures than commonly used, providing baselines to galvanize community efforts towards one of the main open problems in the field: scalability. The code for PCX is available at \textit{https://github.com/liukidar/pcax}.
Comment: 33 pages, 25 figures
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2407.01163
رقم الأكسشن: edsarx.2407.01163
قاعدة البيانات: arXiv