Fast-Convergent Federated Learning via Cyclic Aggregation

التفاصيل البيبلوغرافية
العنوان: Fast-Convergent Federated Learning via Cyclic Aggregation
المؤلفون: Lee, Youngjoon, Park, Sangwoo, Kang, Joonhyuk
سنة النشر: 2022
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Machine Learning, Electrical Engineering and Systems Science - Signal Processing, 68T05
الوصف: Federated learning (FL) aims at optimizing a shared global model over multiple edge devices without transmitting (private) data to the central server. While it is theoretically well-known that FL yields an optimal model -- centrally trained model assuming availability of all the edge device data at the central server -- under mild condition, in practice, it often requires massive amount of iterations until convergence, especially under presence of statistical/computational heterogeneity. This paper utilizes cyclic learning rate at the server side to reduce the number of training iterations with increased performance without any additional computational costs for both the server and the edge devices. Numerical results validate that, simply plugging-in the proposed cyclic aggregation to the existing FL algorithms effectively reduces the number of training iterations with improved performance.
Comment: 5 pages
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2210.16520
رقم الأكسشن: edsarx.2210.16520
قاعدة البيانات: arXiv