Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation

التفاصيل البيبلوغرافية
العنوان: Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation
المؤلفون: Ortega, Tomas, Jafarkhani, Hamid
سنة النشر: 2023
المجموعة: Computer Science
Mathematics
مصطلحات موضوعية: Computer Science - Machine Learning, Electrical Engineering and Systems Science - Signal Processing, Mathematics - Optimization and Control, 68W10, 68W15, 68W40, 90C06, 90C35, 90C26, G.1.6, F.2.1, E.4
الوصف: Asynchronous Federated Learning with Buffered Aggregation (FedBuff) is a state-of-the-art algorithm known for its efficiency and high scalability. However, it has a high communication cost, which has not been examined with quantized communications. To tackle this problem, we present a new algorithm (QAFeL), with a quantization scheme that establishes a shared "hidden" state between the server and clients to avoid the error propagation caused by direct quantization. This approach allows for high precision while significantly reducing the data transmitted during client-server interactions. We provide theoretical convergence guarantees for QAFeL and corroborate our analysis with experiments on a standard benchmark.
Comment: Accepted at the 2023 ICML Workshop of Federated Learning and Analytics in Practice
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2308.00263
رقم الأكسشن: edsarx.2308.00263
قاعدة البيانات: arXiv