تقرير
Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation
العنوان: | Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation |
---|---|
المؤلفون: | Ortega, Tomas, Jafarkhani, Hamid |
سنة النشر: | 2023 |
المجموعة: | Computer Science Mathematics |
مصطلحات موضوعية: | Computer Science - Machine Learning, Electrical Engineering and Systems Science - Signal Processing, Mathematics - Optimization and Control, 68W10, 68W15, 68W40, 90C06, 90C35, 90C26, G.1.6, F.2.1, E.4 |
الوصف: | Asynchronous Federated Learning with Buffered Aggregation (FedBuff) is a state-of-the-art algorithm known for its efficiency and high scalability. However, it has a high communication cost, which has not been examined with quantized communications. To tackle this problem, we present a new algorithm (QAFeL), with a quantization scheme that establishes a shared "hidden" state between the server and clients to avoid the error propagation caused by direct quantization. This approach allows for high precision while significantly reducing the data transmitted during client-server interactions. We provide theoretical convergence guarantees for QAFeL and corroborate our analysis with experiments on a standard benchmark. Comment: Accepted at the 2023 ICML Workshop of Federated Learning and Analytics in Practice |
نوع الوثيقة: | Working Paper |
URL الوصول: | http://arxiv.org/abs/2308.00263 |
رقم الأكسشن: | edsarx.2308.00263 |
قاعدة البيانات: | arXiv |
الوصف غير متاح. |