Bandwidth Characterization of DeepSpeed on Distributed Large Language Model Training

التفاصيل البيبلوغرافية
العنوان: Bandwidth Characterization of DeepSpeed on Distributed Large Language Model Training
المؤلفون: Hanindhito, Bagus, Patel, Bhavesh, John, Lizy K.
المصدر: 2024 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) ISPASS Performance Analysis of Systems and Software (ISPASS), 2024 IEEE International Symposium on. :241-256 May, 2024
Relation: 2024 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)
قاعدة البيانات: IEEE Xplore Digital Library
الوصف
ردمك:9798350376388
تدمد:27660486
DOI:10.1109/ISPASS61541.2024.00031