An MPI-Based Python Framework for Distributed Training with Keras

التفاصيل البيبلوغرافية
العنوان: An MPI-Based Python Framework for Distributed Training with Keras
المؤلفون: Anderson, Dustin, Vlimant, Jean-Roch, Spiropulu, Maria
سنة النشر: 2017
المجموعة: Computer Science
Statistics
مصطلحات موضوعية: Computer Science - Distributed, Parallel, and Cluster Computing, Statistics - Machine Learning
الوصف: We present a lightweight Python framework for distributed training of neural networks on multiple GPUs or CPUs. The framework is built on the popular Keras machine learning library. The Message Passing Interface (MPI) protocol is used to coordinate the training process, and the system is well suited for job submission at supercomputing sites. We detail the software's features, describe its use, and demonstrate its performance on systems of varying sizes on a benchmark problem drawn from high-energy physics research.
Comment: 4 pages, 4 figures, 1 table, DS@HEP, SC17
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/1712.05878
رقم الأكسشن: edsarx.1712.05878
قاعدة البيانات: arXiv