An analytical performance model of generalized hierarchical scheduling
| العنوان: | An analytical performance model of generalized hierarchical scheduling |
|---|---|
| المؤلفون: | Stephen Herbein, Tapasya Patki, Dong H Ahn, Sebastian Mobo, Clark Hathaway, Silvina Caíno-Lores, James Corbett, David Domyancic, Thomas RW Scogland, Bronis R de Supinski, Michela Taufer |
| المصدر: | The International Journal of High Performance Computing Applications. 36:289-306 |
| بيانات النشر: | SAGE Publications, 2022. |
| سنة النشر: | 2022 |
| مصطلحات موضوعية: | Hardware and Architecture, Software, Theoretical Computer Science |
| الوصف: | High performance computing (HPC) workflows are undergoing tumultuous changes, including an explosion in size and complexity. Despite these changes, most batch job systems still use slow, centralized schedulers. Generalized hierarchical scheduling (GHS) solves many of the challenges that face modern workflows, but GHS has not been widely adopted in HPC. A major difficulty that hinders adoption is the lack of a performance model to aid in configuring GHS for optimal performance on a given application. We propose an analytical performance model of GHS, and we validate our proposed model with four different applications on a moderately-sized system. Our validation shows that our model is extremely accurate at predicting the performance of GHS, explaining 98.7% of the variance (i.e., an R2 statistic of 0.987). Our results also support the claim that GHS overcomes scheduling throughput problems; we measured throughput improvements of up to 270× on our moderately-sized system. We then apply our performance model to a pre-exascale system, where our model predicts throughput improvements of four orders of magnitude and provides insight into optimally configuring GHS on next generation systems. |
| تدمد: | 1741-2846 1094-3420 |
| URL الوصول: | https://explore.openaire.eu/search/publication?articleId=doi_________::0cc0f8b07f5bc1673293fd923c73d7fb https://doi.org/10.1177/10943420211051039 |
| حقوق: | CLOSED |
| رقم الأكسشن: | edsair.doi...........0cc0f8b07f5bc1673293fd923c73d7fb |
| قاعدة البيانات: | OpenAIRE |
| تدمد: | 17412846 10943420 |
|---|