A cost/benefit estimating service for mapping parallel applications on heterogeneous clusters

Dimitrios Katramatos, Steve J. Chapin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Matching the resource requirements of a parallel application to the available resources of a large, heterogeneous cluster is a key requirement in effectively scheduling the application tasks on the nodes of the cluster. This paper describes the Cost/Benefit Estimating Service (CBES), a runtime scheduling system targeted at finding highly effective schedules (or mappings) of tasks on nodes. CBES relies on its own infrastructure to gather and maintain static and dynamic information profiles for the computing system and the applications of interest. At the core of CBES is a mapping evaluation module which evaluates candidate application mappings on the basis of shortest execution times. By default, CBES uses a simulated-annealing based scheduler to select mappings. The paper presents the design, initial implementation, and test results of CBES on the Centurion cluster at the University of Virginia and the Orange Grove cluster at Syracuse University. These tests demonstrated that the exploitation of internode communication speed differences due to network heterogeneity can yield speedups of over 10% between same architecture nodes. The, maximum observed speedup across architectures for the best vs. worst mapping scenarios of the same application was over 36%, while the corresponding average case speedup was approximately 30%.

Original languageEnglish (US)
Title of host publication2005 IEEE International Conference on Cluster Computing, CLUSTER
DOIs
StatePublished - Dec 1 2005
Event2005 IEEE International Conference on Cluster Computing, CLUSTER - Burlington, MA, United States
Duration: Sep 27 2005Sep 30 2005

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
ISSN (Print)1552-5244

Other

Other2005 IEEE International Conference on Cluster Computing, CLUSTER
CountryUnited States
CityBurlington, MA
Period9/27/059/30/05

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'A cost/benefit estimating service for mapping parallel applications on heterogeneous clusters'. Together they form a unique fingerprint.

  • Cite this

    Katramatos, D., & Chapin, S. J. (2005). A cost/benefit estimating service for mapping parallel applications on heterogeneous clusters. In 2005 IEEE International Conference on Cluster Computing, CLUSTER [4154105] (Proceedings - IEEE International Conference on Cluster Computing, ICCC). https://doi.org/10.1109/CLUSTR.2005.347062