TDP-Shell: A generic framework to improve interoperability between batch queue systems and monitoring tools

Vicente J. Ivars, Miquel A. Senar, Elisa Heymann

Research output: Chapter in BookChapterResearchpeer-review

Abstract

Nowadays distributed applications, including MPI implementations, are executed on computer clusters managed by a batch queue system. Users take advantage of monitoring tools to detect run-time problems on their applications running on those environments. But it is a challenge to use monitoring tools on a cluster controlled by a batch queue system. This is due to the fact that batch queue systems and monitoring tools do not coordinate the management of the resources they share, when executing a distributed application. We name this problem lack of interoperability and to solve it we have developed a framework called TDP-Shell. This framework supports different batch queue systems such as Condor and SGE, and different monitoring tools such as Paradyn, Gdb and Total view, without any changes on their source code. In this paper we describe how our basic design of TDP-Shell for sequential applications was re-designed to support the monitoring of MPI applications that are executed on a cluster controlled by a batch queue system.

Original languageAmerican English
Title of host publicationProceedings - 2011 IEEE International Conference on Cluster Computing, CLUSTER 2011
Pages522-526
Number of pages5
DOIs
Publication statusPublished - 16 Nov 2011

Publication series

NameProceedings - IEEE International Conference on Cluster Computing, ICCC
ISSN (Print)1552-5244

Keywords

  • batch queue systems
  • interoperability
  • monitoring tools

Fingerprint Dive into the research topics of 'TDP-Shell: A generic framework to improve interoperability between batch queue systems and monitoring tools'. Together they form a unique fingerprint.

  • Cite this

    Ivars, V. J., Senar, M. A., & Heymann, E. (2011). TDP-Shell: A generic framework to improve interoperability between batch queue systems and monitoring tools. In Proceedings - 2011 IEEE International Conference on Cluster Computing, CLUSTER 2011 (pp. 522-526). [6061200] (Proceedings - IEEE International Conference on Cluster Computing, ICCC). https://doi.org/10.1109/CLUSTER.2011.73