Analysis of parallel application checkpoint storage for system configuration

Betzabeth León*, Daniel Franco, Dolores Rexachs, Emilio Luque

*Corresponding author for this work

Research output: Contribution to journalArticleResearchpeer-review

Abstract

The use of fault tolerance strategies such as checkpoints is essential to maintain the availability of systems and their applications in high-performance computing environments. However, checkpoint storage can impact the performance and scalability of parallel applications that use message passing. In the present work, a study is carried out on the elements that can impact the storage of the checkpoint and how these can influence the scalability of an application with fault tolerance. A methodology has been designed based on predicting the size of the checkpoint when the number of processes, the application workload or the mapping varies, using a reduced number of resources. By following this methodology, the system administrator will be able to make decisions about what should be done with the number of processes used and the number of appropriate nodes, adjusting the process mapping in applications that use checkpoints.

Original languageEnglish
Pages (from-to)4582-4617
Number of pages36
JournalJournal of Supercomputing
Volume77
Issue number5
DOIs
Publication statusPublished - May 2021

Keywords

  • Checkpoint
  • Fault tolerance
  • HPC systems
  • MPI application
  • Scalability

Fingerprint

Dive into the research topics of 'Analysis of parallel application checkpoint storage for system configuration'. Together they form a unique fingerprint.

Cite this