Load balancing in homogeneous pipeline based applications

A. Moreno, E. Cesar, A. Guevara, J. Sorribes, T. Margalef

Research output: Contribution to journalArticleResearchpeer-review

14 Citations (Scopus)

Abstract

We propose to use knowledge about a parallel application's structure that was acquired with the use of a skeleton based development strategy to dynamically improve its performance. Parallel/distributed programming provides the possibility of solving highly demanding computational problems. However, this type of application requires support tools in all phases of the development cycle because the implementation is extremely difficult, especially for non-expert programmers. This work shows a new strategy for dynamically improving the performance of pipeline applications. We call this approach Dynamic Pipeline Mapping (DPM), and the key idea is to have free computational resources by gathering the pipeline's fastest stages and then using these resources to replicate the slowest stages. We present two versions of this strategy, both with complexity O(N log (N)) on the number of pipe stages, and we compare them to an optimal mapping algorithm and to the Binary Search Closest (BSC) algorithm [1]. Our results show that the DPM leads to significant performance improvements, increasing the application throughput up to 40% on average. © 2011 Elsevier B.V. All rights reserved.
Original languageEnglish
Pages (from-to)125-139
JournalParallel Computing
Volume38
DOIs
Publication statusPublished - 1 Mar 2012

Keywords

  • Load balancing
  • Performance
  • Pipeline

Fingerprint

Dive into the research topics of 'Load balancing in homogeneous pipeline based applications'. Together they form a unique fingerprint.

Cite this