Using schedflow for performance evaluation of workflow applications

Gustavo Martinez*, Elisa Heymann, Miguel Angel Senar, Emilio Luque, Barton P. Miller

*Autor correspondiente de este trabajo

Producción científica: Capítulo del libroCapítuloInvestigaciónrevisión exhaustiva

1 Cita (Scopus)

Resumen

Computational science increasingly relies on the execution of workflows in distributed networks to solve complex applications. However, the heterogeneity of resources in these environments complicates resource management and the scheduling of such applications. Sophisticated scheduling policies are being developed for workflows, but they have had little impact in practice because their integration into existing workflow engines is complex and time consuming as each policy has to be individually ported to a particular workflow engine. In addition, choosing a particular scheduling policy is difficult, as factors like machine availability, workload, and communication volume between tasks are difficult to predict. In this paper, we describe SchedFlow, a tool that integrates scheduling policies into workflow engines such as Taverna, DAGMan or Karajan. We show how SchedFlow was used to take advantage of different scheduling policies at different times, depending on the dynamic workload of the workflows. Our experiments included two real workflow applications and four different scheduling policies. We show that no single scheduling policy is the best for all scenarios, so tools like SchedFlow can improve performance by providing flexibility when scheduling workflows.

Idioma originalInglés estadounidense
Título de la publicación alojada2010 5th Workshop on Workflows in Support of Large-Scale Science, WORKS 2010
DOI
EstadoPublicada - 2010

Serie de la publicación

Nombre2010 5th Workshop on Workflows in Support of Large-Scale Science, WORKS 2010

Huella

Profundice en los temas de investigación de 'Using schedflow for performance evaluation of workflow applications'. En conjunto forman una huella única.

Citar esto