Designing a benchmark for the performance evaluation of agent-based simulation applications on HPC

Andreu Moreno, Juan J. Rodríguez, Daniel Beltrán, Anna Sikora, Josep Jorba, Eduardo César

Research output: Contribution to journalArticleResearchpeer-review

2 Citations (Scopus)


Agent-based modeling and simulation (ABMS) is a class of computational models for simulating the actions and interactions of autonomous agents with the goal of assessing their effects on a system as a whole. Several frameworks for generating parallel ABMS applications have been developed taking advantage of their common characteristics, but there is a lack of a general benchmark for comparing the performance of the generated applications. We propose and design a benchmark that takes into consideration the most common characteristics of this type of applications and includes parameters for influencing their relevant performance aspects. We provide an initial implementation of the benchmark for FLAME, FLAME GPU, Repast HPC and EcoLab, some of the most popular parallel ABMS platforms, and use it for comparing the applications generated by these platforms. The obtained results are mostly in agreement with previous studies, but the designed and implemented specification has allowed for testing a wider set of aspects, such as the number of interacting agents, the amount of interchanged data or the evolution of the workload and obtaining more reliable results.
Original languageEnglish
Pages (from-to)1524-1550
Number of pages27
JournalJournal of Supercomputing
Issue number3
Publication statusPublished - 17 Mar 2019


  • Agent-based modeling and simulation
  • Benchmark
  • Parallel applications
  • Performance


Dive into the research topics of 'Designing a benchmark for the performance evaluation of agent-based simulation applications on HPC'. Together they form a unique fingerprint.

Cite this