Publications

A lightweight method for evaluating in situ workflow efficiency

Abstract

Performance evaluation is crucial to understanding the behavior of scientific workflows. In this study, we target an emerging type of workflow, called in situ workflows. These workflows tightly couple components such as simulation and analysis to improve overall workflow performance. To understand the tradeoffs of various configurable parameters for coupling these heterogeneous tasks, namely simulation stride, and component placement, separately monitoring each component is insufficient to gain insights into the entire workflow behavior. Through an analysis of the state-of-the-art research, we propose a lightweight metric, derived from a defined in situ step, for assessing resource usage efficiency of an in situ workflow execution. By applying this metric to a synthetic workflow, which is parameterized to emulate behaviors of a molecular dynamics simulation, we explore two possible scenarios (Idle Simulation and …

Date
2021
Authors
Tu Mai Anh Do, Loïc Pottier, Silvina Caíno-Lores, Rafael Ferreira da Silva, Michel A Cuendet, Harel Weinstein, Trilce Estrada, Michela Taufer, Ewa Deelman
Journal
Journal of Computational Science
Volume
48
Pages
101259
Publisher
Elsevier