Publications

End-to-end Integration of Scientific Workflows on Distributed Cyberinfrastructures: Challenges and Lessons Learned with an Earth Science Application

Abstract

Distributed cyberinfrastructures (CI) pose opportunities and challenges for the execution of scientific workflows, especially in the context of Earth science applications. They provide heterogeneous resources that can meet the needs of the applications that are part of the scientific workflows and provide the necessary performance and scalability to achieve scientific goals. However, the challenge with distributed CI is that it is difficult to find the right resources for the applications and to orchestrate the workflow execution from resource provisioning to job execution to delivering the final results. In some cases, poor choice of resources may result in slow execution or outright failure. In this paper, we present Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support (ACCESS) Pegasus, a CI solution built as part of the U.S. National Science Foundation ACCESS program that provides automated execution …

Metadata

publication
Proceedings of the IEEE/ACM 16th International Conference on Utility and …, 2023
year
2023
publication date
2023/12/4
authors
Camila Roa, Mats Rynge, Paula Olaya, Karan Vahi, Todd Miller, James Griffioen, Shelley Knuth, John Goodhue, David Hudak, Alana Romanella, Ricardo Llamas, Rodrigo Vargas, Miron Livny, Ewa Deelman, Michela Taufer
link
https://dl.acm.org/doi/abs/10.1145/3603166.3632142
resource_link
https://par.nsf.gov/servlets/purl/10509922
book
Proceedings of the IEEE/ACM 16th International Conference on Utility and Cloud Computing
pages
1-9