Publications
End-to-end Integration of Scientific Workflows on Distributed Cyberinfrastructures: Challenges and Lessons Learned with an Earth Science Application
Abstract
Distributed cyberinfrastructures (CI) pose opportunities and challenges for the execution of scientific workflows, especially in the context of Earth science applications. They provide heterogeneous resources that can meet the needs of the applications that are part of the scientific workflows and provide the necessary performance and scalability to achieve scientific goals. However, the challenge with distributed CI is that it is difficult to find the right resources for the applications and to orchestrate the workflow execution from resource provisioning to job execution to delivering the final results. In some cases, poor choice of resources may result in slow execution or outright failure. In this paper, we present Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support (ACCESS) Pegasus, a CI solution built as part of the U.S. National Science Foundation ACCESS program that provides automated execution …
Metadata
- publication
- Proceedings of the IEEE/ACM 16th International Conference on Utility and …, 2023
- year
- 2023
- publication date
- 2023/12/4
- authors
- Camila Roa, Mats Rynge, Paula Olaya, Karan Vahi, Todd Miller, James Griffioen, Shelley Knuth, John Goodhue, David Hudak, Alana Romanella, Ricardo Llamas, Rodrigo Vargas, Miron Livny, Ewa Deelman, Michela Taufer
- link
- https://dl.acm.org/doi/abs/10.1145/3603166.3632142
- resource_link
- https://par.nsf.gov/servlets/purl/10509922
- book
- Proceedings of the IEEE/ACM 16th International Conference on Utility and Cloud Computing
- pages
- 1-9