An Overview of the Apache Airavata Software Stack for Science Gateways

Marlon Pierce, Eroma Abeysinghe, Marcus Christie, Eric Coulter, Suresh Marru, Sudhakar Pamidighantam, Rob Quick, Isuru Ranawaka, Jun Wang, Dimuthu Wannipurage
2021 Zenodo  
Tutorial length: 90 minutes Skill level: Any Technology requirements: None Since its inception in the Apache Software Foundation in 2011, Apache Airavata has evolved from a middleware system for supporting science gateway workflow executions to a comprehensive set of semi-autonomous subsystems that can be used to provide solutions for a wide range of science gateways. This tutorial provides a series of lightning overviews of each of these major subsystems and illustrates their usage in
more » ... science gateways. The Virtual Cluster System provides a mechanism for creating dynamic virtual clusters on OpenStack-based clouds. These virtual clusters can be used to execute both containerized serial and parallel scientific applications, providing users and gateways with their own private clusters. They can also be deployed with the JupyterHub interface, providing on-demand access to JupyterLab servers. Apache Airavata's metadata and workflow scheduling infrastructure (the original core of Apache Airavata) builds on Apache Helix and Airavata's own metadata management system to manage the full lifecycle for job executions, capturing the metadata needed to audit and reproduce execution outcomes. The Airavata Django Portal provides an out-of-the-box end user environment for all of the Apache Airavata middleware subsystems. Through the use of the Wagtail Content Management System and the Django Apps extension mechanism, the Airavata Django Portal can be extensively customized to create unique user interfaces that meet the usability requirements of different research communities. Airavata Custos encompasses Apache Airavata's security services for managing user accounts; federated authentication; role, group, and attribute-based authorization; sharing and permissions; and resource credential (secrets) management. Custos services can be used independently of other Airavata services and can be integrated into other science gateway platforms such as Galaxy through the Custos [...]
doi:10.5281/zenodo.5569497 fatcat:n3znwekuvjhy3npifzmnb4pwdi