Hummingbird: Efficient Performance Prediction for Executing Genomic Applications in the Cloud

Amir Bahmani, Ziye Xing, Vandhana Krishnan, Utsab Ray, Frank Mueller, Amir Alavi, Philip S Tsao, Michael P Snyder, Cuiping Pan, Janet Kelso
2021 Bioinformatics  
Motivation A major drawback of executing genomic applications on cloud computing facilities is the lack of tools to predict which instance type is the most appropriate, often resulting in an over- or under- matching of resources. Determining the right configuration before actually running the applications will save money and time. Here, we introduce Hummingbird, a tool for predicting performance of computing instances with varying memory and CPU on multiple cloud platforms. Results Our
more » ... ts on three major genomic data pipelines, including GATK HaplotypeCaller, GATK MuTect2, and ENCODE ATAC-seq, showed that Hummingbird was able to address applications in command line specified in JSON format or workflow description language (WDL) format, and accurately predicted the fastest, the cheapest, and the most cost-efficient compute instances in an economic manner. Availability Hummingbird is available as an open source tool at: https://github.com/StanfordBioinformatics/Hummingbird Supplementary information Supplementary data are available at Bioinformatics online.
doi:10.1093/bioinformatics/btab161 pmid:33693476 fatcat:sgcbhc3ofjdjtklkbcuqpa7t6e