Parallelization of the Trinity Pipeline for De Novo Transcriptome Assembly

V. Sachdeva, C.S. Kim, K.E. Jordan, M.D. Winn
2014 2014 IEEE International Parallel & Distributed Processing Symposium Workshops  
This paper details a distributed-memory implementation of Chrysalis, part of the popular Trinity workflow used for de novo transcriptome assembly. We have implemented changes to Chrysalis, which was previously multi-threaded for sharedmemory architectures, to change it to a hybrid implementation which uses both MPI and OpenMP. With the new hybrid implementation, we report speedups of about a factor of twenty for both GraphFromFasta and ReadsToTranscripts on an iDataPlex cluster for a sugarbeet
more » ... ataset containing around 130 million reads. Along with the hybrid implementation, we also use PyFasta to speed up Bowtie execution by a factor of three which is also part of the Trinity workflow. Overall, we reduce the runtime of the Chrysalis step of the Trinity workflow from over 50 hours to less than 5 hours for the sugarbeet dataset. By enabling the use of multi-node clusters, this implementation is a significant step towards making de novo transcriptome assembly feasible for ever bigger transcriptome datasets.
doi:10.1109/ipdpsw.2014.67 dblp:conf/ipps/SachdevaKJW14 fatcat:zntr64pnk5d73pxx7kxdhf4ojq