pioman: A Pthread-Based Multithreaded Communication Engine

Alexandre Denis
<span title="">2015</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/f3hr4iv3tvhrldoukhnurnloh4" style="color: black;">2015 23rd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing</a> </i> &nbsp;
Recent cluster architectures include dozens of cores per node, with all cores sharing the network resources. To program such architectures, hybrid models mixing MPI+threads, and in particular MPI+OpenMP are gaining popularity. This imposes new requirements on communication libraries, such as the need for MPI_THREAD_MULTIPLE level of multi-threading support. Moreover, the high number of cores brings new opportunities to parallelize communication libraries, so as to have proper background
more &raquo; ... ion of communication and communication/computation overlap. In this paper, we present pioman, a generic framework to be used by MPI implementations, that brings seamless asynchronous progression of communication by opportunistically using available cores. It uses system threads and thus is composable with any runtime system used for multithreading. Through various benchmarks, we demonstrate that our pioman-based MPI implementation exhibits very good properties regarding overlap, progression, and multithreading, and outperforms state-of-art MPI implementations.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/pdp.2015.78">doi:10.1109/pdp.2015.78</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/pdp/Denis15.html">dblp:conf/pdp/Denis15</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/7snp4rhezzc6fb4yz5rtsa47py">fatcat:7snp4rhezzc6fb4yz5rtsa47py</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200309041640/https://hal.inria.fr/hal-01087775/document" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/db/b7/dbb7bb33aa16f391af0a4d51550355f08d9a48bf.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/pdp.2015.78"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>