Enumerating Maximal Bicliques from a Large Graph Using MapReduce

Arko Provo Mukherjee, Srikanta Tirthapura
<span title="2017-09-01">2017</span> <i title="Institute of Electrical and Electronics Engineers (IEEE)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/zve2it4dovamndfi3ijj4n3dzi" style="color: black;">IEEE Transactions on Services Computing</a> </i> &nbsp;
We consider the enumeration of maximal bipartite cliques (bicliques) from a large graph, a task central to many data mining problems arising in social network analysis and bioinformatics. We present novel parallel algorithms for the MapReduce framework, and an experimental evaluation using Hadoop MapReduce. Our algorithm is based on clustering the input graph into smaller subgraphs, followed by processing different subgraphs in parallel. Our algorithm uses two ideas that enable it to scale to
more &raquo; ... rge graphs: (1) the redundancy in work between different subgraph explorations is minimized through a careful pruning of the search space, and (2) the load on different reducers is balanced through a task assignment that is based on an appropriate total order among the vertices. We show theoretically that our algorithm is work optimal, i.e., it performs the same total work as its sequential counterpart. We present a detailed evaluation which shows that the algorithm scales to large graphs with millions of edges and tens of millions of maximal bicliques. To our knowledge, this is the first work on maximal biclique enumeration for graphs of this scale.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/tsc.2016.2523997">doi:10.1109/tsc.2016.2523997</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/kivpaowf3faf7pi5zhvl45btdm">fatcat:kivpaowf3faf7pi5zhvl45btdm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180723062915/https://lib.dr.iastate.edu/cgi/viewcontent.cgi?referer=&amp;httpsredir=1&amp;article=1149&amp;context=ece_pubs" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/d7/da/d7da3a00147805967cfa008f917233ccab346884.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/tsc.2016.2523997"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>