Filters








297 Hits in 5.1 sec

Quincy

Michael Isard, Vijayan Prabhakaran, Jon Currey, Udi Wieder, Kunal Talwar, Andrew Goldberg
<span title="">2009</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/jj2vupi7offrtmqekd7qqfaxdm" style="color: black;">Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles - SOSP &#39;09</a> </i> &nbsp;
We evaluate Quincy against an existing queue-based algorithm and implement several policies for each scheduler, with and without fairness constraints.  ...  We introduce a powerful and flexible new framework for scheduling concurrent distributed jobs with fine-grain resource sharing.  ...  Scheduling in a distributed computing cluster. Bent et al.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/1629575.1629601">doi:10.1145/1629575.1629601</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/sosp/IsardPCWTG09.html">dblp:conf/sosp/IsardPCWTG09</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/7vvybnkx5vdvbfkqb2zmfv6mya">fatcat:7vvybnkx5vdvbfkqb2zmfv6mya</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20110904213854/http://www.sigops.org:80/sosp/sosp09/papers/isard-sosp09.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/f7/69/f769042361e904617ce65407d0616b52bdc7c989.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/1629575.1629601"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

Quincy: Fair Scheduling for Distributed Computing Clusters

Diksha Verma, Anjli Tyagi, Deepak Sharma
<span class="release-stage">unpublished</span>
We evaluate Quincy against an existing queue-based algorithm and implement several policies for each scheduler, with and without fairness constraints.  ...  We introduce a powerful and flexible new framework for scheduling concurrent distributed jobs with fine-grain resource sharing.  ...  Scheduling in a distributed computing cluster. Bent et al.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/dztxwr5t45g53bojcit6esqqpq">fatcat:dztxwr5t45g53bojcit6esqqpq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20180413114019/http://www.ijirt.org/master/publishedpaper/IJIRT101227_PAPER.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/7b/ec/7becbe4aba40000ab89720defd0cd83086896a82.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a>

A secure operating system for data centers: A survey

Ejaz et al., Computer Science Department, University of Engineering and Technology, Taxila, Pakistan
<span title="">2020</span> <i title="International Journal of Advanced and Applied Sciences"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/yppskh3jfbc37jyfabcggfgibi" style="color: black;">International Journal of Advanced and Applied Sciences</a> </i> &nbsp;
Existing distributed operating systems are not scalable to handle thousands of machines in clouds. As a result, current cloud computing environments are more complex at the user side.  ...  To deliver the user with efficient computational power, with the support of data sharing, resource sharing and abstraction, an operating system-like software stack is needed for cloud computing hardware  ...  Quincy To handle the challenge of scheduling along with both fairness and locality constrictions, a new influential and reliable structure for scheduling of concurrent distributed jobs with fine-grained  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.21833/ijaas.2020.08.007">doi:10.21833/ijaas.2020.08.007</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/znvuohkkjzdn3c5txhit4s6yh4">fatcat:znvuohkkjzdn3c5txhit4s6yh4</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200602161105/http://science-gate.com/IJAAS/Articles/2020/2020-7-8/1021833ijaas202008007.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/7c/f6/7cf65861616167999a8271ab821dcfdee8517f01.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.21833/ijaas.2020.08.007"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> Publisher / doi.org </button> </a>

Towards Synthesizing Realistic Workload Traces for Studying the Hadoop Ecosystem

Guanying Wang, Ali R. Butt, Henry Monti, Karan Gupta
<span title="">2011</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/z2ot7tezyrgpxlxgssko2bzyw4" style="color: black;">2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems</a> </i> &nbsp;
Designing cloud computing setups is a challenging task.  ...  The design space, and the scale of the clusters, make it cumbersome and error-prone to test different cluster configurations using real setups.  ...  Figure 8 . 8 Job utilization under Fair Share and Quincy schedulers.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/mascots.2011.59">doi:10.1109/mascots.2011.59</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/mascots/WangBMG11.html">dblp:conf/mascots/WangBMG11</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/xuix6qcl2zgufl34qaweoxgcqi">fatcat:xuix6qcl2zgufl34qaweoxgcqi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170808014407/http://people.cs.vt.edu/~butta/docs/mascots11-hadooptrace.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/4d/64/4d64eee09c2710b91d87c335f31ec5c9565e17cd.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/mascots.2011.59"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

Predictable time-sharing for DryadLINQ cluster

Sang-Min Park, Marty Humphrey
<span title="">2010</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/5q3ptcrafzaofoy6lit2qdvbr4" style="color: black;">Proceeding of the 7th international conference on Autonomic computing - ICAC &#39;10</a> </i> &nbsp;
Instead, as described in this paper, we define a reactive containment and control mechanism for scheduling and executing distributed tasks, schedule the jobs, and then continually monitor and adjust resources  ...  Designing a cluster system in a multi-user environment is challenging because cluster schedulers must satisfy multiple, possibly conflicting, enterprise goals and policies.  ...  ACKNOWLEDGEMENT We would like to thank the anonymous reviewers and the paper shepherd, Renato Figueiredo, for their valuable feedbacks.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/1809049.1809082">doi:10.1145/1809049.1809082</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/icac/ParkH10.html">dblp:conf/icac/ParkH10</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/pgos2lm5bzat3prj7ahc3ix75m">fatcat:pgos2lm5bzat3prj7ahc3ix75m</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20100707124935/http://www.cs.virginia.edu/~sp2kn/paper/Dryadlinq.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/6d/fc/6dfca15886d87ff4279a18f1df64508800d8ea76.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/1809049.1809082"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

On Cloud computational models and the heterogeneity challenge

Raouf Boutaba, Lu Cheng, Qi Zhang
<span title="2011-12-09">2011</span> <i title="Springer Nature"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/bb6biifh2vgodnm4pohs33dggi" style="color: black;">Journal of Internet Services and Applications</a> </i> &nbsp;
Cloud computing is by far the most cost-effective technology for hosting Internet-scale services and applications.  ...  Despite its success, the implications of MapReduce on the management of Cloud workload and cluster resources are still largely unstudied.  ...  Apache Hadoop Apache Hadoop [4] is a framework that allows for the distributed processing of large data sets across clusters of computers.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/s13174-011-0054-7">doi:10.1007/s13174-011-0054-7</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/bskclzv3ajebdjg3swh2w7pema">fatcat:bskclzv3ajebdjg3swh2w7pema</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20171011142518/http://publisher-connector.core.ac.uk/resourcesync/data/Springer-OA/pdf/3e6/aHR0cDovL2xpbmsuc3ByaW5nZXIuY29tLzEwLjEwMDcvczEzMTc0LTAxMS0wMDU0LTcucGRm.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/5c/9a/5c9a37ca231dbd1ac1607f639bffdb462eeddbc2.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1007/s13174-011-0054-7"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> springer.com </button> </a>

A survey of scheduling frameworks in big data systems

Ji Liu, Esther Pacitti, Patrick Valduriez
<span title="">2018</span> <i title="Inderscience Publishers"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/sup4zhk5pzeqfovvsu5j2x2ytm" style="color: black;">International Journal of Cloud Computing</a> </i> &nbsp;
However, scheduling a workload in a computer cluster remains a well-known open problem. Scheduling methods are typically implemented in a scheduling framework and may have different objectives.  ...  Our study shows that different frameworks are proposed for different big data systems, different scales of computer clusters and different objectives.  ...  We would like to thank Vinod Nair for his review and useful  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1504/ijcc.2018.10014859">doi:10.1504/ijcc.2018.10014859</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/wahdohyncfa5plpn3hc6flla6q">fatcat:wahdohyncfa5plpn3hc6flla6q</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20190430095331/https://hal-lirmm.ccsd.cnrs.fr/lirmm-01692229/document" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/5d/ec/5dec3909e781338b83dcf8c30b280db5b3423ad7.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1504/ijcc.2018.10014859"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a>

Putting a "big-data" platform to good use

Mihai Budiu
<span title="">2012</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/5c4wsoaagrh73mwzl3naxxgc3e" style="color: black;">Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing - HPDC &#39;12</a> </i> &nbsp;
Windows Server Cluster services: remote execution, naming, management Storage [5] Distributed execution [9] Compiler [11,14,16,17] Windows Server Windows Server Windows Server Libraries and frameworks  ...  [1,6,7,13] Scheduling [10] Caching and data management [8,15] Monitoring, debugging [4,12] Applications [2,18] Figure 1: DryadLINQ software stack.  ...  The Quincy [10] scheduler attempts to provide a compromise between fairness and efficiency by optimizing resource assignment using a distributed max-flow model.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2287076.2287078">doi:10.1145/2287076.2287078</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/hpdc/Budiu12.html">dblp:conf/hpdc/Budiu12</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/aop475bvbvbbbcjbr6tmbb42dq">fatcat:aop475bvbvbbbcjbr6tmbb42dq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170722094811/http://budiu.info:80/work/hpdc12.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/89/50/8950175ccd214ef1f1912f518e623255b8c276e8.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2287076.2287078"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

Delay scheduling

Matei Zaharia, Dhruba Borthakur, Joydeep Sen Sarma, Khaled Elmeleegy, Scott Shenker, Ion Stoica
<span title="">2010</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/m52bwee6j5hgxdqcfnxtfxy5we" style="color: black;">Proceedings of the 5th European conference on Computer systems - EuroSys &#39;10</a> </i> &nbsp;
As organizations start to use data-intensive cluster computing systems like Hadoop and Dryad for more applications, there is a growing need to share clusters between users.  ...  We illustrate this problem through our experience designing a fair scheduler for a 600-node Hadoop cluster at Facebook.  ...  and Facebook for the many informative discussions that guided this work. We are also grateful to our shepherd, Jim Larus, whose input greatly improved this paper.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/1755913.1755940">doi:10.1145/1755913.1755940</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/eurosys/ZahariaBSESS10.html">dblp:conf/eurosys/ZahariaBSESS10</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/ciapohmbonacdberdbwu3f6pwq">fatcat:ciapohmbonacdberdbwu3f6pwq</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170830014947/http://www.icsi.berkeley.edu/pubs/networking/delayscheduling10.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/66/1b/661b19ff987b9ed9d9252324d4a72ab1fbd588ae.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/1755913.1755940"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

Analysis of hadoop MapReduce scheduling in heterogeneous environment

Khushboo Kalia, Neeraj Gupta
<span title="">2020</span> <i title="Elsevier BV"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/nlqmna5mwnfjhm6fv3u2smz7pu" style="color: black;">Ain Shams Engineering Journal</a> </i> &nbsp;
Over the last decade, several advancements have happened in distributed and parallel computing.  ...  Proper scheduling of jobs needs to be done for better performance.  ...  Quincy scheduler Quincy scheduler focuses on achieving fairness. It follows the flow-based scheduling instead of queue-based scheduling which is used in Hadoop.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1016/j.asej.2020.06.009">doi:10.1016/j.asej.2020.06.009</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/arc6gyftmrhtpe5b7hfe2gzesy">fatcat:arc6gyftmrhtpe5b7hfe2gzesy</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200816035056/https://pdf.sciencedirectassets.com/270550/AIP/1-s2.0-S2090447920301325/main.pdf?X-Amz-Security-Token=IQoJb3JpZ2luX2VjEPL%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FwEaCXVzLWVhc3QtMSJHMEUCIQDluiZaCZ7i4FWhfa2PSH9tLzmCADi2GfNAOGbl010LwAIgdldfdZKZRFSU5bZhwixvyXrbQEAOIfGn2rGFw11qaIMqvQMIy%2F%2F%2F%2F%2F%2F%2F%2F%2F%2F%2FARADGgwwNTkwMDM1NDY4NjUiDJvTcT%2BFeRYXQYgLMiqRA0mSz6fMxHs2gVrH%2Bh8ETAR9a7QCOaa0vdGkzjrx5ZC4U%2Fllze8IqH1ucJ8YB%2F1eP9Pho0KNBU4OLLU3FCMr2hPx88sGL8RdEK6%2BI6qYf9ZjxvNDya061Zo2xptIcLBVnXiZnKqZxeeaY2ULlNaQXf4muP4mK%2FnpeOFcBVvDGdMw50Y6gIhRpAAV%2BF6%2FsIODxm0athVEWx1eUmaTVb7aTqrkf%2FMz31IWaVwLSz3PmZ5MHyijsC%2BoiW5Qf65SS17%2FlkpTaVxdV59el%2BeOW%2Fo%2BaInLv3IHwa8qwznXnjqmelGYr9T2gn9kuK%2Fb9y1NP78MFlX9Uau01iWytXjKfUTrvUwpZMz2%2BBrtsrkgSIO05LvLTKs3soBj5wMPxQpfKjmxqM9mTS89pugM%2BQzcTb8CU%2FbjXdPIWU4W2XkpE7%2BPtCkUmQ2kf7JJfNyVAK6kxePGxAS0HEIOJSd%2Fkz16aOpA9%2FRLj8HF6fS8T7WYa7Enw%2BG%2BozrnpSLO8UZ%2FmTuBbc2JChj2Xa8FaYAydRY%2BHizwAdzGMLWk4vkFOusBlZYqJ1XMkTklSD76Xl3UQp1L7ZU2%2F18OAw%2Bl0T1idgsjFd74LirSbk7ul8vsQKYO1%2ByCYqjGd6gTMkoIjBjl7BCEdkiPyLY9qHSFlGnkkiGs%2FvMfajWFj0NRSHsOQq7pZz6YXH81xfsTMtcrnZrnV9r%2FBrBJvg%2BpdQ0rTXD2Ic9HmFDq2kD3AYwPAj4fIJoeRrZ7J6H2hTJRsvadVnQxzMpAt%2FqJDcr4QW%2BcFWdnj6El45ThceHVy1Rrq4lfnOrIY6DskmBDvYpfjUdXGRfYr4vgQAv0dkHesU1stMwrghSrjaNCnxRQ1yRGnw%3D%3D&amp;X-Amz-Algorithm=AWS4-HMAC-SHA256&amp;X-Amz-Date=20200816T035051Z&amp;X-Amz-SignedHeaders=host&amp;X-Amz-Expires=300&amp;X-Amz-Credential=ASIAQ3PHCVTYXNFD6SPF%2F20200816%2Fus-east-1%2Fs3%2Faws4_request&amp;X-Amz-Signature=35f7744e921624f54a6eb405f7c45e8ce5dd446d46dae222ef78e535c99e0730&amp;hash=18fc7984041d90d739b9e6a1abe5df2b8c640f449a9350fd7fe49af8eea444ca&amp;host=68042c943591013ac2b2430a89b270f6af2c76d8dfd086a07176afe7c76c2c61&amp;pii=S2090447920301325&amp;tid=spdf-406fc2c9-2cce-4798-89ae-18329000c0fc&amp;sid=5b18156e8e7bb544988acb28c05dbfe04916gxrqa&amp;type=client" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1016/j.asej.2020.06.009"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> elsevier.com </button> </a>

Choosy

Ali Ghodsi, Matei Zaharia, Scott Shenker, Ion Stoica
<span title="">2013</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/m52bwee6j5hgxdqcfnxtfxy5we" style="color: black;">Proceedings of the 8th ACM European Conference on Computer Systems - EuroSys &#39;13</a> </i> &nbsp;
Optimally computing CMMF is challenging, but we show that a remarkably simple online scheduler, called Choosy, approximates the optimal scheduler well.  ...  Max-Min Fairness is a flexible resource allocation mechanism used in most datacenter schedulers.  ...  Related Work Datacenter Schedulers Quincy [16] and the Hadoop Fair Scheduler [34] are fair schedulers for datacenters that take into account data locality.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2465351.2465387">doi:10.1145/2465351.2465387</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/eurosys/GhodsiZSS13.html">dblp:conf/eurosys/GhodsiZSS13</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/3pw4ciaaezellnp6xca6nvfy34">fatcat:3pw4ciaaezellnp6xca6nvfy34</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170812091946/https://amplab.cs.berkeley.edu/wp-content/uploads/2013/04/choosy3.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/c9/58/c9584690d0576efecde33fd0dbc54964de3e3ec5.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/2465351.2465387"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>

Coupling task progress for MapReduce resource-aware scheduling

Jian Tan, Xiaoqiao Meng, Li Zhang
<span title="">2013</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/2n2fyi4qgfa53mwrtarkk6ysnm" style="color: black;">2013 Proceedings IEEE INFOCOM</a> </i> &nbsp;
It couples the progresses of MapTasks and ReduceTasks, utilizing Wait Scheduling for ReduceTasks and Random Peeking Scheduling for MapTasks to jointly optimize the task placement.  ...  In this paper, we design and implement a resource-aware scheduler for Hadoop.  ...  First, Fair Scheduler only guarantees the fairness of MapTasks, and is not really fair for ReduceTasks.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/infcom.2013.6566958">doi:10.1109/infcom.2013.6566958</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/infocom/TanMZ13.html">dblp:conf/infocom/TanMZ13</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/wrf67poezjabxpqj34tse2qlvm">fatcat:wrf67poezjabxpqj34tse2qlvm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20150701124003/http://www.utdallas.edu:80/~cxl137330/courses/spring14/AdvRTS/protected/slides/34.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/0c/62/0c62a55d5dfd56b568e9f98e0263add554007cb3.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/infcom.2013.6566958"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

Gemini: An Adaptive Performance-Fairness Scheduler for Data-Intensive Cluster Computing

Zhaojie Niu, Shanjiang Tang, Bingsheng He
<span title="">2015</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/vf7glygozrdhdkhluhlxpb7j4q" style="color: black;">2015 IEEE 7th International Conference on Cloud Computing Technology and Science (CloudCom)</a> </i> &nbsp;
In data-intensive cluster computing platforms such as Hadoop YARN, performance and fairness are two important factors for system design and optimizations.  ...  Next, we leverage the model to guide the resource allocation for pending tasks to optimize the performance of the cluster given the user-defined fairness level.  ...  Quincy [10] resolves fair allocations efficiently by mapping from the fair scheduling problem to min-cost flow.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/cloudcom.2015.52">doi:10.1109/cloudcom.2015.52</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/cloudcom/NiuTH15.html">dblp:conf/cloudcom/NiuTH15</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/dh7qeiut5vcxrfktw3t2vt3rke">fatcat:dh7qeiut5vcxrfktw3t2vt3rke</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170429033010/http://pdcc.ntu.edu.sg:80/xtra/paper/2015Pub/zhaojie_cloudcom.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/52/6f/526f0347bb3a0e05e5361f8713be57cd302e5cae.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/cloudcom.2015.52"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

PRISM: Fine-Grained Resource-Aware Scheduling for MapReduce

Qi Zhang, Mohamed Faten Zhani, Yuke Yang, Raouf Boutaba, Bernard Wong
<span title="2015-04-01">2015</span> <i title="Institute of Electrical and Electronics Engineers (IEEE)"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/ic7oylwbfvfw3hf4wbnzwcqeuq" style="color: black;">IEEE Transactions on Cloud Computing</a> </i> &nbsp;
MapReduce has become a popular model for data-intensive computation in recent years.  ...  In a 10-node Hadoop cluster running standard benchmarks, PRISM offers high resource utilization and provides 1:3Â improvement in job running time compared to the current Hadoop schedulers.  ...  We deployed PRISM in a compute cluster which consists of 10 compute nodes.  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/tcc.2014.2379096">doi:10.1109/tcc.2014.2379096</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/woqi5vojsfdkjhvmogdufi353e">fatcat:woqi5vojsfdkjhvmogdufi353e</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20170829014335/http://rboutaba.cs.uwaterloo.ca/Papers/Journals/2015/ZhangTCC15.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/32/58/325816bfe70411a5c642a170d8b7c75446feddc6.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/tcc.2014.2379096"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>

A Survey on Job Scheduling in Big Data

M. Senthilkumar, P. Ilango
<span title="2016-09-01">2016</span> <i title="Walter de Gruyter GmbH"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/yqncwzlovvhvhktpm65k4wwuoe" style="color: black;">Cybernetics and Information Technologies</a> </i> &nbsp;
Big Data Applications with Scheduling becomes an active research area in last three years. The Hadoop framework becomes very popular and most used frameworks in a distributed data processing.  ...  Various scheduling algorithms of the MapReduce model using Hadoop vary with design and behavior, and are used for handling many issues like data locality, awareness with resource, energy and time.  ...  Scheduling multiple jobs with fairness, locality improvement and delay scheduling are achieved in Hadoop and Quincy scheduler [38, 41] .  ... 
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1515/cait-2016-0033">doi:10.1515/cait-2016-0033</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/psrtc3l3dzgkfklqjl6hr3qczi">fatcat:psrtc3l3dzgkfklqjl6hr3qczi</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20190501231628/https://content.sciendo.com/downloadpdf/journals/cait/16/3/article-p35.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/57/62/576295abbef59bd38601a129fa6e138734872a56.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1515/cait-2016-0033"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="unlock alternate icon" style="background-color: #fb971f;"></i> degruyter.com </button> </a>
&laquo; Previous Showing results 1 &mdash; 15 out of 297 results