12,440 Hits in 4.3 sec

Scalability Analysis of Job Scheduling Using Virtual Nodes [chapter]

Norman Bobroff, Richard Coppinger, Liana Fong, Seetharami Seelam, Jing Xu
2009 Lecture Notes in Computer Science  
In this paper, we analyze the scalability of job scheduling and job dispatching functions in the IBM LoadLeveler job scheduler.  ...  However, our study shows that the static resource matching in the scheduling cycle and job object processing during the hierarchical job launching are two impediments for the scalability of LoadLeveler  ...  This material is based upon work supported by the US Defense Advanced Research Projects Agency (DARPA) under its Agreement No. HR0011-07-9-0002.  ... 
doi:10.1007/978-3-642-04633-9_11 fatcat:uow5zcdwz5f4zpj2evgxffsryu

Andlantis: Large-scale Android Dynamic Analysis [article]

Michael Bierma, Eric Gustafson, Jeremy Erickson, David Fritz, Yung Ryn Choe
2014 arXiv   pre-print
We present Andlantis, a scalable dynamic analysis system capable of processing over 3000 Android applications per hour.  ...  We discuss the results of running 1261 malware samples through the system, and provide examples of malware analysis performed with the resulting data.  ...  After a job has run for a specified time (generally 5 minutes), the scheduler stops the job, collects the resulting data from the appropriate node and cleans up the files used for the job.  ... 
arXiv:1410.7751v1 fatcat:2ehjxv3gwrbs5k3l5nmxnpgdfi

Scheduling divisible loads in the dynamic heterogeneous grid environment

Tao Zhu, Yongwei Wu, Guangwen Yang
2006 Proceedings of the 1st international conference on Scalable information systems - InfoScale '06  
Algorithms of resource location and job scheduling are discussed.  ...  The resource model is maintained in a distributed way, making it loosecoupled and scalable, which is practical for many grid applications, especially for sequence analysis in Bioinformatics.  ...  Analysis of Divisible Load Scheduling Resource Model Analysis Before job scheduling, the resource location procedure will select a subtree matching the job requests, and get the real-time information  ... 
doi:10.1145/1146847.1146855 dblp:conf/infoscale/ZhuWY06 fatcat:tlqjawxykvhujhptprymdn47t4

Reverse Engineering of TopHat: Splice Junction Mapper for Improving Computational Aspect

Olivier Terzo, Lorenzo Mossucca, Andrea Acquaviva, Francesco Abate, Elisa Ficarra, Rosalba Provenzano
2012 2012 Third International Conference on Intelligent Systems Modelling and Simulation  
aspect is an implementation of an hybrid infrastructure: grid and virtual grid computing.  ...  Next Generation Sequencing technology allows more accurate analysis increasing data to elaborate, this opens to new challenges in terms of development of tools and computational infrastructures.  ...  Infrastructure is based on Grid and Virtual Grid Platform, using a common repository and a couple of job schedulers.  ... 
doi:10.1109/isms.2012.76 fatcat:sblrrnjyh5hmjk3qvkrfx6xvqu

Large-scale HPC deployment of Scalable CyberInfrastructure for Artificial Intelligence and Likelihood Free Inference (SCAILFIN)

Mike Hildreth, Kenyi Paolo Hurtado Anampa, Cody Kankel, Scott Hampton, Paul Brenner, Irena Johnson, Tibor Simko
2019 Zenodo  
(LFI) techniques and software using scalable cyberinfrastructure (CI) built on top of existing CI elements.  ...  REANA is capable of orchestrating extremely complicated multi-step workflows, and uses Kubernetes clusters both for scheduling and distributing container-based workloads across a cluster of available machines  ...  ■ Consists of many small pieces which handle workflows, dish out jobs, coordinates results, can be thought of as the job scheduler. Jobs are scheduled via Kubernetes.  ... 
doi:10.5281/zenodo.3599172 fatcat:y4wbigwf5nemjp2nhwdeompoea

An analysis of the load scheduling algorithms in the cloud computing environment: A survey

Divya Chaudhary, Bijendra Kumar
2014 2014 9th International Conference on Industrial and Information Systems (ICIIS)  
This paper presents the basic cloud computing fundamentals and the concepts of load balancing i.e., scheduling of load in the cloud.  ...  It offers immense potential to bloom the world with applications and products focussing on greater resource utilization and scalability.  ...  The Cloud Computing Framework [27] The cloud computing provides the benefits of virtualization and dynamic scalability of the system.  ... 
doi:10.1109/iciinfs.2014.7036659 fatcat:fin3p7o4gndj3bdkhgqo6wlyby

A New MapReduce Framework Based on Virtual IP Mechanism and Load Balancing Strategy

Song Yang, Hao Pingting, Hu Jiejun, Hu Liang, Che Xilong
2015 Open Cybernetics and Systemics Journal  
The deficiency of the MapReduce architecture is a lack in balancing and scalability, thus leads to low efficiency when dealing with large-scale data.  ...  The framework is based on the virtual IP mechanism and load balancing strategy.  ...  It uses one address to name all the cluster nodes for building a virtual cluster with large amount of low-cost resources.  ... 
doi:10.2174/1874110x01509010253 fatcat:fvkdcz4dtbatpcbsr6wsgj2o5a


Kyungyong Lee, David Wolinsky, Renato J. Figueiredo
2012 Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing - HPDC '12  
In this paper, we present a novel approach that integrates a self-organizing P2P overlay for scalable and timely discovery of resources with unmodified client/server job scheduling middleware in order  ...  We show that job scheduling time of our approach scales with O(log N ), where N is the number of resources in a pool, through first-order analytical models and large-scale simulation results.  ...  The scheduled jobs are executed using condor starter of worker nodes and condor shadow daemon of Node A. • Upon job completion, Node A sends a PonD destroy message to nodes in the PonD.  ... 
doi:10.1145/2287076.2287105 dblp:conf/hpdc/LeeWF12 fatcat:3cqvukk4ffffta4s2czakngbtu

Secured Multi-Cloud Virtual Infrastructure with Improved Performance

R. Thandeeswaran, S. Subhashini, N. Jeyanthi, M. A. Saleem Durai
2012 Cybernetics and Information Technologies  
The Oracle grid engine is used to schedule the jobs to the worker nodes (in-house and cloud). Worker nodes will be acting like listeners to receive the job from the oracle grid engine master node.  ...  The model proposed which is the implementation of a secured multi-cloud virtual infrastructure consists of a grid engine on top of the multi-cloud infrastructure to distribute the task among the worker  ...  • Scalability -Multiple customers running tens of millions of jobs with thousands of machines.  ... 
doi:10.2478/cait-2012-0009 fatcat:azuta3ocv5dybegxxpivicvyfu

A Cloud Computing Infrastructure on Heterogeneous Computing Resources

Baomin XU, Ning Wang, Chunyan Li
2011 Journal of Computers  
Cloud computing is a state-of-the-art distributed computing paradigm which can support on-demand service sharing with flexibility and scalability.  ...  In order to use the heterogeneous computing resources in a much more efficient, scalable and flexible way, a Cloud computing infrastructure HCCloud (Heterogeneous Computing Cloud) has developed.  ...  of the compute nodes used for job execution Collect and reduce the execution results from compute nodes, then transfer back to the data server that will meet all the analysis needs of user Faster replication  ... 
doi:10.4304/jcp.6.8.1789-1796 fatcat:phvo6x24yvc5tp6hr75yztplr4

Scheduler technologies in support of high performance data analysis

Albert Reuther, Chansup Byun, William Arcand, David Bestor, Bill Bergeron, Matthew Hubbell, Michael Jones, Peter Michaleas, Andrew Prout, Antonio Rosa, Jeremy Kepner
2016 2016 IEEE High Performance Extreme Computing Conference (HPEC)  
Job schedulers are a key component of scalable computing infrastructures.  ...  Job latency is critical for the efficient utilization of scalable computing infrastructures, and this paper presents the results of job launch benchmarking of several current schedulers: Slurm, Son of  ...  Finally, we measured launch times of virtual machine jobs onto clusters using a variety of job slot packing and oversubscription techniques ].  ... 
doi:10.1109/hpec.2016.7761604 dblp:conf/hpec/ReutherBABBHJMP16 fatcat:7npyzy32dzhqhl65soe6qpadpq

STORM: Lightning-Fast Resource Management

E. Frachtenberg, F. Petrini, J. Fernandez, S. Pakin, S. Coll
2002 ACM/IEEE SC 2002 Conference (SC'02)  
scheduling.  ...  As a result of this HPC-application-like design, STORM is orders of magnitude faster than the best reported results in the literature on two sample resource-management functions: job launching and process  ...  Acknowledgments The authors would like to thank Dror Feitelson for providing the ParPar scheduler which STORM uses as its global-allocation scheduler, Jon Beecroft and Moray McLaren of Quadrics Supercomputers  ... 
doi:10.1109/sc.2002.10057 dblp:conf/sc/FrachtenbergPFPC02 fatcat:2y2zi2uywjfftg6omazkwk5yta

Survey and analysis on Task scheduling in Cloud environment

P. Akilandeswari, H. Srimathi, H. Srimathi
2016 Indian Journal of Science and Technology  
Analysis: This paper focuses on a comparative study of static and dynamic task scheduling currently used and various researchers work on dynamic task scheduling for many applications.  ...  Objectives: In cloud environment many scheduling algorithms are available to achieve the quality of service, but the scalability of task execution increases, scheduling becomes more complex.  ...  In 2 proposed job scheduling for homogeneous cluster computing. It dealt with virtual machine technology to share fractional node resources in a precise and controlled manner for the various job.  ... 
doi:10.17485/ijst/2016/v9i37/102058 fatcat:3d722lgsazaovkk77xc63nftvu

A scalable infrastructure for CMS data analysis based on OpenStack Cloud and Gluster file system

S Toor, L Osmani, P Eerola, O Kraemer, T Lindén, S Tarkoma, J White
2014 Journal of Physics, Conference Series  
In this project the aim has been to design a scalable and resilient infrastructure for CERN HEP data analysis.  ...  The challenge of providing a resilient and scalable computational and data management solution for massive scale research environments requires continuous exploration of new technologies and techniques  ...  The test setup can provide up to 100 slots for serial jobs and 25 slots for whole node requests. We have used A-REX from ARC as our meta scheduler and HTCondor for internal resource management.  ... 
doi:10.1088/1742-6596/513/6/062047 fatcat:q67n5rbtyrgihpmbmyb6aybf6m

Load Balancing in Virtualized Environment - A Survey

N Balaji, A. Umamakeshwari
2015 Indian Journal of Science and Technology  
Load balancing in cloud computing is of paramount importance. As the request floods in, certain nodes might become heavily loaded. So it is essential to spread the load uniformly among the nodes.  ...  In this paper, a review of prevailing load balancing approaches in cloud environment is presented and evaluated against various metrics such as throughput, fault tolerance, scalability, migration time  ...  Since small jobs are scheduled first only they can access the node that performs faster.  ... 
doi:10.17485/ijst/2015/v8is9/65583 fatcat:6wunmhw6gnccjei4ryw4jly3xa
« Previous Showing results 1 — 15 out of 12,440 results