Filters








690 Hits in 3.9 sec

Holistic Runtime Scheduling for the Distributed Computing Landscape

Marcel Blöcher
2021
A wide range of resource scheduling systems for the distributed computing landscape has been proposed in the past, covering the application and infrastructure levels.  ...  Many application-level resource scheduling systems lack support for runtime scheduling, often due to slow or unsuitable algorithms.  ...  In this dissertation, we present four novel solutions to holistic runtime scheduling for the distributed computing landscape.  ... 
doi:10.26083/tuprints-00018576 fatcat:yhndjijxcjb6bn2h45c6r4aqia

Navigating the Landscape for Real-Time Localization and Mapping for Robotics and Virtual and Augmented Reality

2018 Proceedings of the IEEE  
SLAM algorithmic approaches, and (4) tools for delivering, where appropriate, accelerated, adaptive SLAM solutions in a managed, JIT-compiled, adaptive runtime context.  ...  Visual understanding of 3D environments in real-time, at low power, is a huge computational challenge.  ...  Quasi-static scheduling is a compromising approach that statically computes a good schedule and further improves it online depending on runtime conditions [12] .  ... 
doi:10.1109/jproc.2018.2856739 fatcat:a66m7lzvn5bjvlxyw7qkd2qaky

Challenges and Recommendations for Preparing HPC Applications for Exascale [article]

Erika Abraham, Costas Bekas, Ivona Brandic, Samir Genaim, Einar Broch Johnsen, Ivan Kondov, Sabri Pllana, Achim Streit
2015 arXiv   pre-print
While the HPC community is working towards the development of the first Exaflop computer (expected around 2020), after reaching the Petaflop milestone in 2008 still only few HPC applications are able to  ...  Furthermore, we outline a conceptual framework for porting HPC applications to future Exascale computing systems and propose steps for its implementation.  ...  the right decisions to navigate in this complex landscape.  ... 
arXiv:1503.06974v2 fatcat:ehins3rgmred5itigap3xohooy

Adapt or become extinct!

Georgios Goumas, Sally A. McKee, Magnus Själander, Thomas R. Gross, Sven Karlsson, Christian W. Probst, Lixin Zhang
2011 Proceedings of the 1st International Workshop on Adaptive Self-Tuning Computing Systems for the Exaflop Era - EXADAPT '11  
The High-Performance Computing ecosystem consists of a large variety of execution platforms that demonstrate a wide diversity in hardware characteristics such as CPU architecture, memory organization,  ...  This environment also presents a number of hard boundaries (walls) for applications which limit software development (parallel programming wall), performance (memory wall, communication wall) and viability  ...  MOTIVATION The proliferation of multicore technology and the commoditization of High-Performance Computing (HPC) systems have changed the parallel computing landscape.  ... 
doi:10.1145/2000417.2000422 fatcat:h5gnh4twjzcetarsdj2cnfp2yu

Flexible SOA Lifecycle on the Cloud Using SCA

Cristian Ruz, Francoise Baude, Bastien Sauvan, Adrian Mos, Alain Boulze
2011 2011 IEEE 15th International Enterprise Distributed Object Computing Conference Workshops  
, to deployment and runtime support.  ...  We present an integrated approach to design, monitor and manage the lifecycle of applications based on the Service Oriented Architecture (SOA) principles and capable of taking advantage of cloud computing  ...  The ProActive Scheduler [16] is an application that allows to manage tasks over distributed resources and can gather and relinquish nodes launched on desktop computers, clusters, grid or cloud environments  ... 
doi:10.1109/edocw.2011.51 dblp:conf/edoc/RuzBSMB11 fatcat:ruu2aap6njeb3ges47gr5azojq

Virtual Infrastructure Optimisation [chapter]

Spiros Koulouzis, Paul Martin, Zhiming Zhao
2020 Lecture Notes in Computer Science  
We describe our experiences identifying the time-critical requirements of environmental scientists making use of computational research support environments.  ...  Specialised data services for managing the data lifecycle, for creating and delivering data products, and for customised data processing and analysis, all play a crucial role in how these research infrastructures  ...  of competing systems and standards in the world computational landscape.  ... 
doi:10.1007/978-3-030-52829-4_11 fatcat:ichygqd6uvgtraxd57nkaykzra

Towards Self-Protective Multi-Cloud Applications - MUSA – a Holistic Framework to Support the Security-Intelligent Lifecycle Management of Multi-Cloud Applications

Erkuden Rios, Eider Iturbe, Leire Orue-Echevarria, Massimiliano Rak, Valentina Casola
2015 Proceedings of the 5th International Conference on Cloud Computing and Services Science  
The framework includes security-by-design mechanisms to allow application self-protection at runtime, as well as methods and tools for the integrated security assurance in both the engineering and operation  ...  The MUSA framework aims to support the security-intelligent lifecycle management of distributed applications over heterogeneous cloud resources.  ...  ACKNOWLEDGEMENTS The project leading to this paper has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 644429.  ... 
doi:10.5220/0005492905510558 dblp:conf/closer/RiosIORC15 fatcat:ml5oah4vvbgyzdngqfpvpqqrvm

Pilot-Streaming: A Stream Processing Framework for High-Performance Computing [article]

Andre Luckow and George Chantzialexiou and Shantenu Jha
2018 arXiv   pre-print
Pilot-Streaming is based on the Pilot-Job concept and enables developers to manage distributed computing and data resources for complex streaming applications.  ...  The development of streaming applications is a complex task and requires the integration of heterogeneous, distributed infrastructure, frameworks, middleware and application components.  ...  Acknowledgements: We thank Stuart Campbell and Julien Lhermitte (BNL) for guidance on the light source application. This work is funded by NSF 1443054 and 1440677.  ... 
arXiv:1801.08648v2 fatcat:36yv4b4qvjfnhmzndq57ssev4m

DCDB Wintermute: Enabling Online and Holistic Operational Data Analytics on HPC Systems [article]

Alessio Netti, Micha Mueller, Carla Guillen, Michael Ott, Daniele Tafani, Gence Ozer, Martin Schulz
2019 arXiv   pre-print
In this paper we propose Wintermute, a novel operational data analytics framework for HPC installations, built upon the holistic DCDB monitoring system.  ...  specific aspects of the problem.  ...  This research activity has received funding from the DEEP-EST project under the EU H2020-FETHPC-01-2016 Programme grant agreement n. 754304.  ... 
arXiv:1910.06156v1 fatcat:imcqkybna5gtjpyxibdu57vfvi

Toward Efficient In-memory Data Analytics on NUMA Systems [article]

Puya Memarzia, Suprio Ray, Virendra C Bhavsar
2020 arXiv   pre-print
Modern computers increasingly rely on Non-Uniform Memory Access (NUMA) architectures in order to achieve scalability.  ...  Modern operating systems are designed to provide basic support for NUMA systems. However, default system configurations are typically sub-optimal for large data analytics applications.  ...  ACKNOWLEDGEMENTS We would like to thank Kenneth Kent and Aaron Graham from IBM CASA and Serguei Vassiliev and Kaizaad Bilimorya from Compute Canada, for providing access to Machine B and Machine C respectively  ... 
arXiv:1908.01860v3 fatcat:3ri4vadygzce5ao5dslmakn7zm

D4.1 Programming Language And Runtime System: Requirements

Hans Vandierendonck
2016 Zenodo  
This document elaborates the requirements for the VINEYARD programming model and runtime system.  ...  One of the components in the VINEYARD is the programming model and runtime system support, which is developed in Work Package 4.  ...  Data Distribution Distributed systems for big data processing employ some form of data distribution to balance the workload across the distributed system.  ... 
doi:10.5281/zenodo.898162 fatcat:h4qoibk26vfzdao5badtj6fdie

Trends in Data Locality Abstractions for HPC Systems

Didem Unat, Anshu Dubey, Torsten Hoefler, John Shalf, Mark Abraham, Mauro Bianco, Bradford L. Chamberlain, Romain Cledat, H. Carter Edwards, Hal Finkel, Karl Fuerlinger, Frank Hannig (+9 others)
2017 IEEE Transactions on Parallel and Distributed Systems  
Support for expression of data locality has been explored in the past, but those efforts have had only modest success in being adopted in HPC applications for various reasons.  ...  The cost of data movement has always been an important concern in high performance computing (HPC) systems. It has now become the dominant factor in terms of both energy consumption and performance.  ...  C/C++ and Fortran, which dominate the highperformance computing landscape, offer limited facilities for compile-time introspection.  ... 
doi:10.1109/tpds.2017.2703149 fatcat:vjalwrujhrex7cibod3qerf3z4

Container Scheduling Techniques: A Survey and Assessment

Imtiaz Ahmad, Mohammad Gh. AlFailakawi, Asayel AlMutawa, Latifa Alsalman
2021 Journal of King Saud University: Computer and Information Sciences  
In this timely survey, we investigate the landscape of the state-of-the-art container scheduling techniques aiming to inspire more research work in this active area of research.  ...  Then for each class of scheduling algorithms, we analyze and identify key benefits and pitfalls, together with key challenges of the available techniques based on the performance metrics.  ...  Acknowledgment The authors would like to thank the anonymous reviewers for their invaluable comments and constructive criticism to improve the quality of the manuscript.  ... 
doi:10.1016/j.jksuci.2021.03.002 fatcat:ntx6dmydynaqxioolkx64n2ota

Accelerating NWChem Coupled Cluster Through Dataflow-Based Execution [chapter]

Heike Jagode, Anthony Danalis, George Bosilca, Jack Dongarra
2016 Lecture Notes in Computer Science  
In this paper, we present our effort of converting the NWChem's CC code into a dataflow-based form that is capable of utilizing the task scheduling system PaRSEC (Parallel Runtime Scheduling and Execution  ...  Numerical techniques used for describing many-body systems, such as the Coupled Cluster methods (CC) of the quantum chemistry package NWChem, are of extreme interest to the computational chemistry community  ...  The Parallel Runtime Scheduling and Execution Control (PaRSEC) [2] framework is a task-based dataflow-driven runtime that enables task execution based on holistic conditions, leading to a better computational  ... 
doi:10.1007/978-3-319-32149-3_35 fatcat:6bwtlgnw3nb5pjaanvikxs4y6q

Predictive performance modeling for distributed batch processing using black box monitoring and machine learning

Carl Witt, Marc Bux, Wladislaw Gusew, Ulf Leser
2019 Information Systems  
In many domains, the previous decade was characterized by increasing data volumes and growing complexity of computational workloads, creating new demands for highly data-parallel computing in distributed  ...  Effective operation of these systems is challenging when facing uncertainties about the performance of jobs and tasks under varying resource configurations, e.g., for scheduling and resource allocation  ...  Acknowledgements Carl Witt, Marc Bux, and Wladislaw Gusew have received funding by the Deutsche Forschungsgemeinschaft (DFG) through the SOAMED graduate school (GRK 1651).  ... 
doi:10.1016/j.is.2019.01.006 fatcat:4xa64wqoczgbvkf2ui7izmtyvq
« Previous Showing results 1 — 15 out of 690 results