1,116 Hits in 5.7 sec

Design and Performance Characterization of RADICAL-Pilot on Titan [article]

Andre Merzky and Matteo Turilli and Manuel Maldonado and Shantenu Jha
2018 arXiv   pre-print
We characterize its performance and show its ability to scalably execute workloads comprised of thousands of MPI tasks on Titan--a DOE leadership class facility.  ...  We introduce RADICAL-Pilot (RP) as a portable, modular and extensible Python-based Pilot system. We describe RP's design, architecture and implementation.  ...  Acknowledgements This work is supported by NSF "CAREER" ACI-1253644, NSF ACI-1440677 "RADICAL-Cybertools" and DOE Award de-sc0008651.  ... 
arXiv:1801.01843v1 fatcat:zixyngzjo5hxppjy2alskjjmme

PanDA and RADICAL-Pilot Integration: Enabling the Pilot Paradigm on HPC Resources

Andre Merzky, Pavlo Svirin, Matteo Turilli, A. Forti, L. Betev, M. Litmaath, O. Smirnova, P. Hristov
2019 EPJ Web of Conferences  
We integrated the PanDA Harvester service and the RADICAL-Pilot (RP) system to overcome these limitations and enable the execution of ATLAS, Molecular Dy-namics and other workloads on HPC resources.  ...  This paper offer two main con-tributions: (1) introducing PanDA Harvester and RADICAL-Pilot, two systems independent developed to support high-throughput computing (HTC) on high-performance computing (  ...  Laboratory (RADICAL) [14] and designed to support high-throughput computing on HPC infrastructures, including leadership-class machines like Titan.  ... 
doi:10.1051/epjconf/201921403057 fatcat:5mj4v25nmzeetofryyw64toyz4

Using Pilot Systems to Execute Many Task Workloads on Supercomputers [article]

Andre Merzky and Matteo Turilli and Manuel Maldonado and Mark Santcroos and Shantenu Jha
2018 arXiv   pre-print
In this paper we describe RP's design, architecture and implementation, and characterize its performance.  ...  Pilot systems help to satisfy the resource requirements of workloads comprised of multiple tasks. RADICAL-Pilot (RP) is a modular and extensible Python-based pilot system.  ...  Acknowledgments This work is supported by NSF "CAREER" ACI-1253644, NSF ACI-1440677 "RADICAL-Cybertools" and DOE Award de-sc0016280.  ... 
arXiv:1512.08194v4 fatcat:wylszrloqfh35isa6weu2vxmmm

High-Throughput Computing on High-Performance Platforms: A Case Study [article]

Danila Oleynik, Sergey Panitkin, Matteo Turilli, Alessio Angius, Kaushik De, Alexei Klimentov, Sarp H. Oral, Jack C. Wells, Shantenu Jha
2017 arXiv   pre-print
The three main contributions of this paper are: (i) a critical evaluation of design and operational considerations to support the sustained, scalable and production usage of Titan; (ii) a preliminary characterization  ...  of a next generation executor for PanDA to support new workloads and advanced execution modes; and (iii) early lessons for how current and future experimental and observational systems can be integrated  ...  Experiments We designed experiments to characterize the performance of the NGE on Titan, with an emphasis on understanding its overhead and thus the cost of introducing new functionalities.  ... 
arXiv:1704.00978v2 fatcat:xsbd4vmq3nc5rnomay2dhihdvy

Harnessing the Power of Many: Extensible Toolkit for Scalable Ensemble Applications [article]

Vivek Balasubramanian, Matteo Turilli, Weiming Hu, Matthieu Lefebvre, Wenjie Lei, Guido Cervone, Jeroen Tromp, Shantenu Jha
2018 arXiv   pre-print
We perform nine experiments, characterizing EnTK overheads, strong and weak scalability, and the performance of two use case implementations, at scale and on production infrastructures.  ...  We describe the design and implementation of EnTK, characterize its performance and integrate it with two distinct exemplar use cases: seismic inversion and adaptive analog ensembles.  ...  Runtime System Currently, EnTK uses RADICAL-Pilot (RP) [7] , [8] as the RTS. RP is a runtime system designed to execute ensemble applications via pilots.  ... 
arXiv:1710.08491v3 fatcat:5hn3q5orxjagjkopw2ntvipb7a

RADICAL-Cybertools: Middleware Building Blocks for Scalable Science [article]

Vivek Balasubramanian, Shantenu Jha, Andre Merzky, Matteo Turilli
2019 arXiv   pre-print
Specifically, RCT enable executing many-task applications at extreme scale and on a variety of computing infrastructures.  ...  RADICAL-Cybertools (RCT) are a set of software systems that serve as middleware to develop efficient and effective tools for scientific computing.  ...  Matteo Turilli is the lead architect of EnTK, co-architect of RADICAL-Pilot and wrote the paper.  ... 
arXiv:1904.03085v1 fatcat:bqndgjxfl5c6xinxqgcnurwxlm

Designing Workflow Systems Using Building Blocks [article]

Matteo Turilli, Andre Merzky, Vivek Balasubramanian, Manuel Maldonado, Shantenu Jha
2019 arXiv   pre-print
We discuss RADICAL-Cybertools as one implementation of the building blocks concept, showing how they have been designed and developed in accordance with this approach.  ...  We suggest there is a need for a fresh perspective on the design and development of workflow systems and argue for a building blocks approach.  ...  This work is made possible by the work of Vivek Balasubrmanian (EnTK) and other RADICAL members.  ... 
arXiv:1609.03484v3 fatcat:npavemexyvd4xlwbzkseskmmcm

Middleware Building Blocks for Workflow Systems [article]

Matteo Turilli, Vivek Balasubramanian, Andre Merzky, Ioannis Paraskevakos, Shantenu Jha
2019 arXiv   pre-print
We discuss RADICAL-Cybertools as one implementation of the building blocks concept, showing how they are designed and developed in accordance with this approach.  ...  workflows on high performance computing machines; (ii) illustrating a set of building blocks that enable multiple points of integration, which results in design flexibility and functional extensibility  ...  We thank Daniel Smith, Levi Naden and Sam Ellis (MolSSI) for useful discussions and insight. This was was supported primarily by NSF 1440677 and DOE ASCR de-sc0016280.  ... 
arXiv:1903.10057v1 fatcat:vvlkcxkuebhdxcp5bcqrcwu4tu

Characterizing the Performance of Executing Many-tasks on Summit [article]

Matteo Turilli, Andre Merzky, Thomas Naughton, Wael Elwasif, Shantenu Jha
2019 arXiv   pre-print
In this paper, we characterize the performance of executing many tasks using RP when interfaced with JSM and PRRTE on Summit: RP is responsible for resource management and task scheduling on acquired resource  ...  RADICAL-Pilot (RP) -- an implementation of the Pilot abstraction, addresses these challenges and serves as an effective runtime system to execute workloads comprised of many tasks.  ...  At Rutgers, this work was also supported by NSF "CAREER" ACI-1253644, RADICAL-Cybertools NSF 1440677 and 1931512, and DOE Award DE-SC0016280.  ... 
arXiv:1909.03057v1 fatcat:r27ug22ahzespkzpl6ocxsrzlu

Executing dynamic heterogeneous workloads on Blue Waters with RADICAL-Pilot

Mark Santcroos, Ralph Castain, Andre Merzky, Iain Bethune, Shantenu Jha
2016 Zenodo  
In this paper we describe the design and characterize the performance of its RADICAL-Pilot's scheduling and executing components on Crays, which are engineered for efficient resource utilization while  ...  We will discuss four different implementations of support for RADICAL-Pilot on Cray systems and analyze and report on their performance.  ...  This work is also part of the "The Power of Many: Scalable Compute and Data-Intensive Science on Blue Waters", PRAC allocation support by the National Science Foundation (NSF-1516469).  ... 
doi:10.5281/zenodo.3373740 fatcat:psmiyicmxjcsrhms6mr7vuwmgi

A Comprehensive Perspective on Pilot-Job Systems [article]

Matteo Turilli, Mark Santcroos, Shantenu Jha
2016 arXiv   pre-print
Notwithstanding the growing impact on scientific research, there is no agreement upon a definition of Pilot-Job system and no clear understanding of the underlying abstraction and paradigm.  ...  With the increasing importance of task-level parallelism in high-performance computing, Pilot-Job systems are also witnessing an adoption beyond traditional domains.  ...  We thank former and current members of the RADICAL group for helpful discussions, comments, and criticisms. We also thank members of the AIMES project for helpful discussions, in particular Daniel S.  ... 
arXiv:1508.04180v3 fatcat:5navyt6snzdjnnlbetvskzfnki

Synapse: Synthetic application profiler and emulator

Andre Merzky, Ming Tai Ha, Matteo Turilli, Shantenu Jha
2018 Journal of Computational Science  
Motivated by the need to emulate workload execution characteristics on high-performance and distributed heterogeneous resources, we introduce Synapse.  ...  Synapse has a platform-independent application profiler, and has the ability to emulate profiled workloads on a variety of resources.  ...  We acknowledge access to computational facilities on XSEDE resources via TG-MCB090174. We thank members of the RADICAL group, in particular Vivek Balasubramanian and Mark Santcroos for testing.  ... 
doi:10.1016/j.jocs.2018.06.012 fatcat:adyv7isk55alza2nessyiz4wty

RepEx: A Flexible Framework for Scalable Replica Exchange Molecular Dynamics Simulations [article]

Antons Treikalis, Andre Merzky, Haoyuan Chen, Tai-Sung Lee, Darrin M. York, Shantenu Jha
2016 arXiv   pre-print
RepEx is designed to use a pilot-job based runtime system and support diverse RE Patterns and Execution Modes.  ...  A primary motivation of the tight integration of RE functionality with simulation codes has been performance. This is limiting at multiple levels.  ...  We acknowledge allocation TG-MCB090174 for computing time on XSEDE allocated resources. We acknowledge NSF ACI 1516469 and ACI 1515572 (Cheatham) for time on Blue Waters machine.  ... 
arXiv:1601.05439v1 fatcat:vn5ahfz4bzfrbelxyfkwhqbz2q

Synthesis, Characterization, Properties, and Applications of Nanosized Photocatalytic Materials

Jiaguo Yu, Mietek Jaroniec, Huogen Yu, Wenhong Fan
2012 Journal of Nanomaterials  
, one paper reports on dyesensitized solar cells, four papers are related to preparation and properties, and the remaining two papers deal with cancer-cell treatment and with physiological damage of daphnia  ...  This special issue contains sixteen papers, which mainly deal with synthesis, characterization, properties, and environmental applications of nanosized photocatalytic materials.  ...  The article "Influence of selected alkoxysilanes on dispersive properties and surface chemistry of titanium dioxide and TiO 2 -SiO 2 composite Material" reports characterization of TiO 2 and coprecipitated  ... 
doi:10.1155/2012/783686 fatcat:nngokoz6bzdk7hggtunghx3eze

Simulation and analysis of the revised Huygens probe entry and descent trajectory and radio link modelling

B Kazeminejad, M Pérez-Ayúcar, J.-P Lebreton, M Sanchez-Nogales, M Belló-Mora, N Strange, D Roth, L Popken, K Clausen, P Couzin
2004 Planetary and Space Science  
Furthermore the orbiter/probe relay link was simulated in order to assess any potential data loss on the basis of an analytical model of the actual Huygens receiver onboard the Cassini spacecraft.  ...  A variety of parameters that are crucial for the probe system and its scientific payload have been calculated and analyzed together with an assessment of their uncertainties.  ...  The previous tour design (i.e., the T18-5 tour) delivered the probe on the first Titan flyby after SOI with an orbiter flyby altitude of 1200 km (Wolf and Smith, 1995) , while the new design delivers  ... 
doi:10.1016/j.pss.2004.03.008 fatcat:ltng4kc56zeolebz27mv2fvjta
« Previous Showing results 1 — 15 out of 1,116 results