5,969 Hits in 4.8 sec

Trends in Data Locality Abstractions for HPC Systems

Didem Unat, Anshu Dubey, Torsten Hoefler, John Shalf, Mark Abraham, Mauro Bianco, Bradford L. Chamberlain, Romain Cledat, H. Carter Edwards, Hal Finkel, Karl Fuerlinger, Frank Hannig (+9 others)
2017 IEEE Transactions on Parallel and Distributed Systems  
Support for expression of data locality has been explored in the past, but those efforts have had only modest success in being adopted in HPC applications for various reasons.  ...  Data locality abstractions are available in the forms of libraries, data structures, languages and runtime systems; a common theme is increasing productivity without sacrificing performance.  ...  An emerging trend in HPC is to delegate responsibilities to libraries, compilers, and runtime systems.  ... 
doi:10.1109/tpds.2017.2703149 fatcat:vjalwrujhrex7cibod3qerf3z4

Ecoscale: Reconfigurable Computing And Runtime System For Future Exascale Systems

Iakovos Mavroidis, Ioannis Papaefstathiou, Luciano Lavagno, Dimitrios Nikolopoulos, Dirk Koch, John Goodacre, Ioannis Sourdis, Vassilis Papaefstathiou, Marcello Coppola, Manuel Palomino
2016 Zenodo  
In order to reach exascale performance, current HPC systems need to be improved.  ...  Apart from improvements in implementation technology, what is needed is to refine the HPC application development flow as well as the system architecture of future HPC systems.  ...  ) in an HPC system.  ... 
doi:10.5281/zenodo.34893 fatcat:ocwfndo4vjei3hqucmndj22xu4

Pilot-Abstraction: A Valid Abstraction for Data-Intensive Applications on HPC, Hadoop and Cloud Infrastructures? [article]

Andre Luckow, Pradeep Mantha, Shantenu Jha
2015 arXiv   pre-print
As memory naturally fits in with the Pilot concept of retaining resources for a set of tasks, we propose the extension of the Pilot-Abstraction to in-memory resources.  ...  With science moving toward data-driven discoveries relying more on correlations in data to form scientific hypotheses, the limitations of HPC approaches become apparent: Architectural paradigms such as  ...  HPC and ABDS Abstractions This section describes abstractions and runtime systems for data-intensive computing in the HPC and ABDS domains.  ... 
arXiv:1501.05041v1 fatcat:eiu3inxk7bblrcoh7orjkrimjq

Hadoop on HPC: Integrating Hadoop and Pilot-based Dynamic Resource Management [article]

Andre Luckow and Ioannis Paraskevakos and George Chantzialexiou and Shantenu Jha
2016 arXiv   pre-print
How to explore runtime trade-offs (data localities vs. data movement)? This paper provides both conceptual understanding and practical solutions to the integrated use of HPC and Hadoop environments.  ...  This is an important step that allows applications to integrate HPC stages (e.g. simulations) to data analytics.  ...  We thank Professor Geoffrey Fox for useful discussions.  ... 
arXiv:1602.00345v1 fatcat:iyrqqxv4xjdwbdcwil2v23rfom

A Tale of Two Data-Intensive Paradigms: Applications, Abstractions, and Architectures [article]

Shantenu Jha, Judy Qiu, Andre Luckow, Pradeep Mantha, Geoffrey C.Fox
2014 arXiv   pre-print
Scientific problems that depend on processing large amounts of data require overcoming challenges in multiple areas: managing large-scale data distribution, co-placement and scheduling of data with compute  ...  We analyze the ecosystems of the two prominent paradigms for data-intensive applications, hereafter referred to as the high-performance computing and the Apache-Hadoop paradigm.  ...  A possible and promising approach for interoperability that emerges and will be investigated is the extension of HPC Pilot-Job abstraction to YARN, and the usage of Pilot-Data [12] for data-locality  ... 
arXiv:1403.1528v2 fatcat:dnyrpncqfneofaxyuvq3tzffz4

Survey on Parallel Computing and Performance Modelling in High Performance Computing

Chaitali S.Jadhav
2015 International Journal on Recent and Innovation Trends in Computing and Communication  
The parallel programming come a long way with the advances in the HPC.  ...  The high performance computing landscape is shifting from collections of homogeneous nodes towards heterogeneous systems, in which nodes consist of a combination of traditional out-of-order execution cores  ...  And also for visualisation purposes in reducing large data sets into pictures for scientific understandings. D.  ... 
doi:10.17762/ijritcc2321-8169.150299 fatcat:mpen3gv5ing6jiejwwl7zpu2eu

A Case for Optimistic Coordination in HPC Storage Systems

Philip Carns, Kevin Harms, Dries Kimpe, Robert Ross, Justin Wozniak, Lee Ward, Matthew Curry, Ruth Klundt, Geoff Danielson, Cengiz Karakoyunlu, John Chandy, Bradley Settlemeyer (+1 others)
2012 2012 SC Companion: High Performance Computing, Networking Storage and Analysis  
In this work we evaluate the viability of optimistic conditional storage operations as an alternative to distributed locking in HPC storage systems.  ...  HPC storage systems typically employ pessimistic distributed locking to provide this functionality in cases where applications cannot perform their own coordination.  ...  Department of Energy's Oak Ridge National Laboratory and included the Extreme Scale Systems Center, located at ORNL and funded by the DoD in part by the "Novel Software Storage Architectures" contract.  ... 
doi:10.1109/sc.companion.2012.19 dblp:conf/sc/CarnsHKRWWCKDKCSG12 fatcat:kfpn4kq56benza5pbkmwl73kz4


Antonenko Vitaly, Petrov Ivan, Smeliansky Ruslan, Huang Zhen Chun, Chen Min, Cao Donggang, Chen Xiangqun
2019 Zenodo  
In this research we present MC2E –an environment for academic multidisciplinary research.  ...  MC2E will also provide a Channel-on-Demand service to connect clouds and supercomputers with channels that are used to send data for parallel applications.  ...  Such resources are often provided as supercomputers and clusters for High Performance Computing (HPC). The general trend today is the use of supercomputers or HPC installations.  ... 
doi:10.5281/zenodo.3706640 fatcat:wchoiamkozauzj22s63b4qlba4

Survey of Methodologies, Approaches, and Challenges in Parallel Programming Using High-Performance Computing Systems

Paweł Czarnul, Jerzy Proficz, Krzysztof Drypczewski
2020 Scientific Programming  
of parallelism, constructs enabling parallelism and synchronization, features introduced in recent versions indicating trends, support for hybridity in parallel execution, and disadvantages.  ...  This paper provides a review of contemporary methodologies and APIs for parallel programming, with representative technologies selected in terms of target system type (shared memory, distributed, and hybrid  ...  and challenges for development of future solutions in contemporary HPC systems.  ... 
doi:10.1155/2020/4176794 fatcat:j52aegknyrdxzg2nopk73g3uly

The Landscape of Exascale Research

Stijn Heldens, Pieter Hijma, Ben Van Werkhoven, Jason Maassen, Adam S. Z. Belloum, Rob V. Van Nieuwpoort
2020 ACM Computing Surveys  
In this work, we present an overview of these efforts and provide insight into the important trends, developments, and exciting research opportunities in exascale computing.  ...  We use a three-stage approach in which we (1) discuss various exascale landmark studies, (2) use data-driven techniques to analyze the large collection of related literature, and (3) discuss eight research  ...  The first trend is the rise of Big Data and the gap between large-scale data analytics (i.e., Big Data) and large-scale scientific computing (i.e., HPC).  ... 
doi:10.1145/3372390 fatcat:jhtwt7pxd5c5darhz75hiqgsnq

Challenges and Opportunities of User-Level File Systems for HPC (Dagstuhl Seminar 17202)

André Brinkmann, Kathryn Mohror, Weikuan Yu, Marc Herbstritt
2017 Dagstuhl Reports  
hierarchical storage systems in order to begin a community effort in enabling user-level file system support for HPC systems.  ...  In contrast, file systems at the user level can be tailored for specific HPC workloads for high performance and can be used by applications without administrator intervention.  ...  Similar trends can be seen in the context of HPC and big data convergence or of alternative file system interfaces.  ... 
doi:10.4230/dagrep.7.5.97 dblp:journals/dagstuhl-reports/BrinkmannMY17 fatcat:2bquax3oz5c5xlsoxdkiomotiy

Exploratory Project: State of the Cloud, from University of Michigan and Beyond

Traci L. Ruthkoski
2010 2010 IEEE Second International Conference on Cloud Computing Technology and Science  
As data center costs rise and space availability diminishes many organizations are investigating the viability of cloud computing for research use.  ...  The most visible examples of shared resource development in local IT infrastructure are in the areas of virtualization technology and HPC efficiency management.  ...  Ultimately local systems administrators do not have complete control over guaranteed uptime for services provided.  ... 
doi:10.1109/cloudcom.2010.50 dblp:conf/cloudcom/Ruthkoski10 fatcat:riyswuwk75d6hgaaoz7wupijrm

Challenges in Deeply Heterogeneous High Performance Systems

Giovanni Agosta, William Fornaciari, David Atienza, Ramon Canal, Alessandro Cilardo, Jose Flich, Carles Hernandez Luz, Michal Kulczewski, Giuseppe Massari, Rafael Tornero Gavila, Marina Zapater Sancho
2019 2019 22nd Euromicro Conference on Digital System Design (DSD)  
at exploring new High-Performance Computing (HPC) technologies.  ...  both time-critical and throughput-oriented computation that run on deeply heterogeneous acceleratorbased systems.  ...  In RECIPE we will explore for the first time how to deploy memory layout randomization techniques in an HPC system.  ... 
doi:10.1109/dsd.2019.00068 dblp:conf/dsd/AgostaFACCFHKMG19 fatcat:3zmdras2iraq3nmyw7gn2qaesu

Lessons Learned from Building In Situ Coupling Frameworks

Matthieu Dorier, Matthieu Dreher, Tom Peterka, Justin M. Wozniak, Gabriel Antoniu, Bruno Raffin
2015 Proceedings of the First Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization - ISAV2015  
Over the past few years, the increasing amounts of data produced by large-scale simulations have motivated a shift from traditional offline data analysis to in situ analysis and visualization.  ...  will face in order to move toward exascale.  ...  This work was done in the framework of a collaboration between the KerData joint Inria -ENS Rennes -Insa Rennes team and Argonne National Laboratory within the Joint Laboratory for Extreme-Scale Computing  ... 
doi:10.1145/2828612.2828622 dblp:conf/sc/DorierDPWAR15 fatcat:vclffn2fu5c5ba5rcuys7qiimq

The Changing Costs of Random Digital Dial Cell Phone and Landline Interviewing

Thomas Guterbock, Grant Benson, Paul Lavrakas
2017 Survey Practice  
Abstract Abstract Using newly collected data on recent dual frame surveys from a large number of survey organizations, this article discusses the current cost ratio of cell phone random digital dial (RDD  ...  When the actual interview time is included in the numerator and denominator of the ratio, to yield the average HPC ratios seen in the table, the 2010 data showed that the HPC for cell phone calling was  ... 
doi:10.29115/sp-2018-0015 fatcat:s27jydkhwnabngncub62zrggn4
« Previous Showing results 1 — 15 out of 5,969 results