Filters








22,579 Hits in 8.9 sec

Towards an I/O tracing framework taxonomy

Andy Konwinski, John Bent, James Nunez, Meghan Quist
2007 Proceedings of the 2nd international workshop on Petascale data storage held in conjunction with Supercomputing '07 - PDSW '07  
There is high demand for I/O tracing in High Performance Computing (HPC). It enables in-depth analysis of distributed applications and file system performance tuning.  ...  As a response to this demand for tracing tools, various means of I/O trace generation exist.  ...  data intensive scientific applications.  ... 
doi:10.1145/1374596.1374610 dblp:conf/sc/KonwinskiBNQ07 fatcat:3athzjxm2rdxxgcu42u7tba4na

I/O performance evaluation with Parabench — programmable I/O benchmark

Olga Mordvinova, Dennis Runz, Julian M. Kunkel, Thomas Ludwig
2010 Procedia Computer Science  
Application access patterns reflect different I/O behavior and can be used for performance testing. This paper presents the programmable I/O benchmarking tool Parabench.  ...  Choosing an appropriate cluster file system for a specific high performance computing application is challenging and depends mainly on the specific application I/O needs.  ...  Acknowledgment The authors would like to thank the members of the SAP development team TREX, in particular to Christian Bartholomä and Oleksandr Shepil for their technical advices in studing OLAP I/O,  ... 
doi:10.1016/j.procs.2010.04.238 fatcat:uphtltdkkbg4hkwvmoh76uq2v4

An experimental evaluation of I/O optimizations on different applications

M.A. Kandaswamy, M. Kandemir, A. Choudhary, D. Bernholdt
2002 IEEE Transactions on Parallel and Distributed Systems  
First, we want to understand the behavior of large-scale data-intensive applications and the impact of I/O subsystems on their performance and vice versa.  ...  Index Terms-I/O optimizations, parallel architectures, I/O intensive applications, disk layout, collective I/O.  ...  [32] use an I/O-intensive, three-dimensional parallel application code to evaluate the I/O performances of the IBM SP-2 and the Intel Paragon.  ... 
doi:10.1109/tpds.2002.1019861 fatcat:2npd5thoy5detocy4g4dyrv7hq

An Unsupervised Learning Approach for I/O Behavior Characterization

Pablo J. Pavan, Jean Luca Bez, Matheus S. Serpa, Francieli Zanon Boito, Philippe O. A. Navaux
2019 2019 31st International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD)  
I/O operations are the bottleneck of several applications due to the difference between processing and data access speeds.  ...  Thus, identifying and characterizing the I/O access pattern is important, since it reflects directly on applications' performance.  ...  The access pattern represents the way an application access its data, and it has a direct impact on I/O performance.  ... 
doi:10.1109/sbac-pad.2019.00019 dblp:conf/sbac-pad/PavanBSBN19 fatcat:ig35uy4wjvai3c2nlhvaptp7ou

An experimental evaluation of I/O optimizations on different applications

M.A. Kandaswamy, M. Kandemir, A. Choudhary, D. Bernholdt
2002 IEEE Transactions on Parallel and Distributed Systems  
First, we want to understand the behavior of large-scale data-intensive applications and the impact of I/O subsystems on their performance and vice versa.  ...  Index Terms-I/O optimizations, parallel architectures, I/O intensive applications, disk layout, collective I/O.  ...  [32] use an I/O-intensive, three-dimensional parallel application code to evaluate the I/O performances of the IBM SP-2 and the Intel Paragon.  ... 
doi:10.1109/tpds.2002.1158267 fatcat:l6hxfd4mnrdmtpiedzx4osrwgy

In-situ I/O processing

Fang Zheng, Hasan Abbasi, Jianting Cao, Jai Dayal, Karsten Schwan, Matthew Wolf, Scott Klasky, Norbert Podhorszki
2011 Proceedings of the sixth workshop on Parallel Data Storage - PDSW '11  
I/O graphsthat combine data movement with 'in transit' operations on data as it is being moved across the I/O hierarchy.  ...  This paper argues for flexibility in the implementation of such in-situ data analytics, using measurements and a performance model that demonstrate the potential advantages and limitations of performing  ...  Section IV reports performance results on constructing and accelerating I/O processing for a large-scale scientific application on Oak Ridge National Laboratory's Cray XT5 platform, which demonstrates  ... 
doi:10.1145/2159352.2159362 fatcat:2644earqanf3rixptfmgjampxa

Interval Based I/O: A New Approach to Providing High Performance Parallel I/O

Jeremy Logan, Phillip Dickens
2011 2011 40th International Conference on Parallel Processing Workshops  
Providing scalable, high-performance parallel I/O for data-intensive computations is beset by a number of difficult challenges.  ...  The most often cited difficulties include the non-contiguous I/O patterns prominent in scientific codes, the lack of support for parallel I/O optimizations in POSIX, the high cost of providing strict file  ...  We believe that aligning these two different data models will significantly enhance the performance of parallel I/O for data-intensive scientific applications.  ... 
doi:10.1109/icppw.2011.45 dblp:conf/icppw/LoganD11 fatcat:jvs4vr72lbd75jxdhvcbjugdgq

Scalable I/O and analytics

Alok Choudhary, Wei-keng Liao, Kui Gao, Arifa Nisar, Robert Ross, Rajeev Thakur, Robert Latham
2009 Journal of Physics, Conference Series  
These applications are highly I/O and data intensive, leading scientists to observe that performing I/O and subsequent analyses are major bottlenecks in effectively utilizing peta-scale systems and a major  ...  In this work we outline our recent achievements and current research for designing scalable I/O software and enabling data analytics in storage systems.  ...  We evaluate this subfiling scheme using two scientific production application I/O kernels, FLASH-IO and S3D-IO.  ... 
doi:10.1088/1742-6596/180/1/012048 fatcat:q3fkb774vnewdgr7e3dayvl2bq

Performance Analysis of an I/O-Intensive Workflow Executing on Google Cloud and Amazon Web Services

Hassan Nawaz, Gideon Juve, Rafael Ferreira Da Silva, Ewa Deelman
2016 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)  
In this paper, we conduct an analysis of the performance of an I/O-intensive real scientific workflow on cloud environments using makespan (the turnaround time for a workflow to complete its execution)  ...  Lastly, we also suggest modifications in the standard cloud storage APIs, which will reduce the makespan for I/O-intensive workflows.  ...  We thank Karan Vahi and Mats Rynge for their valuable help.  ... 
doi:10.1109/ipdpsw.2016.90 dblp:conf/ipps/NawazJSD16 fatcat:n6uytkmdabdt3bdzflevu7slxa

Semantics-based distributed I/O for mpiBLAST

Pavan Balaji, Wu-chun Feng, Jeremy Archuleta, Heshan Lin, Rajkumar Kettimuthu, Rajeev Thakur, Xiaosong Ma
2008 Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming - PPoPP '08  
Thus, we present ParaMEDIC-a novel environment that uses applicationspecific semantic information to compress I/O data and improve performance in distributed environments.  ...  While mpiBLAST has been shown to achieve high performance in clusters with fast local filesystems, its I/O processing remains a concern for scalability, especially in systems having limited I/O capabilities  ...  In this paper, we presented ParaMEDIC-an environment that uses application-specific semantic information to compress I/O data and improve performance in distributed environments.  ... 
doi:10.1145/1345206.1345262 dblp:conf/ppopp/BalajiFALKTM08 fatcat:jugxa4vmenhmjcgyqbikuqapru

A new approach to I/O performance evaluation: self-scaling I/O benchmarks, predicted I/O performance

Peter M. Chen, David A. Patterson
1994 ACM Transactions on Computer Systems  
an I\O request.  ...  There is therefore an increased need to understand and compare the performance of 1/0 systems, hence the need for I/O-intensive benchmarks.  ...  Graphs for the third plateau are shown in Figure 19 . The focal point for uniqueBytes is 2 MIB in graphs (a)-(d) and 15 MB in graphs (O-(i) .  ... 
doi:10.1145/195792.195812 fatcat:ge3dq7gp6nf77hpiysacy356zu

I/O performance of virtualized cloud environments

Devarshi Ghoshal, Richard Shane Canon, Lavanya Ramakrishnan
2011 Proceedings of the second international workshop on Data intensive computing in the clouds - DataCloud-SC '11  
mid-range computing and data-intensive applications which are not served through existing DOE centers today.  ...  The scientific community is exploring the suitability of cloud infrastructure to handle High Performance Computing (HPC) applications.  ...  This can have a significant impact on overall application performance for I/O intensive applications.  ... 
doi:10.1145/2087522.2087535 fatcat:56sccsweynca5h3ducxi6o33uy

Diskdirected I/O for MIMD Multiprocessors [chapter]

2009 High Performance Mass Storage and Parallel I/O  
We propose a new technique, disk-directed I/O, to allow the disk servers to determine the flow of data for maximum performance. Our simulations show that tremendous performance gains are possible.  ...  Many scientific applications that run on today's multiprocessors, such as weather forecasting and seismic analysis, are bottlenecked by their file-I/O needs.  ...  Acknowledgements Thanks to Song Bac Toh and Sriram Radhakrishnan for implementing and validating the disk model; to Chris Ruemmler, John Wilkes, and Hewlett Packard Corporation for allowing us to use their  ... 
doi:10.1109/9780470544839.ch35 fatcat:vncne37s6rg4jkpff2w2op27dm

Boosting Application-Specific Parallel I/O Optimization Using IOSIG

Yanlong Yin, Surendra Byna, Huaiming Song, Xian-He Sun, Rajeev Thakur
2012 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)  
The signatures include local I/O behavior for each process and global behavior for an overall application. We illustrate the usage of the IOSIG tool in data prefetching and data layout optimizations.  ...  The tool enables tracing parallel I/O calls of an application and analyzing the collected information to provide a clear understanding of I/O behavior of the application.  ...  The authors are also grateful to anonymous reviewers for their valuable comments and suggestions.  ... 
doi:10.1109/ccgrid.2012.136 dblp:conf/ccgrid/YinBSST12 fatcat:phdsllr3jvasvptwkqizgbmsay

Toward Understanding I/O Behavior in HPC Workflows

Jakob Luttgau, Shane Snyder, Philip Carns, Justin M. Wozniak, Julian Kunkel, Thomas Ludwig
2018 2018 IEEE/ACM 3rd International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems (PDSW-DISCS)  
I/O performance is not usually accounted for in workflow telemetry reported to users.  ...  In this paper, we present an approach to augment the I/O efficiency of the individual tasks of workflows by combining workflow description frameworks with system I/O telemetry data.  ...  Tigres also was evaluated for use with I/O-intensive workflows, but a facility within the workflow engine to capture I/O behavior is missing.  ... 
doi:10.1109/pdsw-discs.2018.00012 dblp:conf/sc/LuttgauSCWK018 fatcat:rjlmvxiefbfrznlcu4p226kdwu
« Previous Showing results 1 — 15 out of 22,579 results