Filters








364,695 Hits in 5.8 sec

Flexible Download Time Analysis of Coded Storage Systems

Qiqi Shuai, Victor O.K. Li
2016 Proceedings of the 9th ACM International on Systems and Storage Conference - SYSTOR '16  
Introduction and Motivation Download time is a key performance metric in distributed storage systems since it greatly impacts user experience, especially for latency-sensitive applications such as Google  ...  These tradeoffs can be used to meet the latency constraints on content download in distributed storage systems.  ... 
doi:10.1145/2928275.2933278 dblp:conf/systor/ShuaiL16 fatcat:zsncimquqzakbogcko3kufc2tm

Pwrake

Masahiro Tanaka, Osamu Tatebe
2010 Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing - HPDC '10  
data analysis on the Gfarm file system as a case study.  ...  This poster proposes Pwrake, a parallel and distributed flexible workflow management tool based on Rake, a domain specific language for building applications in the Ruby programming language.  ...  parallel execution Distributed FS provides efficient I/O Data Intensive Computing requires Distributed File System Gfarm: a Wide-area Distributed File System  Widely used as a build tool  ... 
doi:10.1145/1851476.1851529 dblp:conf/hpdc/TanakaT10 fatcat:34bnjhzdjjdincgc2qqjnzu64m

VSFS: A Searchable Distributed File System

Lei Xu, Ziling Huang, Hong Jiang, Lei Tian, David Swanson
2014 2014 9th Parallel Data Storage Workshop  
n Larger volume n Higher parallel I/O performance ¤ Flexibility n No fixed data schemas n Support structured and unstructured data Background 4  Original file system concepts are aged  ...  n Build filesystem namespace around file-search API VSFS: A Searchable Distributed File System (Cont'd)  Defines a new file system form (Cont'd) ¤ Enables existing applications to use file system  ...  Hive  Searching as a common facility in file system has shown its performance advantages.  Encourages the applications to take advantage of the search functionality. n Usually it only incurs minimal  ... 
doi:10.1109/pdsw.2014.10 dblp:conf/sc/XuHJTS14 fatcat:ecekbkfsjze3voxzpthoq3tppu

FRIEDA: Flexible Robust Intelligent Elastic Data Management in Cloud Environments

Devarshi Ghoshal, Lavanya Ramakrishnan
2012 2012 SC Companion: High Performance Computing, Networking Storage and Analysis  
The explosion in scientific data coupled with unique characteristics of cloud environments require a more flexible and robust distributed data management solution than the ones currently in existence.  ...  Additionally, we describe a range of data management strategies and show the benefit of flexible data management approaches in cloud environments.  ...  FRIEDA provides more flexible controls on data partitioning, distribution, and computation while executing in a distributed parallel environment.  ... 
doi:10.1109/sc.companion.2012.132 dblp:conf/sc/GhoshalR12 fatcat:ukvd7gdv45gx5ousd6rjjmullm

Flexibility and performance of parallel file systems [chapter]

David Kotz, Nils Nieuwejaar
1996 Lecture Notes in Computer Science  
As we gain experience with parallel file systems, it becomes Ames under agreement numbers NCC 2-849 and NAG 2-936.  ...  6 Related work The Hurricane File System (HFS) [25], a parallel file system for the Hector mul- tiprocessor, is also designed with the philosophy that flexibility is critical for performance  ...  file systems, much more so than building directly on distributed Unix systems.  ... 
doi:10.1007/3-540-61695-0_1 fatcat:vidtowrmird2lcki65kl56jf6y

Resilient and Secure File Dispersal in a Mobile P2P System

Khalid Ashraf, Rachid Anane, Nick Blundell
2011 2011 IEEE Workshops of International Conference on Advanced Information Networking and Applications  
This paper presents an approach to resilient file management and network storage through the design and implementation of a file dispersal system for a mobile P2P network, based on distributed hash tables  ...  The convergence of mobile networks and P2P systems has led to the deployment of a range of schemes for file storage over a network.  ...  The system offers flexibility by providing users with two methods for performing file dispersal to suit environmental conditions.  ... 
doi:10.1109/waina.2011.149 dblp:conf/aina/AshrafAB11 fatcat:aty52s75ufcandwgibyn4z33v4

A Flexible Multiagent Parallel File System for Clusters [chapter]

María S. Perez, Jesús Carretero, Félix García, José M. Peña, Víctor Robles
2003 Lecture Notes in Computer Science  
In this sense, parallel I/O is becoming one of the major topics in the area of high-performance systems.  ...  Many of these applications require access to huge data repositories and other I/O sources, being the I/O phase a bottleneck in the computing systems, due to its poor performance.  ...  The usage of hints related to different aspects of data distribution and access patterns allows parallel file systems to increase the performance of these operations.  ... 
doi:10.1007/3-540-44864-0_26 fatcat:fg3lyqybffd73cyzaveoekuxxi

Scientific Computing Meets Big Data Technology: An Astronomy Use Case [article]

Zhao Zhang, Kyle Barbary, Frank Austin Nothaft, Evan Sparks, Oliver Zahn, Michael J. Franklin, David A. Patterson, Saul Perlmutter
2016 arXiv   pre-print
We present Kira, a flexible and distributed astronomy image processing toolkit using Apache Spark.  ...  With Kira SE as the use case, we study the programming flexibility, dataflow richness, scheduling capacity and performance of Apache Spark running on the EC2 cloud.  ...  Traditionally, distributed workflow systems are run on top of a shared file system.  ... 
arXiv:1507.03325v2 fatcat:ssldp2tk6natbej43qy5ptaphm

A New Framework for Mobile Edge Caching by Proposing Flexible User in Heterogeneous Cellular Networks

Parisa Eslami, Mohammad H. Amerimehr, Seyed Pooya Shariatpanahi
2020 IEEE Access  
The satisfactory criterion for the flexible user is to receive any of the files within the requested set.  ...  set of multiple files from the library with a unique feature, e.g., 5 movies within comedy genre from the library in the peak-traffic duration.  ...  It should be noted that if flexibility index is K = 1, the distribution in (5) reduces to the normal Zipf distribution in (4) .  ... 
doi:10.1109/access.2020.3031964 fatcat:rruzo3yk25bqlchsd4huqwbxgq

The Archive Solution for Distributed Workflow Management Agents of the CMS Experiment at LHC

Valentin Kuznetsov, Nils Leif Fischer, Yuyi Guo
2018 Computing and Software for Big Science  
operators in assessing the performance of the CMS computing system.  ...  The system leverages modern technologies such as a document oriented database and the Hadoop eco-system to provide the necessary flexibility to reliably process, store, and aggregate O(1M) documents on  ...  Special thanks goes to Eric Vaandering (FNAL) for initiating the idea of WMArchive system in CMS and his constant support along development cycle.  ... 
doi:10.1007/s41781-018-0005-0 fatcat:t4o6tejmtzgypnvcwfhzcwkvkq

Generating realisticimpressionsfor file-system benchmarking

Nitin Agrawal, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau
2009 ACM Transactions on Storage  
The performance of file systems and related software depends on characteristics of the underlying file-system image (i.e., file-system metadata and file contents).  ...  Impressions is flexible, supporting user-specified constraints on various file-system parameters using a number of statistical techniques to generate consistent images.  ...  Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of NSF or other institutions.  ... 
doi:10.1145/1629080.1629086 fatcat:miwqzj27k5ay3m7atil3izocui

Orchestra: Extensible Block-Level Support for Resource and Data Sharing in Networked Storage Systems

Michail D. Flouris, Renaud Lachaize, Angelos Bilas
2008 2008 14th IEEE International Conference on Parallel and Distributed Systems  
Current solutions satisfy typically the first two requirements through a distributed file-system, resulting in monolithic, hard-to-manage storage systems.  ...  High-performance storage systems are evolving towards decentralized commodity clusters that can scale in capacity, processing power, and network throughput.  ...  We see that 0FS performs, in the local case, close to current file-systems. Performance of distributed setups Next, we examine the scalability of 0FS in distributed setups.  ... 
doi:10.1109/icpads.2008.110 dblp:conf/icpads/FlourisLB08 fatcat:drpwggtmdvdyhb6cqriwbcq6nm

A Flexible High Demand Storage System for MAGIC-I and MAGIC-II using GFS [article]

E. Carmona, J.A. Coarasa, M. Barcelo, for the MAGIC Collaboration
2009 arXiv   pre-print
To deal with the large storage requirements of MAGIC-I and MAGIC-II, we have installed the distributed file system GFS and a cluster of computers with concurrent access to the same shared storage units  ...  The system can not only handle a sustained DAQ write rate above 1.2 kHz for MAGIC-I, but also allows other nodes to perform simultaneous concurrent access to the data on the shared storage units.  ...  Flexibility Cluster configuration is contained in a single file that is identical in all nodes belonging to the cluster.  ... 
arXiv:0907.1003v1 fatcat:chtc46qiuvhotoifk6ngkgaysi

HBA: Distributed Metadata Management for Large Cluster-Based Storage Systems

M S Nirmala
2018 International Journal of Trend in Scientific Research and Development  
Simulation results show our HBA design to be highly effective and efficient in improving the performance and scalability of file systems in clusters with 1,000 to 10,000 nodes (or super clusters) and with  ...  An efficient and distributed scheme for file mapping or file lookup is critical in decentralizing metadata management within a group of metadata servers.  ...  introduced by HBA is minute in modern fast networks. We have implemented our HBA design in Linux and measured its performance in a real cluster.  ... 
doi:10.31142/ijtsrd18211 fatcat:njosmsgasjavxekegex4dijw4y

A comparative finite analysis of the mechanical behavior of ProTaper NEXT and WaveOne rotary files

Nada Omar, Amira Galal Ismail, Manar Galal, Mohamed H. Zaazou, Mohamed Abdullah Mohamed
2019 Bulletin of the National Research Centre  
The mathematical analysis of files was performed on SolidWorks software package.  ...  The mechanical behavior of the two files was analyzed numerically in a SolidWorks package to simulate and measure torsion, bending, and file displacement.  ...  The degree of flexibility of NiTi rotary instruments is a crucial property in predicting the mechanical behavior and performance of endodontic instruments during the preparation of curved canals (Lopes  ... 
doi:10.1186/s42269-019-0183-x fatcat:nfzv6eiizfa4ffy3yigfntohty
« Previous Showing results 1 — 15 out of 364,695 results