22,625 Hits in 6.2 sec

Optorsim: A Grid Simulator for Studying Dynamic Data Replication Strategies

William H. Bell, David G. Cameron, A. Paul Millar, Luigi Capozza, Kurt Stockinger, Floriano Zini
2003 The international journal of high performance computing applications  
We detail the design and implementation of OptorSim and analyse various replication algorithms based on different Grid workloads.  ...  Replication, creating geographically disparate identical copies of data, is regarded as one of the major optimisation techniques for reducing data access costs.  ...  Acknowledgments The authors thank Erwin Laure and Heinz Stockinger for valuable discussions during the preparation of this paper.  ... 
doi:10.1177/10943420030174005 fatcat:nwfuoyvggjaitjbm5pqdhohgii

Simulation of Dynamic Grid Replication Strategies in OptorSim [chapter]

William H. Bell, David G. Cameron, Luigi Capozza, A. Paul Millar, Kurt Stockinger, Floriano Zini
2002 Lecture Notes in Computer Science  
Replication is regarded as one of the major optimisation techniques for providing fast data access. Within this paper, several replication algorithms are studied.  ...  In contrast, Data Grids mostly deal with large computational problems that in turn require evaluating and mining large amounts of data.  ...  Acknowledgements We want to thank Erwin Laure and Heinz Stockinger for valuable discussions during the preparation of this paper.  ... 
doi:10.1007/3-540-36133-2_5 fatcat:a2eckrkhjnakvovkcblqiiof6y

TBHR: A Dynamic Data Management in Grid Computing

Ms. Prema. R
2019 International Journal for Research in Applied Science and Engineering Technology  
Day by day the size of the data in data grid is increasing more than Terabytes. Accessing such huge sized data is a serious challenge to network and Grid designers.  ...  A data grid connects huge numbers of computers which is located various places all over the world for sharing data and resources.  ...  The dynamic data management in grid is fully based on the efficiency of data replication and data placement. In a data grid, periodically new data is generated.  ... 
doi:10.22214/ijraset.2019.3372 fatcat:m2ri42hlpfbgxfmtry4db7r26y

Dynamic data replication in LCG 2008

C. Nicholson, D. G. Cameron, A. T. Doyle, A. P. Millar, K. Stockinger
2008 Concurrency and Computation  
To provide performant access to data from high energy physics experiments such as the Large Hadron Collider (LHC), controlled replication of files among grid sites is required.  ...  economic models; third, that grid site policies which allow maximum resource sharing are more effective; and lastly, that dynamic replication is particularly effective when data access patterns include  ...  Varying Dataset Size The ratio of average SE size to total dataset size can be a useful characterisation metric for a data grid, and is here designated D.  ... 
doi:10.1002/cpe.1314 fatcat:lmup7a5r4nga3hy3drtz5fqeym

Two Level Job Scheduling and Data Replication in Data Grid

Somayeh Abdi, Hossein Pedram, Somayeh Mohamadi
2010 International Journal of Grid Computing & Applications  
Objective of dynamic replica strategies is reducing file access time which leads to reducing job runtime.  ...  Additionally, replication of data from primary repositories to other locations can be an important optimization step to reduce the frequency of remote data access.  ...  In section 3, a two layered hierarchical structure is proposed for data grid based on classification of networks, along with a scheduling algorithm and replication algorithm for this structure, Section  ... 
doi:10.5121/ijgca.2010.1103 fatcat:nrzul2dzdjhurc2q5lsdii2msm

The Impact of Data Replication on Job Scheduling Performance in Hierarchical Data Grid

Somayeh Abdi, Hossein Pedram, Somayeh Mohamadi
2010 International Journal on Applications of Graph Theory In wireless Ad Hoc Networks And sensor Networks  
The major bottleneck to supporting fast data access in Grids is the high latencies of Wide Area Networks and Internet.  ...  Objective of dynamic replica strategies is reducing file access time which leads to reducing job runtime.  ...  accessed per job 500 MB Size of single file 50GB Total size of files .  ... 
doi:10.5121/jgraphoc.2010.2302 fatcat:tatboxyzjncuvjmvjgdetrlnta

Data replication strategies with performance objective in data grid systems: a survey

Riad Mokadem, Abdelkader Hameurlain
2015 International Journal of Grid and Utility Computing  
Also, each replication strategy is designed according to the data grid topology for which it was proposed.  ...  In this context, a significant number of replication strategies have been proposed for data grid systems.  ...  Furthermore, most of these strategies are designed for the hierarchical data grid topology.  ... 
doi:10.1504/ijguc.2015.066395 fatcat:agrmpify5vffxp3buk2nwoj3gy

Network and data location aware approach for simultaneous job scheduling and data replication in large-scale data grid environments

Najme Mansouri
2014 Frontiers of Computer Science  
However, replication should be used wisely because the storage size of each Data Grid site is limited.  ...  In addition, we propose a new replica replacement strategy that considers file availability, time of access, access frequency and size of file.  ...  A new data replica replacement algorithm has been proposed on the base of file availability, the last time the replica was requested, number of access, and size of the replica as criteria.  ... 
doi:10.1007/s11704-014-3146-2 fatcat:6us7sudqpvca5pcc7jk2tyt4na

A new decentralized periodic replication strategy for dynamic data grids

Hanene Chettaoui, Faouzi Ben Charrada
2014 Scalable Computing : Practice and Experience  
Data grids provide scalable infrastructure for storage resource and data files management, which support dataintensive applications that need to access to huge amount of data stored at distributed locations  ...  The size of these data can reach the scale of terabytes or even petabytes in many applications.  ...  We designed first an algorithm which selects the best candidate files for replication based on the requests number and the copies number of each file.  ... 
doi:10.12694/scpe.v15i1.969 fatcat:cuvvalmhiffd7a6rd5lpjxuqt4

A Survey for Replica Placement Techniques in Data Grid Environment

Alireza Souri, Amir masoud Rahmani
2014 International Journal of Modern Education and Computer Science  
In data grids, data replication on variant nodes can change some problems such as response time and availability.  ...  Also, in data replication, there are some challenges to finding the best replica efficiently in relation to performance and location of physical storage systems.  ...  There are two types of data replication techniques, namely, static and dynamic.  ... 
doi:10.5815/ijmecs.2014.05.06 fatcat:iafsb4xfsrhubls33mqmxtvmju

Predicting Dynamic Replication based on Fuzzy System in Data Grid [article]

Mahnaz Khojand, Mehdi Fatan Serj, Sevin Ashrafi, Vahideh Namaki
2018 arXiv   pre-print
The new algorithm considers the history usage of files, files size, the level of the sites and free available space for replication and tries to predict future needs and pre replicates them in the resources  ...  Data grid replication is an effective method to achieve efficient and fault tolerant data access while reducing access latency and bandwidth consumption in grids.  ...  Replica layout algorithm selects the optimal node for placing the replica based on the spatio-temporal locality of data access.  ... 
arXiv:1804.02963v2 fatcat:bsfvbntvgzhr7bt6oklrnbpxra

A Survey of File Replication Techniques In Grid Systems

Moslem kaviani, Faezeh Pournaghdali, Mohmood Ahmadi
2015 International Journal of Computer Applications Technology and Research  
Grid is a type of parallel and distributed systems that is designed to provide reliable access to data and computational resources in wide area networks.  ...  Replication is a technique used in grid systems to improve the applications' response time and to reduce the bandwidth consumption.  ...  LALW selects a popular file for replication and calculates a suitable number of copies and grid sites for replication.  ... 
doi:10.7753/ijcatr0407.1003 fatcat:q2wzj4pv45bdhhdj6b2lumitu4

A replication strategy based on swarm intelligence in spatial data grid

Ping Zhang, Kunqing Xie, Xiujun Ma, Xiong Li, Yixian Sun
2010 2010 18th International Conference on Geoinformatics  
Every site in the grid system has a single agent, which is serving as containers for data, following simple rules of behavior and without knowing any global information.  ...  The local interactions and simple action between agents give a fairly optimal replication location solution globally. We carried the experiments using OptorSim for the EU Data Grid Testbed 1.  ...  And in [9] William H.Bell and David G.Cameron detail the design and implementation of OptorSim and analyze various replication algorithms based on different Grid workloads. III.  ... 
doi:10.1109/geoinformatics.2010.5567998 dblp:conf/geoinformatics/ZhangXMLS10 fatcat:6e2qcjcrc5gqhieacwolyqeptu

File Clustering Based Replication Algorithm in a Grid Environment

Hitoshi Sato, Satoshi Matsuoka, Toshio Endo
2009 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid  
We propose a file clustering based replication algorithm for grid file systems.  ...  Replication in grid file systems can significantly improves I/O performance of data-intensive applications.  ...  Acknowledgements This research is supported in part by the MEXT Grantin-Aid for Scientific Research on Priority Areas 18049028 and the JSPS Global COE program entitled "Computationism as Foundation for  ... 
doi:10.1109/ccgrid.2009.73 dblp:conf/ccgrid/SatoME09 fatcat:s7vilr2h6fgwda3aox3kvokzam

Data Replication and the Storage Capacity of Data Grids [chapter]

Silvia Figueira, Tan Trieu
2008 Lecture Notes in Computer Science  
Storage is undoubtedly one of the main resources in data grids, and planning the capacity of storage nodes is an important step in any data-grid design.  ...  We have developed a tool to calculate, for a specific scenario, the minimum capacity required for each storage node in a grid, and we have used this tool to show that different strategies used for data  ...  Since one of the main resources in data grids is storage, planning the capacity of storage nodes is a key part of a data-grid design. This paper focuses on storagecapacity planning for data grids.  ... 
doi:10.1007/978-3-540-92859-1_50 fatcat:rbioxi4tizdb7ijgn6csd2as2i
« Previous Showing results 1 — 15 out of 22,625 results