101,882 Hits in 5.9 sec

Data management and transfer in high-performance computational grid environments

Bill Allcock, Joe Bester, John Bresnahan, Ann L. Chervenak, Ian Foster, Carl Kesselman, Sam Meder, Veronika Nefedova, Darcy Quesnel, Steven Tuecke
2002 Parallel Computing  
We describe here two services that we believe are fundamental to any Data Grid: reliable, high-speed transport and replica management.  ...  Our replica management service integrates a replica catalog with GridFTP transfers to provide for the creation, registration, location, and management of dataset replicas.  ...  This work was supported in part by the Mathematical, Information, and Computational Sciences Division subprogram of the Office of Advanced Scientific Computing Research, U.S.  ... 
doi:10.1016/s0167-8191(02)00094-7 fatcat:hodirpw6sjad5nn6d62mbk2que

Implementation of Computational Grid Services in Enterprise Grid Environments

R.J.A. Richard, Ajay Anant Joshi, C. Eswaran
2008 American Journal of Applied Sciences  
Grid Computing refers to the development of high performance computing environment or virtual super computing environment by utilizing available computing resources in a LAN, WAN and Internet.  ...  The emergence of Global Grid concept provides an excellent opportunity for Grid based e-Science applications to use high performance super computing environments.  ...  Rajkumar Buyya and other Alchemi team members through online grid users' forum is appreciated.  ... 
doi:10.3844/ajassp.2008.1442.1447 fatcat:3o57stf77vg3nahcc3zlfvv5qi

Performance engineering in data Grids

Erwin Laure, Heinz Stockinger, Kurt Stockinger
2005 Concurrency and Computation  
In this paper we present performance engineering techniques that aim to facilitate an efficient use of Grid systems, in particular systems that deal with the management of large scale data sets in the  ...  Having discussed important performance engineering techniques we investigate how major Grid projects deal with performance issues particularly related to Data Grids and how they implement the techniques  ...  ACKNOWLEDGEMENTS We would like to thank our colleagues from the EU DataGrid project for their support throughout this work and many stimulating discussions as well as Ian Willers (CERN) for proofreading  ... 
doi:10.1002/cpe.923 fatcat:7pry35r3cfh6zaejtterofhalm

A Study on TCP Buffer Management Algorithm for Improvement of Network Performance in Grid Environment [chapter]

Yonghwan Jeong, Minki Noh, Hyewon K. Lee, Youngsong Mun
2004 Lecture Notes in Computer Science  
The Grid is the environment that connects high performance computing resource, which are scattered geographically as related network.  ...  Nevertheless, the Grid network envionment are consists of high speed researches, it uses network management method of former old internet envionment, and it cannot take the full advantage of high performance  ...  This study is improving performance of traffic transfer for GridFTP in grid network of high performance and TCP buffer management for many concurrent TCP connection controls.  ... 
doi:10.1007/978-3-540-24688-6_39 fatcat:cd6dk66nv5bnfmn45zloryw3h4

Network Storage Management in Data Grid Environment [chapter]

Shaofeng Yang, Zeyad Ali, Houssain Kettani, Vinti Verma, Qutaibah Malluhi
2004 Lecture Notes in Computer Science  
NSM is designed as a Java-based, high-performance, distributed storage system, which can be utilized in the Grid environment.  ...  Therefore, the system can run in a typical heterogeneous Grid environment. We illustrates how NSM incorporates Grid-FTP and GSI authentication.  ...  For NSM to run in the grid environment, it has to support this standard Grid data transfer protocol.  ... 
doi:10.1007/978-3-540-24680-0_138 fatcat:dyzgpot2yrg5vgti4si7mlorii

Information Retrieval: Today and Tomorrow

Varsha Kumari, Sandhya Pundhir, Supreet Kaur
2015 International Journal of Computer Applications  
The analysis is based on the Information Retrieval in distributed environments, grid and the cloud environments. Different crawling techniques in these environments are also discussed in this paper.  ...  Information Retrieval involves the searching and retrieval of knowledge from large database collections. In this paper, the analysis and comparison of the IR techniques is done.  ...  In contrast, Grids have a number of these high level services for instant data transfer and metadata search [8] .  ... 
doi:10.5120/20291-2661 fatcat:nisk2omrp5eh5n4cvep4riuysq

Content Based Data Transfer Mechanism for Efficient Bulk Data Transfer in Grid Computing Environment

N Thenmozhi
2011 International Journal of Grid Computing & Applications  
In this paper, we address an application layer content based data transfer scheme for grid computing environments.  ...  By using the proposed scheme in a grid computing environment, we can simultaneously move bulk data in an efficient way using simple subscribe and publish mechanism.  ...  Dickens, and Illino [21] discussed about a high performance file transfer mechanism for grid computing to achieve excellent performance in a computational grid and he used the concept of Lightweight  ... 
doi:10.5121/ijgca.2011.2405 fatcat:p7wiy4vswnfeplnlxauppqkhvm

Components and workflow based Grid programming environment for integrated image-processing applications

Hai Jin, Ran Zheng, Qin Zhang, Ying Li
2006 Concurrency and Computation  
With the development of high-performance computing technologies, Grid computing has emerged as a new infrastructure for applications with resource integration.  ...  However, some obstacles for the prevalence of Grid and Grid application developments are still to be overcome, which is largely due to the immature Gridenabled computing environment and its geographically  ...  tasks, affording high-performance computing and resource-sharing services, which bridges the gap between professional image processing and high-performance computing.  ... 
doi:10.1002/cpe.1034 fatcat:fvvitpd56fezpjblfkkcoo6wsq

DotGrid: a .NET-based cross-platform software for desktop grids

Alireza Poshtkohi, Ali Haj Abutalebi, Shaahin Hessabi
2007 International Journal of Web and Grid Services  
DotGrid is the first comprehensive desktop grid software utilising Microsoft's .NET Framework in Windows-based environments and MONO .NET in Unix-class operating systems to operate.  ...  Using DotGrid services and APIs, grid desktop middleware and applications can be implemented conveniently. We evaluated our DotGrid's performance by implementing a set of grid-based applications.  ...  computers in grid and cluster environments.  ... 
doi:10.1504/ijwgs.2007.014955 fatcat:wzy46falcbevfarunavlzfegrm

A Framework for Data Management and Transfer in Grid Environments [chapter]

Haojie Zhou, Xingwu Liu, Liqiang Cao, Li Zha
2006 Lecture Notes in Computer Science  
In this paper, we propose a grid file management system called Vega [1][2] Hotfile2 for data-intensive application in widely distributed systems and grid environments.  ...  Presented here are two services that we believe are fundamental to any grid file management system: high-performance, secure transport and metadata management.  ...  Based on HTTP, control channel and data transfer channel in Hotfile2 solve the firewall problem, and our protocol achieves better performance in transferring small and middle files comparing to GridFTP  ... 
doi:10.1007/11802167_54 fatcat:sr4umgkzergc3p7gmdftkan6y4

Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing

Bill Allcock, Joe Bester, John Bresnahan, Ann Chervenak, Carl Kesselman, Sam Meder, Veronika Nefedova, Darcy Quesnel, Steven Tuecke, Ian Foster
2001 Mass Storage Systems and Technologies(MSS), Proceedings of the NASA Goddard Conference on  
After studying data-intensive, high-performance computing applications such as highenergy physics and climate modeling, we conclude that these applications require two fundamental data management services  ...  : secure, reliable, efficient transfer of data in wide area environments and the ability to register and locate multiple copies of data sets.  ...  Acknowledgements We are grateful to Marcus Thiebaux and Soonwook Hwang for their work in characterizing the performance of LDAP servers.  ... 
doi:10.1109/mss.2001.10001 dblp:conf/mss/AllcockBBCKMNQT01 fatcat:jnfurycdb5cm5o7khbgd5kvq4y

Distributed Data Mining on Grids: Services, Tools, and Applications

M. Cannataro, A. Congiusta, A. Pugliese, D. Talia, P. Trunfio
2004 IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics)  
Data mining algorithms are widely used today for the analysis of large corporate and scientific datasets stored in databases and data archives.  ...  The grid can play a significant role in providing an effective computational support for distributed knowledge discovery applications.  ...  ACKNOWLEDGMENT The authors wish to thank the organizations involved in the MIUR SP3 project that offered their machines for running the experiments discussed in this paper.  ... 
doi:10.1109/tsmcb.2004.836890 pmid:15619945 fatcat:rk5sqabry5h5va4bymk6cyv4ou

End-To-End Cache System for Grid Computing: Design and Efficiency Analysis of a High-Throughput Bioinformatic Docking Application

Jose Ignacio Garzon, Eduardo Huedo, Ruben Santiago Montero, Ignacio Martin Llorente, Pablo Chacon
2009 The international journal of high performance computing applications  
Parallel Grid adaptation of many high-throughput computing applications that use the same data intensively could enjoy great benefits from our cache system.  ...  Cache techniques are an efficient tool to reduce latency times in transfer operations through Grid systems.  ...  manage Grid environments.  ... 
doi:10.1177/1094342009350469 fatcat:fpecwepznfd5nmp5s4n53ogj5q

DotGrid: A .NET-based cross-platform Grid computing infrastructure

Ali Haj Abutalebi, Alireza Poshtkuhi, Leila Mahmoudi Ayough, Shaahin Hessabi
2006 2006 International Conference on Computing & Informatics  
We evaluated DotGrid capabilities by implementing some applications including a high throughput file transfer and solving a typical computational problem.  ...  Our DotGrid has been developed based on Microsoft .NET in Windows and MONO .NET in Linux and UNIX. Using DotGrid APIs, Grid middlewares and applications can be implemented easily.  ...  This approach is suitable for some data-intensive Grid environments such as large file transfers with parallel data transfer mechanisms and high-energy physics applications. 4) Partial file transfers:  ... 
doi:10.1109/icoci.2006.5276479 fatcat:t5nbdupg3bcbfke35c6qx5w3hm

Towards a sophisticated grid workflow development and computing environment

T. Fahringer
2006 Proceedings 20th IEEE International Parallel & Distributed Processing Symposium  
onto the Grid, explicitly specify data transfer operations, etc.  ...  While Grid infrastructures can provide massive compute and data storage power, it is still an art to effectively harness the power of Grid computing.  ...  onto the Grid, explicitly specify data transfer operations, etc.  ... 
doi:10.1109/ipdps.2006.1639492 dblp:conf/ipps/Fahringer06 fatcat:n72mynvluzgbxj3uxfr2revlcm
« Previous Showing results 1 — 15 out of 101,882 results