Filters








5,769 Hits in 4.5 sec

A Metadata Catalog Service for Data Intensive Applications

Gurmeet Singh, Shishir Bharathi, Ann Chervenak, Ewa Deelman, Carl Kesselman, Mary Manohar, Sonal Patil, Laura Pearlman
2003 Proceedings of the 2003 ACM/IEEE conference on Supercomputing - SC '03  
In this paper, we present the design of a Metadata Catalog Service (MCS) that provides a mechanism for storing and accessing descriptive metadata and allows users to query for data items based on desired  ...  There are various types of metadata, and it is likely that a range of metadata services will exist in Grid environments that are specialized for particular types of metadata cataloguing and discovery.  ...  Acknowledgments This research was supported in part by the National Science Foundation under grants ITR-0086044(GriPhyN) and ITR AST0122449 (NVO) and the DOE Cooperative Agreements: DE-FC02-01ER25449 (SciDAC-DATA  ... 
doi:10.1145/1048935.1050184 dblp:conf/sc/SinghBCDKMPP03 fatcat:walreagoszecvepimpq7rumr4m

Metadata Management in the EU DataGrid

Gavin McCance
2003 Metadata Management in Grid and P2P Systems  
the data are always near the compute resources -for data hungry applications b) Earth Observation/Medical -convenient mechanism for logical namespace.  ...  memory intensive hash WSDL interfaces Scalability achieved by: Each site has a Local Replica Catalog LRC containing mappings for files located at the given site Each site runs a Replica Location Index  ...  Application Specific General Metadata Future Work Plan to work together with DAIS working group of GGF to ensure that our services can be re-factored into DAIS-compliant services.  ... 
dblp:conf/mmgps/McCance03 fatcat:umuekjtu3narzmsrarf43bxjiq

Page 282 of Library Resources & Technical Services Vol. 51, Issue 4 [page]

2007 Library Resources & Technical Services  
than is customary for catalog records.  ...  The level of expertise in a certain subject area may not be resident in a technical services or cataloging department.  ... 

Data management and transfer in high-performance computational grid environments

Bill Allcock, Joe Bester, John Bresnahan, Ann L. Chervenak, Ian Foster, Carl Kesselman, Sam Meder, Veronika Nefedova, Darcy Quesnel, Steven Tuecke
2002 Parallel Computing  
Our replica management service integrates a replica catalog with GridFTP transfers to provide for the creation, registration, location, and management of dataset replicas.  ...  So-called Data Grids provide essential infrastructure for such applications, much as the Internet provides essential services for applications such as e-mail and the Web.  ...  , Laura Pearlman and Ewa Deelman for comments on this paper; and to the many colleagues in the sciences who helped us understand their requirements.  ... 
doi:10.1016/s0167-8191(02)00094-7 fatcat:hodirpw6sjad5nn6d62mbk2que

Data Management Challenges of Data-Intensive Scientific Workflows

Ewa Deelman, Ann Chervenak
2008 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID)  
However, many challenges remain in the area of data management related to workflow creation, execution, and result management.  ...  The authors would like to thank the ESG, LIGO, Montage, and SCEC collaborators for helpful discussions and fruitful collaborations.  ...  The Metadata Catalog Service [18] provides a set of generic and extensible metadata attributes.  ... 
doi:10.1109/ccgrid.2008.24 dblp:conf/ccgrid/DeelmanC08 fatcat:npefcon3tfftnku65yfnufrwey

Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing

Bill Allcock, Joe Bester, John Bresnahan, Ann Chervenak, Carl Kesselman, Sam Meder, Veronika Nefedova, Darcy Quesnel, Steven Tuecke, Ian Foster
2001 Mass Storage Systems and Technologies(MSS), Proceedings of the NASA Goddard Conference on  
After studying data-intensive, high-performance computing applications such as highenergy physics and climate modeling, we conclude that these applications require two fundamental data management services  ...  : secure, reliable, efficient transfer of data in wide area environments and the ability to register and locate multiple copies of data sets.  ...  Acknowledgements We are grateful to Marcus Thiebaux and Soonwook Hwang for their work in characterizing the performance of LDAP servers.  ... 
doi:10.1109/mss.2001.10001 dblp:conf/mss/AllcockBBCKMNQT01 fatcat:jnfurycdb5cm5o7khbgd5kvq4y

Data and Metadata Collections for Scientific Applications [chapter]

Arcot K. Rajasekar, Reagan W. Moore
2001 Lecture Notes in Computer Science  
catalogs, digital library services for manipulating data sets, and data grids for federating multiple collections.  ...  Moreover, the importance of metadata is coming to the fore, as a means of not only discovering datasets of interest but also for organizational purposes.  ...  -96-C-0020 "Distributed Object Computation Testbed," the Data Intensive Computing thrust area of the NSF project ASC 96-19020 "National Partnership for Advanced Computational Infrastructure," the NASA  ... 
doi:10.1007/3-540-48228-8_8 fatcat:4g4b6mie4fh5po4ertr4qu4k3i

Architecture of Distributed Data Aggregation Service

Vlad Serbanescu, Florin Pop, Valentin Cristea, Gabriel Antoniu
2014 2014 IEEE 28th International Conference on Advanced Information Networking and Applications  
In this paper we present a Distributed Data Aggregation Service relying on a storage system designed to meet these demands, namely BlobSeer.  ...  We implemented a client providing a formal description for the data retrieval queries and a specification for a search API.  ...  ACKNOWLEDGMENT The research presented in this paper is supported by projects: "SideSTEP -Scheduling Methods for Dynamic Dis- We would like to thank the reviewers for their time and expertise, constructive  ... 
doi:10.1109/aina.2014.89 dblp:conf/aina/SerbanescuPCA14 fatcat:5ulyl2fnpjavbdmdamxijpwnee

Making Metadata Maker: A Web Application for Metadata Production

Myung-Ja Han, Nicole Ream-Sotomayor, Patricia Lampron, Deren Kudeki
2016 Library resources & technical services  
To improve the cataloging and metadata creation workflow, the University of Illinois at Urbana-Champaign Library developed a web application, Metadata Maker, which allows anyone to create metadata in four  ...  different formats, including MARC21 for an online public access catalog, regardless of their familiarity with metadata standards or systems that utilize the metadata.  ...  will be reviewed by a cataloger, using the data field 500 for all notes works for UIUC's local purposes and makes the application more user friendly for non-catalogers.  ... 
doi:10.5860/lrts.60n2.89 fatcat:n3vqllji7nemrouzrmkl4lg2wu

The Roles of the Metadata Librarian in a Research Library

John W. Chapman
2007 Library resources & technical services  
Many institutions have placed the position of a metadata librarian within a traditional cataloging or technical services department.  ...  of data description into the traditional technical services workflow." 5 The  ...  As was mentioned earlier, in many cases creating descriptive records for digital resources requires more intensive description than is customary for catalog records.  ... 
doi:10.5860/lrts.51n4.279 fatcat:bg6wi2fokvdojcxnxjcghghnye

A Semantic Metadata Catalog Service for Grid [chapter]

Kewei Wei, Ming Zhang, Yaping Zhu
2005 Lecture Notes in Computer Science  
Metadata is the information that describes the most important feature of an object. In recent years, metadata plays a more and more important role in data intensive applications.  ...  In this paper, we propose a semantic metadata catalog service, Semantic MCS. Semantic MCS has a well-organized data management model and supports the query mechanism using Ontology inference.  ...  MCAT is designed as a central catalog for the metadata of data files. It supports logical name space that is independent from the physical name space.  ... 
doi:10.1007/11590354_18 fatcat:ighumkgwindonls2irrgu3xnfm

How to Implement a Governmental Open Source Geoportal

Saeidi Anjileh Mehdi, Madad Ali, Ghasemlou Nima, Rezaie Zahra, Saeidi Reyhaneh, Baktash Peyman
2014 Journal of Geographic Information System  
These kinds of search abilities are called "Geoportal", which provides client applications that use several geo services such as catalogs and web map services.  ...  In this study we present an overall concept of service oriented architecture and its consequence web service specifications and eventually web catalog services which are fundamentals of developing a geoportal  ...  The second one is a Catalog server (in this case Geo Network) which works upon CSW (Catalog Service for Web) service specification.  ... 
doi:10.4236/jgis.2014.64025 fatcat:nt3qoi6ghrhz5a7kw3yel6efw4

Efficient Metadata Generation to Enable Interactive Data Discovery over Large-Scale Scientific Data Collections

Sangmi Lee Pallickara, Shrideep Pallickara, Milija Zupanski, Stephen Sullivan
2010 2010 IEEE Second International Conference on Cloud Computing Technology and Science  
Users must select a reliable data publisher from the large collection of data services available over the Internet.  ...  Because scientific datasets are often encoded as binary data formats, querying or validating missing data over hundreds of Megabytes of a binary file involves a compute intensive decoding process.  ...  The Metadata Catalog Service (MCS) [17] and MCAT Metadata Catalog associated with iRODS manage metadata for scientific datasets.  ... 
doi:10.1109/cloudcom.2010.99 dblp:conf/cloudcom/PallickaraPZS10 fatcat:t46mzsikgzdnzndwjvon6qo6de

Apache Science Data Analytics Platform [article]

Thomas Huang
2018 Figshare  
Its goal is to create a community-supported, integrated platform for big geospatial data analysis using Cloud computing technology.  ...  The Apache Science Data Analytics Platform (SDAP) (http://sdap.incubator.apache.org) is a suite of Big Data solutions created through the support of the NASA Advanced Information Technology (AIST) and  ...  , data centers need to do more than just storing bits Giovanni: A web-based application for visualize, analyze, and access vast amounts of Earth science remote sensing data without having to download  ... 
doi:10.6084/m9.figshare.5786421.v1 fatcat:mhrixgkxcfhpzlsuzgr5mkdmgu

Data Management Systems for Scientific Applications [chapter]

Reagan W. Moore
2001 IFIP Advances in Information and Communication Technology  
catalogs, digital library services for manipulating data sets, and data grids for federating multiple collections.  ...  Examples of the application of the technology include distributed collections and data grids for astronomical sky surveys, high energy physics data collections, and art image digital libraries.  ...  -96-C-0020 "Distributed Object Computation Testbed," the Data Intensive Computing thrust area of the NSF project ASC 96-19020 "National Partnership for Advanced Computational Infrastructure," the NASA  ... 
doi:10.1007/978-0-387-35407-1_16 fatcat:sybifglanjdwbksemco6hzccjm
« Previous Showing results 1 — 15 out of 5,769 results