3,355 Hits in 5.3 sec

Grid Services for Fast Retrieval on Large Multidimensional Databases [chapter]

Peter Baumann
2001 Lecture Notes in Computer Science  
Fast, user-centric access to and evaluation of large supercomputing results is a well-recognised problem among compute and data service providers.  ...  Implementation of this platform relies on the multidimensional database system RasDaMan. Evaluation covers all major application fields by HPC centres with in-depth experience in their resp. field.  ...  The RasDaMan Array DBMS The goal of the RasDaMan DBMS is to provide database services on general MDD structures in a domain-independent way.  ... 
doi:10.1007/3-540-48228-8_82 fatcat:afsnd6rlyneophjszu7diznfwu

A Blocky and Layered Management Schema for Remote Sensing Data

Beibei Yang, Rui Wang, Wen Zhang, Chenhan Wu, Xujin Wang, Lingkui Meng
2020 IEEE Access  
on demand.  ...  Based on a discrete global grid, this paper studies the blocky division method and coding specification of Google S2 and then accomplishes the layered storage of remote sensing data in HBase.  ...  The authors would like to thank the anonymous reviewers for their valuable comments.  ... 
doi:10.1109/access.2020.2997519 fatcat:jvtnnfuambb5lctwl4tchra244

An efficient storage and service method for multi-source merging meteorological big data in cloud environment

Ming Yang, Wenchun He, Zhiqiang Zhang, Yongjun Xu, Heping Yang, Yufeng Chen, Xiaolong Xu
2019 EURASIP Journal on Wireless Communications and Networking  
In this study, an efficient storage and service method for multidimensional meteorological data is designed based on NoSQL big data storage technology and the multidimensional characteristics of meteorological  ...  In service, heterogeneous NoSQL common components are designed to improve the heterogeneity of the NoSQL database.  ...  requires retrieving a multidimensional time series of that location.  ... 
doi:10.1186/s13638-019-1576-0 fatcat:dzzuf2gjqzfzvjo5v72v5peqom

The Grids Python Tool for Querying Spatiotemporal Multidimensional Water Data

Riley Chad Hales, E. James Nelson, Gustavious P. Williams, Norman Jones, Daniel P. Ames, J. Enoch Jones
2021 Water  
Water data are frequently stored as multidimensional arrays, also called gridded or raster data, and span two or three spatial dimensions, the time dimension, and other dimensions which vary by the specific  ...  We present a Python package which provides a central interface for efficient access to multidimensional water data regardless of the file format.  ...  For example, SciDB is a relational database model developed for storing and processing multidimensional array data [20] .  ... 
doi:10.3390/w13152066 fatcat:ybtdzano5rbz5hspkwan6xjfz4

Sustainable system design for gridded, spatio-temporal, agroecosystem forecasting models

Paul Roehsner, Kathleen Marie Baker
2016 Journal of Agricultural Informatics  
We compare storage system designs for an expandable crop disease forecasting system that relies on multiple gridded weather forecast inputs to artificial neural network disease risk models.  ...  A traditional relational database management system (PostgreSQL), a NoSQL database system (MongoDB) and a scientific file format version (netCDF) of a single crop disease risk modeling system in one region  ...  Chansheng He at Western Michigan University for their input, editing and technical assistance throughout the project. We also thank our research collaborators Krishna Bondalapati  ... 
doi:10.17700/jai.2016.7.2.269 fatcat:e45e4bvhpjcgxclkaqqmbfxkhy

Fostering Cross-Disciplinary Earth Science Through Datacube Analytics [chapter]

Peter Baumann, Angelo Pio Rossi, Brennan Bell, Oliver Clements, Ben Evans, Heike Hoenig, Patrick Hogan, George Kakaletris, Panagiota Koltsida, Simone Mantovani, Ramiro Marco Figuera, Vlad Merticariu (+4 others)
2018 Earth Observation Open Science and Innovation  
One of the most influential initiatives in EO is EarthServer which has demonstrated new directions for flexible, scalable EO services based on innovative NoSQL  ...  Obviously, goal is to allow users to "ask any question, any time, on any size", thereby enabling them to "build their own product on the go".  ...  In the field of gridded data, Array Databases provide a disruptive innovation for flexible, scalable data-centric services on datacubes.  ... 
doi:10.1007/978-3-319-65633-5_5 fatcat:h4iheb7a3rff7p7v7a67gwackm

Hierarchical Storage Support and Management for Large-Scale Multidimensional Array Database Management Systems [chapter]

Bernd Reiner, Karl Hahn, Gabriele Höfling, Peter Baumann
2002 Lecture Notes in Computer Science  
To combine the advantages of both techniques, storing large amounts of data on tertiary storage media and optimizing data access for retrieval with multidimensional database management systems is the intention  ...  We introduce concepts for efficient hierarchical storage support and management for large-scale multidimensional array database management systems and their integration into the commercial array database  ...  On the other hand, multidimensional database management systems (DBMS) offer efficient retrieval or manipulation of MDDs.  ... 
doi:10.1007/3-540-46146-9_68 fatcat:vxdo3xnd7ngzzgnfvdscyzot64

A grid middleware for data management exploiting peer-to-peer techniques

Athanasia Asiki, Katerina Doka, Ioannis Konstantinou, Antonis Zissimos, Dimitrios Tsoumakos, Nectarios Koziris, Panayiotis Tsanakas
2009 Future generations computer systems  
In this paper, we describe a service-oriented middleware architecture for Grid environments which enables efficient data management.  ...  To ensure fast file lookups in the distributed repositories, our system incorporates a multidimensional indexing scheme which serves the need for supporting both exact match and range queries over a group  ...  Large amounts of audiovisual data are becoming available on the World Wide Web, in broadcast data streams, in personal and business databases.  ... 
doi:10.1016/j.future.2008.09.005 fatcat:tzonh3v7vjcrpe3yoogvr3jrqe

Design and analysis of a multi-dimensional data sampling service for large scale data analysis applications

Xi Zhang, T. Kurc, J. Saltz, S. Parthasarathy
2006 Proceedings 20th IEEE International Parallel & Distributed Processing Symposium  
This new implementation is then bootstrapped on top of our previous implementation, which efficiently samples large datasets along a single dimension (e.g., time), thereby realizing a service for spatio-temporal  ...  Sampling is a widely used technique to increase efficiency in database and data mining applications operating on large dataset.  ...  There has been extensive literature on index structures for multidimensional data access.  ... 
doi:10.1109/ipdps.2006.1639315 dblp:conf/ipps/ZhangKSP06 fatcat:emeykbxpijdtxlqbwdfsid36s4

Relational extensions for OLAP

N. Colossi, W. Malloy, B. Reinwald
2002 IBM Systems Journal  
We also describe Web services for OLAP (online analytical processing) that provide metadata for multidimensional data, as well as XML (Extensible Markup Language) query results.  ...  Enterprises have been storing multidimensional data, using a star or snowflake schema, in relational databases for many years.  ...  Ultimately, this can mean providing different access controls on each cell of a database. • Multidimensional. Multidimensionality is the primary requirement for an OLAP system.  ... 
doi:10.1147/sj.414.0714 fatcat:57kzuk2e5fayxmszuisr6wcfj4

Data webs for earth science data

Asvin Ananthanarayan, Rajiv Balachandran, Robert Grossman, Yunhong Gu, Xinwei Hong, Jorge Levera, Marco Mazzucco
2003 Parallel Computing  
Achieving high performance required developing specialized high performance transport services as well as specialized high performance middleware services for merging multiple data streams.  ...  Data webs complement data grids which are grid based infrastructures designed to support arbitrary distributed computation over distributed data using a trusted computing model.  ...  protocols so that large data sets can be retrieved efficiently.  ... 
doi:10.1016/j.parco.2003.06.002 fatcat:qhxn3vx7evdftffuanbfdmjyhm


2003 Parallel Processing Letters  
In this paper we describe a services oriented software system to provide basic database support for efficient execution of applications that make use of scientific datasets in the Grid.  ...  This system supports two core operations: efficient selection of the data of interest from distributed databases and efficient transfer of data from storage nodes to compute nodes for processing.  ...  MEDIGRID [56] is another project recently initiated in Europe to investigate application of Grid technologies for manipulating large medical image databases.  ... 
doi:10.1142/s0129626403001264 fatcat:3xasfxkq3ncttavs4vztlh2vfu

On-line analytical processing on large databases managed by computational grids

B. Fiser, U. Onan, I. Elsayed, P. Brezany, A.M. Tjoa
2004 Proceedings. 15th International Workshop on Database and Expert Systems Applications, 2004.  
There already exist several successful Data Grid projects addressing processing files storing large volumes of scientific data and projects developing services for accessing remote relational and XML databases  ...  Management of large data repositories integrated into the Grid poses new challenges for Grid research.  ...  Therefore, for the end-user and other potential applications, we consider this datacube as one large virtual cube, which is distributed across a set of Grid hosts, which manage the creation, updates and  ... 
doi:10.1109/dexa.2004.1333533 dblp:conf/dexaw/FiserOEBT04 fatcat:jgsvsesmcbf6pmddubnudqs4xu

Exploratory Data Analysis via Self-Organization

Baldo Faieta, Erik D. Lumer
1994 Open research Areas in Information Retrieval  
This technique, based on principles of collective processing and self-organization, supports the dynamic visualization and manipulation of emergent structures present in multidimensional data sets.  ...  The algorithm works by first placing database elements randomly in a grid and then aggregating them in a particular way so that statistical regularities are mapped into spatially structured clusters.  ...  Wirtz at Zetes for providing a forum in which this work could be developed. This research was supported, in part, by a grant from Zetes.  ... 
dblp:conf/riao/FaietaL94 fatcat:qz2bqoldxbflveqqme5a76zgaa

A Survey of Spatio-Temporal Big Data Indexing Methods in Distributed Environment

Ruijie Tian, Huawei Zhai, Weishi Zhang, Fei Wang, Yao Guan
2022 IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing  
How to construct an effective index for the application requirements of spatio-temporal data in a distributed environment has become one of the hotspots of spatio-temporal big data research.  ...  Spatio-temporal data present multisource, heterogeneous, and multidimensional scale characteristics.  ...  There are two structures for existing spatio-temporal indexes based on NoSQL databases. 1) The spatio-temporal multidimensional index, as shown in Fig. 7 , is an extension of spatial multidimensional  ... 
doi:10.1109/jstars.2022.3175657 fatcat:tjklpbkfffasjhwillift47k2i
« Previous Showing results 1 — 15 out of 3,355 results