21 Hits in 1.2 sec

SkyQuery: A Web Service Approach to Federate Databases

Tanu Malik, Alexander S. Szalay, Tamas Budavari, Ani Thakar
2003 Conference on Innovative Data Systems Research  
In this paper, we present SkyQuery, a successful prototype of an evolving federation of astronomy archives. It interoperates using the emerging Web services standard.  ...  Ineffective integration will result in defunct federations and under utilized scientific data. Astronomy, in particular, has many autonomous archives spread over the Internet.  ...  In this paper, we present SkyQuery [Sky02], a successful prototype of one of the first proposed federations of astronomy archives.  ... 
dblp:conf/cidr/MalikS03 fatcat:mjg7kpv5fnd2bghdxhr7buepl4

SkyQuery: An Implementation of a Parallel Probabilistic Join Engine for Cross-Identification of Multiple Astronomical Databases [article]

László Dobos, Tamás Budavári, Nolan Li, Alexander S. Szalay, István Csabai
2012 arXiv   pre-print
Based on the idea, an open, SOAP-web-service-based standard, Open SkyQuery was developed by the National Virtual Observatory to federate geographically distributed data sets [Bud2] .  ...  Time domain astronomy is the emerging field of the 21 th century.  ... 
arXiv:1206.5021v1 fatcat:vnghwx76cng2lcegskrctwwcvq

Web Services for the Virtual Observatory [article]

Alexander S. Szalay, Tamas Budavari, Tanu Malika, Jim Gray, Ani Thakara
2002 arXiv   pre-print
We present two prototype applications, the SdssCutout and the SkyQuery as examples of this layered architecture.  ...  SkyQuery is a portal 4 that federates five geographically separate archives and web services.  ...  The SkyQuery portal sorts count results by decreasing counts, and then creates a federated query plan.  ... 
arXiv:cs/0208014v1 fatcat:j4lanytbsrgqdlov3ki22yk7em

LifeRaft: Data-Driven, Batch Processing for the Exploration of Scientific Databases [article]

Xiaodan Wang , Tanu Malik
2009 arXiv   pre-print
Evaluating LifeRaft in the SkyQuery federation of astronomy databases reveals a two-fold improvement in query throughput.  ...  We also wish to thank Ani Thakar, Tamás Budavari and the rest of the Sloan Digital Sky Survey team at Johns Hopkins University for their assistance with Astronomy data and workloads.  ...  Recall that an Astronomy archive receives from each query a list of objects to be cross-matched.  ... 
arXiv:0909.1760v1 fatcat:dapcsv7panbsrc5cmus322jcku

A Black-Box Approach to Query Cardinality Estimation

Tanu Malik, Randal C. Burns, Nitesh V. Chawla
2007 Conference on Innovative Data Systems Research  
Our primary case study is the Open SkyQuery federation of Astronomy archives, which uses a scheduling and caching mechanism at the mediator for execution of federated queries at remote sources.  ...  Also, the black-box approach provides dramatic improvements in the performance of caching in Open SkyQuery.  ...  We also thank Xiaodan Wang for his help the experimental section and explaining the gory details of the Open SkyQuery source code.  ... 
dblp:conf/cidr/MalikBC07 fatcat:fascpj2j3jatjo4jnm4dsa2ija

'e-science and cyberinfrastructure

Tony Hey
2006 Proceedings of the 15th international conference on World Wide Web - WWW '06  
SkyQuery SkyQuery ( ( ) ) Distributed Query tool using a set of Web Services Distributed Query tool using a set of Web Services Federates many astronomy  ...  archives from Federates many astronomy archives from Pasadena, Chicago, Baltimore, Cambridge UK Pasadena, Chicago, Baltimore, Cambridge UK Grown from 4 to 15 Grown from 4 to 15 archives,becoming  ...  papers refereed archival papers ' ' ' ' archives containing hundreds or archives containing hundreds or thousands of terabytes of data will be thousands of terabytes of data will be affordable and necessary  ... 
doi:10.1145/1135777.1135780 dblp:conf/www/Hey06 fatcat:afosej3hinhzjipslmti2u5334

SciServer: a Science Platform for Astronomy and Beyond [article]

Manuchehr Taghizadeh-Popp, Jai Won Kim, Gerard Lemson, Dmitry Medvedev, M. Jordan Raddick, Alexander S. Szalay, Aniruddha R. Thakar, Joseph Booker, Camy Chhetri, Laszlo Dobos, Michael Rippin
2020 arXiv   pre-print
All these services, wrapped in a layer of REST APIs, constitute a scalable collaborative data-driven science platform that is attractive to science disciplines beyond astronomy.  ...  Open SkyQuery (a VO-compliant version of SkyQuery, Budavári et al. (2004) ) was the flagshipÂăfor the primary mission of the Virtual Observatory (VO), namely to federate the worldwide digital astronomical  ...  The Sloan Digital Sky Survey (SDSS) science archive (Szalay, 1999) pioneered the concept of server-side analytics -the backbone of the current science platform concept -in astronomy almost 20 years ago  ... 
arXiv:2001.08619v1 fatcat:yfxqxg2qrrhltbvjq6gwogonia

Probabilistic Record Linkage in Astronomy: Directional Cross-Identification and Beyond

Tamás Budavári, Thomas J. Loredo
2015 Annual Review of Statistics and Its Application  
Modern astronomy increasingly relies upon systematic surveys, whose dedicated telescopes continuously observe the sky across varied wavelength ranges of the electromagnetic spectrum; some surveys also  ...  Such astronomical versions of the record linkage problem are known by various terms in astronomy: cross-matching, cross-identification, and directional, positional, or spatio-temporal coincidence assessment  ...  Section 4 is concerned with the practical implementation and describes a widely used online service called SkyQuery that can dynamically federate archives of astronomical data.  ... 
doi:10.1146/annurev-statistics-010814-020231 fatcat:qm2dzizlungfvibwxr5zavrza4

Andromeda: Building e-Science Data Integration Tools [chapter]

Víctor Cuevas-Vicenttín, José Luis Zechinelli-Martini, Genoveva Vargas-Solar
2006 Lecture Notes in Computer Science  
SkyQuery [3] is maybe the most representative prototype of a federated database application, implemented using a set of interoperating Web services.  ...  For the first time data acquisition and archival is being designed for online interactive analysis.  ... 
doi:10.1007/11827405_5 fatcat:jjsqu5chn5cyvcd7kxjcethlby

Gaspra - software for astronomical image processing in high-performance computing clusters

Fábio Andrijauskas, André Leon Sampaio Gradvohl
2014 Revista Brasileira de Computação Aplicada  
We designed Gaspra to batch process large sets of astronomical images, allowing researchers to create scientific workflows to obtain new knowledge from these astronomy imagery data sets.  ...  In addition, the authors acknowledge the Big Bear Solar Observatory at New Jersey Institute of Technology and the InfraRed Science Archive (IRSA) at California Technology Institute for the images; and  ...  SkyQuery software, in other hand, consists of a federate database for astronomical data [9] . This federate database integrates several databases with information access features similar to Gaspra.  ... 
doi:10.5335/rbca.2014.4072 fatcat:kkhk32db7jhitcsxls6pg6uj34

The Catalog Archive Server Database Management System

Ani R. Thakar, Alex Szalay, George Fekete, Jim Gray
2008 Computing in science & engineering (Print)  
The SDSS Catalog Archive Server adds advanced data mining features to the DBMS to provide fast online access to the data.  ...  We're also working on making the CAS metadata framework generic and extensible to other non-SDSS and non-astronomy archives. Figure 1 . 1 The Catalog Archive Server schema.  ...  Indeed, the Schema Browser group of tables is already used in the virtual observatory community as a template for SkyNodes in the Open SkyQuery federated query system (  ... 
doi:10.1109/mcse.2008.15 fatcat:7c3ktnjurzea3m6vz5asgbj4wq

Integrating distributed data sources with OGSA-DAI DQP and VIEWS

B. Dobrzelecki, A. Krause, A. C. Hume, A. Grant, M. Antonioletti, T. Y. Alemu, M. Atkinson, M. Jackson, E. Theocharopoulos
2010 Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences  
Until recently, it lacked the built-in functionality that would allow easy creation of federations of distributed data sources.  ...  The system provides a mediator-wrapper for integration of astronomy data archives.  ...  One of the early examples of a successful distributed query processor implemented with hierarchical Web services was developed by the SkyQuery project (Malik et al. 2003) .  ... 
doi:10.1098/rsta.2010.0166 pmid:20679127 fatcat:alchi7j5bndxxinpdfzh6c5rxq

VOStat: A Statistical Web Service for Astronomers

Arnab Chakraborty, Eric D. Feigelson, G. Jogesh Babu
2013 Publications of the Astronomical Society of the Pacific  
The purpose of VOStat is to facilitate a wider range of statistical analyses than are commonly used in astronomy, and to promote use of more advanced methodology in R and CRAN.  ...  These tools include Aladin Sky Atlas, Datascope, Octet, Open SkyQuery, Topcat, VIM, and VisIVO.  ...  INTRODUCTION Astronomy has always accounted for the production of a significant amount of scientific data.  ... 
doi:10.1086/670053 fatcat:bxjoopsygved3f65vwlyogfogu

Bypass Caching: Making Scientific Databases Good Network Citizens

T. Malik, R. Burns, A. Chaudhary
21st International Conference on Data Engineering (ICDE'05)  
Scientific database federations are geographically distributed and network bound. Thus, they could benefit from proxy caching.  ...  Bypass-yield caching is altruistic; caches minimize the overall network traffic generated by the federation, rather than focusing on local performance.  ...  Experiments We develop bypass-yield caching within the SkyQuery [27] federation of astronomy databases.  ... 
doi:10.1109/icde.2005.30 dblp:conf/icde/MalikBC05 fatcat:n65y47leffa5jktjhtq46sf3ii

Grid-Based Data Stream Processing in e-Science

Richard Kuntschke, Tobias Scholl, Sebastian Huber, Alfons Kemper, Angelika Reiser, Hans-martin Adorf, Gerard Lemson, Wolfgang Voges
2006 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06)  
The SkyQuery system [18] and its current redesigned version OpenSkyQuery [19] are federated databases which are based on web service technology.  ...  ., data archives, has to be combined to gain ideally seamless SEDs of celestial objects.  ... 
doi:10.1109/e-science.2006.261114 dblp:conf/eScience/KuntschkeSHKRALV06 fatcat:ljis52yevjghdegfu3pfjtwjme
« Previous Showing results 1 — 15 out of 21 results