2,952,274 Hits in 4.8 sec

Data management at scale

G. Sayeed Choudhury
2016 Information Services and Use  
By doing so, it may be possible to support broader goals of data management at scale, identify network effects through linked data and highlight possibilities for partnerships, including with the corporate  ...  management.  ...  Choudhury / Data management at scale  ... 
doi:10.3233/isu-160795 fatcat:spqodg4wefhtbdndoednm2dqtu

Managing data retention policies at scale

Jun Li, Sharad Singhal, Ram Swaminathan, Alan H. Karp
2011 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops  
large-scale policy management; compliance and regulatory; data retention; encryption key store; cloud service Compliance with regulatory policies on data remains a key hurdle to cloud computing.  ...  By deleting the encryption key at a specified retention time associated with the data object, we effectively delete the data object and its copies stored in online and offline environments.  ...  With respect to the two key challenges identified earlier, our data retention management service demonstrates that:  Policy management at scale requires metadata management at scale.  ... 
doi:10.1109/inm.2011.5990674 dblp:conf/im/LiSSK11 fatcat:w65v5lzp7jec5oebgvp5grrjd4

Data management and analysis at the Large Scale Data Facility

A. O. Garcia, S. Bourov, A. Hammad, T. Jejkal, J.C. Otte, S. Pfeiffer, T. Schenker, C. Schmidt, J. van Wezel, B. Neumair, A. Streit
2011 2011 Sixth International Conference on Digital Information Management  
Introduction The For end-users: DataBrowser graphical tool for exploring and managing the LSDF data also library for meta-data access based on ADALAPI connects to the meta-data repository will be available  ...  Stotzka et. al., Perspective of the Large Scale Data Facility supporting nuclear fusion applications, Proceedings PDP 2011. facility Software DIC Outlook ⇒ experiments need storage ⇒ need sophisticated  ... 
doi:10.1109/icdim.2011.6093357 dblp:conf/icdim/GarciaBHJOPSSWNS11 fatcat:vxu2zoqekjfdbm4nbg4usyyyge

Castor: Contextual IoT Time Series Data and Model Management at Scale [article]

Bei Chen and Bradley Eck and Francesco Fusco and Robert Gormally and Mark Purcell and Mathieu Sinn and Seshu Tirupathi
2019 arXiv   pre-print
We demonstrate Castor, a cloud-based system for contextual IoT time series data and model management at scale.  ...  The main features of Castor are: (1) an efficient pipeline for ingesting IoT time series data in real time; (2) a scalable, hybrid data management service for both time series and contextual data; (3)  ...  In this paper, we demonstrate Castor, a system for managing IoT time series data and predictive models along with semantic context information at scale.  ... 
arXiv:1811.08566v3 fatcat:cx4a4qx2nfgibcqgnxqtab42ie

DataHub: Collaborative Data Science & Dataset Version Management at Scale [article]

Anant Bhardwaj, Souvik Bhattacherjee, Amit Chavan, Amol Deshpande, Aaron J. Elmore, Samuel Madden, Aditya G. Parameswaran
2014 arXiv   pre-print
We outline the challenges in providing dataset version control at scale.  ...  Relational databases have limited support for data collaboration, where teams collaboratively curate and analyze large datasets.  ...  Current data management systems are inadequate at supporting these types of collaborative environments.  ... 
arXiv:1409.0798v1 fatcat:ja4qzcr4h5axpdbgvaqexzcor4

EMODnet marine litter data management at pan-European scale

Maria Eugenia Molina Jack, Maria del Mar Chaves Montero, François Galgani, Alessandra Giorgetti, Matteo Vinci, Morgan Le Moigne, Alberto Brosich
2019 Ocean and Coastal Management  
This assessment depends on the availability of robust, homogeneous data-sets at the European scale.  ...  A data management plan for marine litter has been developed at European level within the existing EMODnet network to collect, homogenise and provide access to standardised data-sets and data products that  ...  All EMODnet Chemistry partners and subcontractors are acknowledged for contributing with data and valuable expertise.  ... 
doi:10.1016/j.ocecoaman.2019.104930 fatcat:cyr2tot7srg4pmsaecs3xw2ohe

VNF chain allocation and management at data center scale

Nodir Kodirov, Sam Bayless, Fabian Ruffy, Ivan Beschastnikh, Holger H. Hoos, Alan J. Hu
2018 Proceedings of the 2018 Symposium on Architectures for Networking and Communications Systems - ANCS '18  
at data-center-scale.  ...  However, existing tools, such as E2 and SOL, limit VNF chain allocation to rack-scale and provide limited support for management of allocated chains.  ...  This work is supported in part by a gift from Microsoft Azure, and the Institute for Computing, Information and Cognitive Systems (ICICS) at UBC.  ... 
doi:10.1145/3230718.3230724 dblp:conf/ancs/KodirovBRBHH18 fatcat:4sfgjlqo4ze7ddxzq7rxluf5ti

BlobSeer: Efficient data management for data-intensive applications distributed at large-scale

Bogdan Nicolae, Gabriel Antoniu, Luc Bouge
2010 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW)  
to enable efficient data management for dataintensive applications at large scale.  ...  While this approach enables efficient fine-grain data transfers at large scale, unlike in the case of BlobSeer, data management transparency is missing, as the user must be aware of data location and manage  ... 
doi:10.1109/ipdpsw.2010.5470802 dblp:conf/ipps/NicolaeAB10 fatcat:uevzz3ze4ndvvbp5c3gun4qk34

Reconstructing historical ranges with fossil data at continental scales

Jason S McLachlan, James S Clark
2004 Forest Ecology and Management  
Our analysis supports the view that populations of these and other species existed at low densities over extensive areas in the past, and such areas would not be accurately mapped using fossil data.  ...  It is well known that fossil pollen and plant macrofossil data provide limited information on distribution and abundance of small or diffuse tree populations.  ...  Williams provided additional data and ideas. M. Rocca and M. Dietz provided technical assistance. A. Kremer, M. Wolosin, S. Ladeau, K. Brown, I. Ibanez, M.  ... 
doi:10.1016/j.foreco.2004.05.026 fatcat:l6o4i5grtfap7dwowwyz354bya

Spatial data application for pesticide management at the catchment scale
Uporaba prostorskih podatkov za upravljanje fitofarmacevtskih sredstev na ravni povodja

Marjetka Suhadolc
2018 Geodetski vestnik  
doi:10.15292/geodetski-vestnik.2018.01.39-50 fatcat:duildcsah5cqloxz5fgd6ejnfm

Petabytes in Practice: Working with Collections as Data at Scale

Will R. Thomas, Benjamin Galewsky, Sandeep Puthanveetil Satheesan, Gregory Jansen, Richard Marciano, Shannon Bradley, Jong Lee, Luigi Marini, Kenton McHenry
2019 Data and Information Management  
an understanding of working with digital collections at scale for cultural data.  ...  The emerging transdiscipline of Computational Archival Science (CAS) links frameworks such as Brown Dog and repository software such as Digital Repository At Scale To Invite Computation (DRAS-TIC) to yield  ...  Maryland is the host of the Digital Repository at Scale that Invites Computation or DRAS-TIC stack to deploy data repositories that scale out to billions of files on potentially thousands of commodity  ... 
doi:10.2478/dim-2019-0004 fatcat:uefpzvcbrndtlmcmc5bv36hmsm

Public Mobility Data Enables COVID-19 Forecasting and Management at Local and Global Scales [article]

Cornelia Ilin, Sébastien Annan-Phan, Xiao Hui Tai, Shikhar Mehra, Solomon M Hsiang, Joshua E Blumenstock
2020 medRxiv   pre-print
We demonstrate the effectiveness of this approach using local and regional data from China, France, Italy, South Korea, and the United States, as well as national data from 80 countries around the world  ...  We show that publicly available data on human mobility --- collected by Google, Facebook, and other providers --- can be used to evaluate the effectiveness of non-pharmaceutical interventions and forecast  ...  on policy interventions to mobility data from several different countries at 175 multiple geographic scales.  ... 
doi:10.1101/2020.10.29.20222547 fatcat:gekdekxm4jgnnifdqz4zvqo45i

A Conceptual Framework for Selecting and Analyzing Stressor Data to Study Species Richness at Large Spatial Scales

1997 Environmental Management  
To date, there has been a lack of conceptual development on how to use stressor data to study geographic patterns of species richness at large spatial scales.  ...  In this paper we develop a conceptual framework for selecting stressor data and analyzing their relationship to geographic patterns of species richness at large spatial scales.  ...  O'Connor for generously supplying information on his research using regression-tree analysis on breeding bird data and for reviewing an early version of this paper.  ... 
doi:10.1007/s002679900024 pmid:9008076 fatcat:ixhtyy26gjacrl7kldfqt4wmwa

Time-evolving graph processing at scale

Anand Padmanabha Iyer, Li Erran Li, Tathagata Das, Ion Stoica
2016 Proceedings of the Fourth International Workshop on Graph Data Management Experiences and Systems - GRADES '16  
Introduction Graph-structured data is on the rise, in size, complexity and the dynamism they exhibit.  ...  Time-evolving graph-structured big data arises naturally in many application domains such as social networks and communication networks.  ...  This works well for applications where the records are generated at the same location as the streaming program. For data generated by external applications, e.g.  ... 
doi:10.1145/2960414.2960419 dblp:conf/grades/IyerLDS16 fatcat:tks4gkhimzhtzocriqu3vxwrle

Public mobility data enables COVID-19 forecasting and management at local and global scales

Cornelia Ilin, Sébastien Annan-Phan, Xiao Hui Tai, Shikhar Mehra, Solomon Hsiang, Joshua E. Blumenstock
2021 Scientific Reports  
We evaluate this approach using local and regional data from China, France, Italy, South Korea, and the United States, as well as national data from 80 countries around the world.  ...  An advantage of the approach is that it involves minimal assumptions about disease dynamics, and requires only publicly-available data.  ...  Funding was also provided by Award 2020-0000000149 from CITRIS and the Banatao Institute at the University of California.  ... 
doi:10.1038/s41598-021-92892-8 pmid:34188119 fatcat:7zae3u4zkbhpjkltd4gm674o4q
« Previous Showing results 1 — 15 out of 2,952,274 results