Filters








52 Hits in 4.0 sec

Stateful Serverless Computing with Crucial

Daniel Barcelona-Pons, Pierre Sutra, Marc Sánchez-Artigas, Gerard París, Pedro García-López
2022 ACM Transactions on Software Engineering and Methodology  
Accordingly, a distributed shared memory layer is the natural answer to the needs for fine-grained state management and synchronization.  ...  We present Crucial , a system to program highly-parallel stateful serverless applications. Crucial retains the simplicity of serverless computing.  ...  Current serverless frameworks support only uncoordinated embarrassingly parallel operations, or bulk synchronous parallelism (BSP) [44, 56] .  ... 
doi:10.1145/3490386 fatcat:tkyjgul3gbhwlge4muwjxn3p6q

Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms [article]

Dimitrios Koutsoukos and Ingo Müller and Renato Marroquín and Ana Klimovic and Gustavo Alonso
2021 arXiv   pre-print
To demonstrate the advantages of our approach, we use Modularis to build a distributed query processing system supporting relational queries running on an RDMA cluster, a serverless cloud platform, and  ...  We show the end-to-end performance of Modularis by comparing it with a framework for SQL processing (Presto), a commercial cluster database (SingleStore), as well as Query-as-a-Service systems (Athena,  ...  Serverless. For the serverless backend, we use the two Queryas-a-Service systems Athena and BigQuery as baselines.  ... 
arXiv:2004.03488v2 fatcat:e7ft5oersvcarms2wsagxyopwa

GUMP

Robert N. Lass, Joe Macker, David Millar, Ian J. Taylor
2010 Proceeding of the 2nd workshop on Bio-inspired algorithms for distributed systems - BADS '10  
in a serverless network environment.  ...  in a serverless network environment.  ...  A GUMP message contains a byte array for the data packet, along with information about the sender (host, port) and other related metadata, such as message receiver ID (for supporting multiple connections  ... 
doi:10.1145/1809018.1809026 fatcat:rtaedaf3zbhxvns7omdbz2xob4

Developing a File System Structure to Solve Healthy Big Data Storage and Archiving Problems Using a Distributed File System

Atilla Ergüzen, Mahmut Ünver
2018 Applied Sciences  
In this work, an efficient model for the storage of medical images using a distributed file system structure has been developed.  ...  With this work, a robust, available, scalable, and serverless solution structure has been produced, especially for storing large amounts of data in the medical field.  ...  FARSITE (2002) is a serverless file system that runs distributed on a network. It runs distributed on a network of physically unreliable computers.  ... 
doi:10.3390/app8060913 fatcat:x5qhxpq7izfzzhexoc2i65jpda

MoveApps: a serverless no-code analysis platform for animal tracking data

Andrea Kölzsch, Sarah C. Davidson, Dominik Gauggel, Clemens Hahn, Julian Hirt, Roland Kays, Ilona Lang, Ashley Lohr, Benedict Russell, Anne K. Scharf, Gabriel Schneider, Candace M. Vinciguerra (+2 others)
2022 Movement Ecology  
To allow long-term and cross-system reproducibility, Apps have public source code and are compiled and run in Docker containers that form the basis of a serverless cloud computing system.  ...  Results We developed MoveApps, an open analysis platform for animal tracking data, to make sophisticated analytical tools accessible to a global community of movement ecologists and wildlife managers.  ...  Acknowledgements We are grateful to Michael Quetting for project coordination and to Babak Naimi for contribution to the very early conceptions of the MoveApps idea and its start.  ... 
doi:10.1186/s40462-022-00327-4 pmid:35843990 pmcid:PMC9290230 fatcat:uai2m3wpqjduvfjhmmuiwbw6ma

MoveApps - a serverless no-code analysis platform for animal tracking data [article]

Andrea Koelzsch, Sarah C Davidson, Dominik Gauggel, Clemens Hahn, Julian Hirt, Roland Kays, Ilona Lang, Ashley K Lohr, Benedict Russell, Anne K Scharf, Gabriel Schneider, Candace Vinciguerra (+2 others)
2022 bioRxiv   pre-print
To allow long-term and cross-system reproducibility, Apps have public source code and are compiled and run in Docker containers that form the basis of a serverless cloud computing system.  ...  Results: We developed MoveApps, an open analysis platform for animal tracking data, to make sophisticated analytical tools accessible to a global community of movement ecologists and wildlife managers.  ...  Acknowledgements We are grateful to Michael Quetting for project coordination and to Babak Naimi for contribution to the very early conceptions of the MoveApps idea and its start.  ... 
doi:10.1101/2022.02.15.480513 fatcat:bkvykgd4qvhuvo45fjymkf6mxi

R2: A Distributed Remote Function Execution Mechanism With Built-in Metadata [article]

Jianpeng Qi, Rui Wang
2021 arXiv   pre-print
This paper aims to solve the question, "Given a function with its parameters and metadata, how to select the executor in a distributed manner and obtain the result in NDN?"  ...  Second, we develop a 2-phase mechanism, where in the first phase, the function request from a client-first reaches the data source and retrieves the metadata, then the best node is selected while the metadata  ...  R2 assumes the metadata is stored together with its data and utilizes a 2-phase mechanism to consecutively complete the metadata extraction, cost estimation, function executor selection, data extraction  ... 
arXiv:2112.06128v1 fatcat:ein5jxwm3ramvfb7ccgqq27oee

Cost- and QoS-Efficient Serverless Cloud Computing [article]

Chavit Denninnart
2020 arXiv   pre-print
With the goal of providing a low cost and a high QoS, the serverless computing paradigm offers opportunities that can be harnessed to attain the goals.  ...  For the first approach, we propose a mechanism to identify various types of "mergeable" tasks, which can benefit from computational reuse if they are executed together as a group.  ...  For training and validating the model, we extracted metadata of the benchmark videos and transcoding configurations. A short sample of these metadata is shown inTable 3.3.  ... 
arXiv:2011.11711v1 fatcat:ra66iigninem7gqibmivsn3dba

Storage events: distributed users, federation and beyond

A. Paul Millar, Olufemi Adeyemi, Vincent Garonne, Dmitry Litvintsev, Tigran Mkrtchyan, Albert Rossi, Marina Sahakyan, Jürgen Starek, A. Forti, L. Betev, M. Litmaath, O. Smirnova (+1 others)
2019 EPJ Web of Conferences  
At DESY, we are investigating storage events along with Apache OpenWhisk and Kubernetes to build a "serverless" cloud, similar to AWS Lambda or Google Cloud Functions, for photon science use cases.  ...  Currently, this is achieved by clients notifying central services of activity; e.g., a client notifies a replica catalogue after an upload.  ...  Acknowledgements This work is supported in part by the eXtreme DataCloud (XDC) project. eXtreme DataCloud is co-funded by the Horizon2020 Framework Program -Grant Agreement 777367  ... 
doi:10.1051/epjconf/201921404035 fatcat:okco3htrwrejhpt7qui6466mhy

The Farsite project

William J. Bolosky, John R. Douceur, Jon Howell
2007 ACM SIGOPS Operating Systems Review  
debugging framework, and our experiences with formal system specification.  ...  A main premise of the project has been that building a scalable system requires more than scalable algorithms: To be scalable in a practical sense, a distributed system targeting 10 5 nodes must tolerate  ...  However, we focused the bulk of our efforts on building a working service, irrespective of the eventual need for distribution.  ... 
doi:10.1145/1243418.1243422 fatcat:kq4b4kkje5eg7ly3cvr53kqf5q

Scalable Storage for Digital Libraries [chapter]

Edward A. Fox, Paul Mather
2003 Signals and Communication Technology  
I propose a storage system optimised for digital libraries.  ...  Its key features are its heterogeneous scalability; its integration and exploitation of rich semantic metadata associated with digital objects; its use of a name space; and its aggressive performance optimisation  ...  In the Warwick Framework, the metadata for an object is actually a container holding packages of metadata.  ... 
doi:10.1007/978-3-662-05300-3_12 fatcat:y44le2j27bemdkvlwyguuqadve

Sharpening Your Tools: Updating bulk_extractor for the 2020s [article]

Simson Garfinkel, Jonathan Stewart
2022 arXiv   pre-print
Between 2018 and 2022 we updated the program from C++98 to C++17, performed a complete code refactoring, and adopted a unit test framework.  ...  We provide lessons and recommendations for other digital forensics tool maintainers.  ...  less data in the future than a systematic extraction of bulk data from resident files.  ... 
arXiv:2208.01639v1 fatcat:fh6ia4jnanfyznwj6vwaibzzzu

Analysis and Improvement of Heterogeneous Hardware Support in Docker Images [article]

Panagiotis Gkikopoulos, Valerio Schiavoni, Josef Spillner
2021 arXiv   pre-print
Docker images are used to distribute and deploy cloud-native applications in containerised form. A container engine runs them with separated privileges according to namespaces.  ...  We first conduct a systematic one-year evolution analysis of a sample of Docker images concerning their use of hardware-specific features.  ...  The second distribution method is to include the Dockerfile in a publicly accessible code repository (e.g., GitHub), for users to build the image themselves [17] .  ... 
arXiv:2105.02606v1 fatcat:72belkkdlvctvj7gfqshn4kuau

A Survey and Classification of Software-Defined Storage Systems

Ricardo Macedo, João Paulo, José Pereira, Alysson Bessani
2020 ACM Computing Surveys  
Finally, we provide key insights about the paradigm and discuss potential future research directions for the field.  ...  Further, we propose a taxonomy and classification of existing SDS solutions accordingly several different criteria.  ...  for temporary files and hot data, and hundreds of TiB of HDD drives for the main data bulk.  ... 
doi:10.1145/3385896 fatcat:f4v7bgxwfbaxpfckrei4qkttby

A Comparative Taxonomy and Survey of Public Cloud Infrastructure Vendors [article]

Dimitrios Sikeridis, Ioannis Papapanagiotou, Bhaskar Prasad Rimal, Michael Devetsikiotis
2018 arXiv   pre-print
The outcomes are essential both for individual researchers, and bigger enterprises in their attempt to identify the set of cloud services that will utterly meet their needs without compromises.  ...  However, in the process of selecting a provider's cloud service over the competition, we observe a lack of universal common ground in terms of terminology, functionality of services and billing models.  ...  Google's Cloud Dataflow, on the other hand, supports a fully programmable (Python, Java) framework and a distributed computing platform.  ... 
arXiv:1710.01476v2 fatcat:qra5ebnvejcsle5mpfbossxhtm
« Previous Showing results 1 — 15 out of 52 results