Filters








29,641 Hits in 5.3 sec

Model Construction and Data Management of Running Log in Supporting SaaS Software Performance Analysis

Rui Wang, Shi Ying, Chengai Sun, Hongyan Wan, Huolin Zhang, Xiangyang Jia
2017 Proceedings of the 29th International Conference on Software Engineering and Knowledge Engineering  
In this paper, we define a log format to standardize multi-source heterogeneous log data and construct a log model to support SaaS software performance analysis, where the two performance metrics of average  ...  Furthermore, a log management framework is given to support real-time big log data collection, access, calculation, storage and service, and the technology implementation of the framework is also given  ...  , then it flows into the Flume sink node of a virtual machine and generates two log event stream branch: The first flows directly to the HBase database for storage; The second will flow into the Spark  ... 
doi:10.18293/seke2017-128 dblp:conf/seke/WangYSWZJ17 fatcat:ushr7put7zgdjlcd4r22eg5d5q

Scalable virtual machine storage using local disks

Jacob Gorm Hansen, Eric Jul
2010 ACM SIGOPS Operating Systems Review  
We are building Lithium, a distributed storage system designed specifically for virtualization workloads running in large-scale data centers and clouds.  ...  task of virtual machine storage.  ...  Hansen, Orran Krieger, Eno Thereska, George Coulouris, Eske Christiansen, Rene Schmidt, Steffen Grarup, Henning Schild, and Sharon Weber for input and comments that helped shape and improve this paper.  ... 
doi:10.1145/1899928.1899936 fatcat:jv2qntgiuff6fpezjs4bipias4

Agentless cloud-wide monitoring of virtual disk state

Wolfgang Richter
2014 Proceedings of the 2014 workshop on PhD forum - PhD forum '14  
The core mechanism this dissertation introduces is called Distributed Streaming Virtual Machine Introspection (DS-VMI), and it leverages two properties of modern clouds: virtualized servers managed by  ...  Concretely, this dissertation focuses on virtualized clouds, but the proposed monitoring platform generalizes to any form of persistent storage.  ...  For example, performing a diff on the history of two log-structured file streams is a cheap operation.  ... 
doi:10.1145/2611166.2611174 dblp:conf/mobisys/Richter14 fatcat:ukvtl4kiene4xgn226emv4ycze

Cloud Computing and Big Data for Oil and Gas Industry Application, China

Yang Zhifeng
2019 Journal of Computers  
Cloud computing and big data can provide convenient information sharing and high quality service for oil and gas industry.  ...  In this paper, the distributed cloud storage architecture and its applications for seismic data of oil and gas industry are focused on first.  ...  Acknowledgment The authors thanks Zhang yulong for his initial contribution. References  ... 
doi:10.17706/jcp.14.4.268-282 fatcat:r44blslnbjckdo22qbe37eoo7a

LSDM: Improving the Performance of Mobile Storage with a Log-Structured Address Remapping Device Driver

Aviad Zuck, Oren Kishon, Sivan Toledo
2014 2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies  
Mobile devices use low-cost SSDs such as microSD cards and eMMC devices for persistent data storage.  ...  However, The controllers of low-cost SSDs are optimized for reads and for sequential writes and they perform poorly under random writes.  ...  The utility of a log-structured page-level mapping to achieve high performance in flash storage has already been widely recognized.  ... 
doi:10.1109/ngmast.2014.9 dblp:conf/ngmast/ZuckKT14 fatcat:fq6e2sp3pnfobaop2b6tw6ipmi

Storage virtualization using a block-device file system

Sorin Faibish, Stephen Fridella, Peter Bixby, Uday Gupta
2008 ACM SIGOPS Operating Systems Review  
Storage Virtualization using a Block-Device File SystemStorage Virtualization; what is it?  ...  performance for metadata workloads -Metadata on high performance disk (RAID0) -Data on lower performance disk (RAID5) Additional Features ---File System Extension metadata (fixed) data blocks  ... 
doi:10.1145/1341312.1341340 fatcat:lnqvpnd2cbeyhm7detxzjvjt6m

Lithium

Jacob Gorm Hansen, Eric Jul
2010 Proceedings of the 1st ACM symposium on Cloud computing - SoCC '10  
To address the limitations of centralized shared storage for cloud computing, we are building Lithium, a distributed storage system designed specifically for virtualization workloads running in large-scale  ...  failures, but also often faster than naïve approaches and, for a relatively small cluster of just eight hosts, performs well compared with an enterprise-class Fibre Channel disk array.  ...  Hansen, Orran Krieger, Eno Thereska, George Coulouris, Eske Christiansen, Rene Schmidt, Steffen Grarup, Henning Schild, and the anonymous reviewers for their input and comments that helped shape and improve  ... 
doi:10.1145/1807128.1807134 dblp:conf/cloud/HansenJ10 fatcat:ampqjhtidjdylgwt74h7sjcwxe

A virtual shared metadata storage for HDFS

Jiang Zhou, Yong Chen, Xiaoyan Gu, Weiping Wang, Dan Meng
2015 2015 IEEE International Conference on Networking, Architecture and Storage (NAS)  
In this research, we introduce a novel Virtual Shared Storage Pool (VSSP) concept and design for storing and sharing metadata in HDFS.  ...  The VSSP not only reduces the overhead on metadata modification operations, but also improves the I/O performance for namespace storage.  ...  For the standby node, it receives the journal streams, applies them to in memory structure and stores them in local disks.  ... 
doi:10.1109/nas.2015.7255195 dblp:conf/nas/ZhouCGWM15 fatcat:otndhyex5bashdimmsgz3wspze

Reference Architecture and Classification of Technologies, Products and Services for Big Data Systems

Pekka Pääkkönen, Daniel Pakkala
2015 Big Data Research  
Acknowledgements The authors acknowledge Markus Meier for design of the reference architecture for big data systems, which inspired the authors for replication and differentiation in this work.  ...  This research has been carried out in Digile Need for Speed program, and it has been partially funded by Tekes (the Finnish Funding Agency for Technology and Innovation).  ...  Facebook extracts semi-structured, streaming log data with Scribe (stream extraction). Scribe-Hadoop cluster acts as a Stream temp data store.  ... 
doi:10.1016/j.bdr.2015.01.001 fatcat:diyyx34wqzewbcwshq2yezsxm4

MapReduce Analysis for Cloud-Archived Data

Balaji Palanisamy, Aameek Singh, Nagapramod Mandagere, Gabriel Alatorre, Ling Liu
2014 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing  
Public storage clouds have become a popular choice for archiving certain classes of enterprise data -for example, application and infrastructure logs.  ...  We propose VNCache: an efficient solution for MapReduce analysis of such cloud-archived log data without requiring an apriori data transfer and loading into the local Hadoop cluster.  ...  For example, for an analysis of 1 month of log data archived in the cloud, all blocks stored in the storage cloud that contains any data for the chosen time window would become part of the virtual filesystem  ... 
doi:10.1109/ccgrid.2014.13 dblp:conf/ccgrid/PalanisamySMAL14 fatcat:j4ev3bhjyvcsvbl64hs3zeqktm

Block storage virtualization with commodity secure digital cards

Harvey Tuch, Cyprien Laplace, Kenneth C. Barr, Bi Wu
2012 Proceedings of the 8th ACM SIGPLAN/SIGOPS conference on Virtual Execution Environments - VEE '12  
As a result of this work, recommendations are made for future optimizations throughout the stack that may simplify and improve the performance of storage virtualization systems on mobile platforms.  ...  media available for VM block storage and checkpoint images.  ...  for permitting us to spend time on this paper.  ... 
doi:10.1145/2151024.2151050 dblp:conf/vee/TuchLBW12 fatcat:setqvlnpazezvforttjsdmfwg4

Block storage virtualization with commodity secure digital cards

Harvey Tuch, Cyprien Laplace, Kenneth C. Barr, Bi Wu
2012 SIGPLAN notices  
As a result of this work, recommendations are made for future optimizations throughout the stack that may simplify and improve the performance of storage virtualization systems on mobile platforms.  ...  media available for VM block storage and checkpoint images.  ...  for permitting us to spend time on this paper.  ... 
doi:10.1145/2365864.2151050 fatcat:aevmd6uki5a63lx7lorex5pnme

Integrating HBase with Berkeley DB (BDB) to Improve the Performance of Write Intensive Workload

Anusha A C, Keerthi P, Madhuri M, Neha H, Vidhya K
2016 International Journal of Engineering Research and  
BDB is made of log-structured binary B+ trees. This paper also puts forth a re-usable plug-in that will save migration time and efforts required when switching to BDB.  ...  It is a layered system that is made of a lower level HDFS (Hadoop distributed file system) and a higher lever layer responsible for managing the data.  ...  DRFS maintains high performance and low overhead with many read and write operations. DRFS uses random, contentindependent identifiers for data storage.  ... 
doi:10.17577/ijertv5is030734 fatcat:mobqoeetszeb7lf2seqovzndr4

A Comprehensive Analysis of Architectures and Methods of Real-Time Big Data Analytics

Sinan AY, Department of Computer Engineering, Turkish Military Academy, Ankara, Turkey, M. Ali Akçayol
2017 Lecture Notes on Information Theory  
The studies of big data analytics has emerged due to the lack of data analysis methods, and storage problems with traditional database systems.  ...  In this study, several architectures and applications for real-time big data analysis have been investigated and compared with each other in details.  ...  Mo and Wang [5] presented the Asynchronous Index Strategy (AIS) structure. This structure has shown high performance for time series real-time big data stream storage.  ... 
doi:10.18178/lnit.5.1.7-12 fatcat:ogc2paal4be7nizbi3z5yog6sq

Study of the Big Data Collection Scheme Based Apache Flume for Log Collection

Sooyong Jung, Dept. of Computer Science Graduate School, Soongsil University, 369 Sangdo-Ro, Dongjak-Gu, Seoul, Korea, Yongtae Shin
2018 Journal of clean energy technologies  
The structure for bulk log processing is designed to be matched with one web server and one Flume agent, and the Flume agents connected to the web server are connected to the Flume agent that plays the  ...  In this paper, we have studied the big data collection technology based on Apache Flume for bulk log collection.  ...  GlusterFS is designed for today's high-performance, virtualized cloud environments.  ... 
doi:10.7763/ijcte.2018.v10.1206 fatcat:75t6ft5ghvh4fog3tuyyavdt3e
« Previous Showing results 1 — 15 out of 29,641 results