6 Hits in 1.6 sec

DBLK: Deduplication for primary block storage

Yoshihiro Tsuchiya, Takashi Watanabe
2011 2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST)  
The deduplication block-device (DBLK) is a deduplication and compression system with a block device interface. It is used as a primary storage and block-wise deduplication is done inline.  ...  Since deduplication for primary storage requires low latency and detecting block-wise deduplication creates a large amount of metadata, it is necessary to efficiently use the memory of the system.  ...  ACKNOWLEDGMENTS We thank the anonymous reviewers for their comments. We also thank our managers, Katsuhiko Nishikawa, Yasuo Noguchi, Riichiro Take and Koichi Kumon for their suggestions and support.  ... 
doi:10.1109/msst.2011.5937237 dblp:conf/mss/TsuchiyaW11 fatcat:avn7dlenaffrpb7xswhed5mlta

Efficient Deduplication in a Distributed Primary Storage Infrastructure

João Paulo, José Pereira
2016 ACM Transactions on Storage  
However, traditional archival and backup deduplication systems impose prohibitive storage overhead for virtual machines hosting latency-sensitive applications.  ...  DEDIS works on top of any unsophisticated storage backend, centralized or distributed, as long as it exports a basic shared block device interface.  ...  ACKNOWLEDGMENT We thank the DAIS'14 reviewers for their comments on earlier versions of this article.  ... 
doi:10.1145/2876509 fatcat:rekpetayojdqxh7jwfdetdec7e

HANDS: A heuristically arranged non-backup in-line deduplication system

A. Wildani, E. L. Miller, O. Rodeh
2013 2013 IEEE 29th International Conference on Data Engineering (ICDE)  
HANDS reduces the amount of in-memory index storage required by up to 99% while still achieving between 30% and 90% of the deduplication a full memory-resident index provides, making primary deduplication  ...  Deduplicating in-line data on primary storage is hampered by the disk bottleneck problem, an issue which results from the need to keep an index mapping portions of data to hash values in memory in order  ...  We also thank the industrial sponsors of the SSRC, our reviewers, and all SSRC members for insightful discussions and feedback.  ... 
doi:10.1109/icde.2013.6544846 dblp:conf/icde/WildaniMR13 fatcat:bwzentshivdihhtaphxgtwqgc4

A Survey and Classification of Storage Deduplication Systems

João Paulo, José Pereira
2014 ACM Computing Surveys  
Thus, it has been applied to different storage types, including archives and backups, primary storage, within solid-state drives, and even to random access memory.  ...  The automatic elimination of duplicate data in a storage system, commonly known as deduplication, is increasingly accepted as an effective technique to reduce storage costs.  ...  ACKNOWLEDGMENTS We would like to thank the anonymous reviewers for their extensive comments and suggestions that helped us improve this article.  ... 
doi:10.1145/2611778 fatcat:kh76pmfu3nhlji4v5uyrfhgycu

A Content Fingerprint-based Cluster-wide Inline Deduplication for Shared-Nothing Storage Systems

Awais Khan, Prince Hamandawana, Youngjae Kim
2020 IEEE Access  
Other Deduplication approaches for primary storage systems, such as iDedup [49] , DBLK [70] , and I/O Deduplication [71] , exploit different workload characteristics to attain a fair throughput and  ...  Moreover, these studies target backup and archival storage rather than primary storage.  ... 
doi:10.1109/access.2020.3039056 fatcat:okz34jybhfdihkjsj236yzejra

Virtual disk formats for the efficient support of clones, snapshots and deduplication [article]

Emmanouil Androulidakis, National Technological University Of Athens, National Technological University Of Athens
overhead and the COW technique for snapshots and clones, but will additionally offer instant snapshot/clone creation, efficient remote replication and low access latency required for primary storage.  ...  Deduplication can be employed for both chunks and nodes.  ...  The filesystems in primary storage write data in fixed-sized blocks and so the "insertion in the middle" problem is not so common, fixed-sized chunking can yield deduplication results equal or comparable  ... 
doi:10.26240/heal.ntua.13942 fatcat:3vchj4e65vggnl2zwbm2zqplg4