DBLK: Deduplication for primary block storage

Yoshihiro Tsuchiya, Takashi Watanabe
2011 2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST)  
The deduplication block-device (DBLK) is a deduplication and compression system with a block device interface. It is used as a primary storage and block-wise deduplication is done inline. Since deduplication for primary storage requires low latency and detecting block-wise deduplication creates a large amount of metadata, it is necessary to efficiently use the memory of the system. We solved this problem by developing a multilayer Bloom filter (MBF) to reduce the size of the data structuren in the memory for indexing duplicate data.
doi:10.1109/msst.2011.5937237 dblp:conf/mss/TsuchiyaW11 fatcat:avn7dlenaffrpb7xswhed5mlta