Efficient detection of large-scale redundancy in enterprise file systems

George Forman, Kave Eshghi, Jaap Suermondt
2009 ACM SIGOPS Operating Systems Review  
In order to catch and reduce waste in the exponentially increasing demand for disk storage, we have developed very efficient technology to detect approximate duplication of large directory hierarchies. Such duplication can be caused, for example, by unnecessary mirroring of repositories by uncoordinated employees or departments. Identifying these duplicate or nearduplicate hierarchies allows appropriate action to be taken at a high level. For example, one could coordinate and consolidate
more » ... consolidate multiple copies in one location.
doi:10.1145/1496909.1496926 fatcat:zyds376dbndfvp2o3ptvbcjm4u