A framework for describing web repositories

Frank McCown, Michael L. Nelson
2009 Proceedings of the 2009 joint international conference on Digital libraries - JCDL '09  
In prior work we have demonstrated that search engine caches and archiving projects like the Internet Archive's Wayback Machine can be used to "lazily preserve" websites and reconstruct them when they are lost. We use the term "web repositories" for collections of automatically refreshed and migrated content, and collectively we refer to these repositories as the "web infrastructure". In this paper we present a framework for describing web repositories and the status of web resources in them.
more » ... is includes an abstract API for web repository interaction, the concepts of deep vs. flat and light/dark/grey repositories and terminology for describing the recoverability of a web resource. Our API may serve as a foundation for future web repository interfaces.
doi:10.1145/1555400.1555456 dblp:conf/jcdl/McCownN09a fatcat:nfeba62pxnaethyhteopv3kpo4