The unique strengths and storage access characteristics of discard-based search

Mahadev Satyanarayanan, Rahul Sukthankar, Lily Mummert, Adam Goode, Jan Harkes, Steve Schlosser
2010 Journal of Internet Services and Applications  
Discard-based search is a new approach to searching the content of complex, unlabeled, nonindexed data such as digital photographs, medical images, and realtime surveillance data. The essence of this approach is query-specific content-based computation, pipelined with human cognition. In this approach, query-specific parallel computation shrinks a search task down to human scale, thus allowing the expertise, judgment, and intuition of an expert to be brought to bear on the specificity and
more » ... ivity of the search. In this paper, we report on the lessons learned in the Diamond project from applying discard-based search to a variety of applications in the health sciences. From the viewpoint of a user, discard-based search offers unique strengths. From the viewpoint of server hardware and software, it offers unique opportunities for optimization that contradict long-established tenets of storage design. Together, these distinctive end-to-end attributes herald a new genre of Internet applications.
doi:10.1007/s13174-010-0001-z fatcat:l54nz2pm5zdgznq3wa4y3gxtyi