Rapid Exploitation and Analysis of Documents [report]

D J Buttler, D Andrzejewski, K D Stevens, D Anastasiu, B Gao
2011 unpublished
Analysts are overwhelmed with information. They have large archives of historical data, both structured and unstructured, and continuous streams of relevant messages and documents that they need to match to current tasks, digest, and incorporate into their analysis. The purpose of the READ project is to develop technologies to make it easier to catalog, classify, and locate relevant information. We approached this task from multiple angles. First, we tackle the issue of processing large
more » ... es of information in reasonable time. Second, we provide mechanisms that allow users to customize their queries based on latent topics exposed from corpus statistics. Third, we assist users in organizing query results, adding localized expert structure over results. Forth, we use word sense disambiguation techniques to increase the precision of matching user generated keyword lists with terms and concepts in the corpus. Fifth, we enhance co-occurence statistics with latent topic attribution, to aid entity relationship discovery. Finally we quantitatively analyze the quality of three popoular latent modeling techniques to examine under which circumstances each is useful.
doi:10.2172/1033748 fatcat:gkdolx6ukfd53e2mm6h6cjmdqy