Efficient mining of association rules in text databases

John D. Holt, Soon M. Chung
1999 Proceedings of the eighth international conference on Information and knowledge management - CIKM '99  
In this paper, we propose two new algorithms for mining association rules between words in text databases. The characteristics of text databases are quite different from those of retail transaction databases, and existing mining algorithms cannot handle text databases efficiently because of the large number of itemsets (i.e., words) that need to be counted. Two well-known mining algorithms, Apriori algorithm and Direct Hashing and Pruning (DHP) algorithm, are evaluated in the context of mining
more » ... context of mining text databases, and are compared with the new proposed algorithms named Multipass-Apriori (M-Apriori) and Multipass-DHP (M-DHP). It has been shown that the proposed algorithms have better performance for large text databases.
doi:10.1145/319950.319981 dblp:conf/cikm/HoltC99 fatcat:jp4w47xn25dprns666aqdfqhz4