Extracting Significant Phrases from Text

Yuan J. Lui, Richard Brent, Ani Calinescu
2007 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07)  
Prospective readers can quickly determine whether a document is relevant to their information need if the significant phrases (or keyphrases) in this document are provided. Although keyphrases are useful, not many documents have keyphrases assigned to them, and manually assigning keyphrases to existing documents is costly. Therefore, there is a need for automatic keyphrase extraction. This paper introduces a new domain independent keyphrase extraction algorithm. The algorithm approaches the
more » ... lem of keyphrase extraction as a classification task, and uses a combination of statistical and computational linguistics techniques, a new set of attributes, and a new learning method to distinguish keyphrases from non-keyphrases. The experiments indicate that this algorithm performs at least as well as other keyphrase extraction tools and that it outperforms Microsoft Word 2000's AutoSummarize feature significantly.
doi:10.1109/ainaw.2007.180 dblp:conf/aina/LuiBC07 fatcat:b52p4ypt3razpk2k2dhc5774vu