Filters








8,117 Hits in 5.2 sec

Retrieval and novelty detection at the sentence level

James Allan, Courtney Wade, Alvaro Bolivar
2003 Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval - SIGIR '03  
, and 2) find the novel sentences from the collection of relevant sentences.  ...  Our research shows that the former step appears to be the more difficult part of this task, and that the performance of novelty measures is very sensitive to the presence of non-relevant sentences.  ...  Evaluation in the novelty track was based on standard recall and precision measures, but applied at the sentence level, and to either relevant or to novel sentences.  ... 
doi:10.1145/860435.860493 dblp:conf/sigir/AllanWB03 fatcat:wgrtpe3zd5cxrduhcl7nqg63vi

Retrieval and novelty detection at the sentence level

James Allan, Courtney Wade, Alvaro Bolivar
2003 Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval - SIGIR '03  
, and 2) find the novel sentences from the collection of relevant sentences.  ...  Our research shows that the former step appears to be the more difficult part of this task, and that the performance of novelty measures is very sensitive to the presence of non-relevant sentences.  ...  Evaluation in the novelty track was based on standard recall and precision measures, but applied at the sentence level, and to either relevant or to novel sentences.  ... 
doi:10.1145/860492.860493 fatcat:ech6awx5hnddddkv6knvlvjhn4

Improving novelty detection for general topics using sentence level information patterns

Xiaoyan Li, W. Bruce Croft
2006 Proceedings of the 15th ACM international conference on Information and knowledge management - CIKM '06  
In this work, a new novelty detection approach based on the identification of sentence level information patterns is proposed.  ...  Then we elaborate a thorough analysis of sentence level information patterns on data from the TREC novelty tracks, including sentence lengths, named entities, sentence level opinion patterns.  ...  The novelty definition can be applied to novelty detection at different levels -event level, sentence level and document level.  ... 
doi:10.1145/1183614.1183652 dblp:conf/cikm/LiC06 fatcat:l2iut7pxnrcz3lgbqlv2qr3w5y

Novelty detection based on sentence level patterns

Xiaoyan Li, W. Bruce Croft
2005 Proceedings of the 14th ACM international conference on Information and knowledge management - CIKM '05  
In this paper, a new novelty detection approach based on the identification of sentence level patterns is proposed.  ...  An analysis of patterns in sentences was performed with data from the TREC 2002 novelty track and experiments on novelty detection were carried out on data from the TREC 2003 and 2004 novelty tracks.  ...  Named Entity Pattern Analysis Our novelty definition can be applied to novelty detection at different levels -event level, sentence level and document level.  ... 
doi:10.1145/1099554.1099734 dblp:conf/cikm/LiC05a fatcat:bwa7oozkzvfunj6qr3kix5jqiu

An information-pattern-based approach to novelty detection

Xiaoyan Li, W. Bruce Croft
2008 Information Processing & Management  
9 In this paper, a new novelty detection approach based on the identification of sentence level information patterns is 10 proposed.  ...  Second, a thorough analysis of sen-12 tence level information patterns is elaborated using data from the TREC novelty tracks, including sentence lengths, named 13 entities (NEs), and sentence level opinion  ...  Novelty detection at the sentence level is also the basis for novelty detection at the event level. Therefore 35 the work in this paper will focus on novelty detection at the sentence level. ).  ... 
doi:10.1016/j.ipm.2007.09.013 fatcat:ko2fvnhmbnek5hbm5xpmdgmmrm

Where to start filtering redundancy?

Ronald T. Fernandez, Javier Parapar, David E. Losada, Alvaro Barreiro
2010 Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval - SIGIR '10  
Novelty detection is a difficult task, particularly at sentence level. Most of the approaches proposed in the past consist of re-ordering all sentences following their novelty scores.  ...  In fact, a naive baseline with no novelty detection capabilities yields often better performance than any state-of-the-art novelty detection mechanism.  ...  Acknowledgments: This work was partially supported by FEDER, Ministerio de Ciencia e Innovación and Xunta de Galicia under projects TIN2008-06566-C04-04, 2008/068 and 07SIN005206PR.  ... 
doi:10.1145/1835449.1835590 dblp:conf/sigir/FernandezPLB10 fatcat:mzb6ziste5dwrnuztwb6z5ge2y

Fact-focused novelty detection

Jahna Otterbacher, Dragomir Radev
2006 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '06  
Methods for detecting sentences in an input document set, which are both relevant and novel with respect to an information need, would be of direct benefit to many systems, such as extractive text summarizers  ...  In previous experiments, judges were asked to first identify sentences that are relevant to a general topic, and then to eliminate sentences from the list that do not contain new information.  ...  The authors would like to thank the members of the CLAIR research group and the anonymous SIGIR reviewers for their feedback and comments on this work.  ... 
doi:10.1145/1148170.1148318 dblp:conf/sigir/OtterbacherR06 fatcat:adpnrypemvfczej3md2q6infka

Novelty Detection: A Perspective from Natural Language Processing

Tirthankar Ghosal, Tanik Saikh, Tameesh Biswas, Asif Ekbal, Pushpak Bhattacharyya
2021 Computational Linguistics  
However, detecting redundancy at the semantic level and identifying novel text is not straightforward because the text may have less lexical overlap yet convey the same information.  ...  We also present our enhanced dataset TAP-DLND 2.0 and several baselines to the community for further researchon document-level novelty detection.  ...  to do our investigations on Textual Novelty.  ... 
doi:10.1162/coli_a_00429 fatcat:2c7qctjchrhirpcpamhisiygke

Major topic detection and its application to opinion summarization

Lun-Wei Ku, Li-Ying Lee, Tung-Ho Wu, Hsin-Hsi Chen
2005 Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '05  
Because no queries are posed beforehand, detecting opinions is similar to the task of topic detection on sentence level.  ...  Such terms form the major topic of the relevant document set. How to choose the major topic is described as follows. We assign weights to each word both at document level and paragraph level.  ... 
doi:10.1145/1076034.1076161 dblp:conf/sigir/KuLWC05 fatcat:qn4jskyd7zhzvdcfjsdqz2mv2e

Clustering Based Approach for Novelty Detection in Text Documents

Sushil Kumar, Komal Kumar Bhatia
2019 Asian Journal of Computer Science and Technology  
In this work we proposed a clustering based approach for novelty detection which will provide the relevant and novel documents for the information need.  ...  It is necessary to retrieve relevant and novel information from a given query by the user. With the result of this the user will require minimum effort to access the information need.  ...  Novelty detection can be performed at three different levels: the event level by T. Brant and Frants [2] , the document level and the sentence level [8, 10] . At the event level by J.  ... 
doi:10.51983/ajcst-2019.8.2.2130 fatcat:6ihk2rfqxzhlvdlsvumxw6lxt4

Aspects of sentence retrieval

Vanessa Murdock
2007 SIGIR Forum  
the data needed, and completing and reviewing the collection of information.  ...  Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining  ...  Sentence retrieval for novelty detection and question answering live on opposite ends of the spectrum of relevance.  ... 
doi:10.1145/1328964.1328990 fatcat:bilmicvjwvd3pnncu6tk6kpbry

TAP-DLND 1.0 : A Corpus for Document Level Novelty Detection [article]

Tirthankar Ghosal, Amitra Salam, Swati Tiwari, Asif Ekbal, Pushpak Bhattacharyya
2018 arXiv   pre-print
To bridge this gap, we present here a resource for benchmarking the techniques for document level novelty detection.  ...  Important though the problem is, we are unaware of any benchmark document level data that correctly addresses the evaluation of automatic novelty detection techniques in a classification framework.  ...  ., and Bolivar, A. (2003) . Retrieval and novelty detection at the sentence level.  ... 
arXiv:1802.06950v1 fatcat:64muykgm2fab7kx2ueg3rgt3de

Novelty detection using local context analysis

Ronald T. Fernández, David E. Losada
2007 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '07  
Losada belongs to the "Ramón y Cajal" program, whose funds come from MEC and the FEDER program.  ...  ACKNOWLEDGEMENTS This work was partially supported by national project TIN2005-08521-C02-01 and Galician network 2006/23. David E.  ...  Although NewWords and SetDif are competitive methods for novelty detection, our results indicate that precision at top ranks might be further improved if redundancy decisions are made in terms of a more  ... 
doi:10.1145/1277741.1277878 dblp:conf/sigir/FernandezL07 fatcat:sgawut6ktvfpvj33lpjeidwcei

Compose Like Humans: Jointly Improving the Coherence and Novelty for Modern Chinese Poetry Generation [article]

Lei Shen, Xiaoyu Guo, Meng Chen
2020 arXiv   pre-print
At last, we take into consideration both the draft and the "refining vector" to generate a new poem. The draft provides future sentence-level information for a line to be generated.  ...  Thus, it requires more to control the coherence and improve the novelty. In this paper, we propose a generate-retrieve-then-refine paradigm to jointly improve the coherence and novelty.  ...  ACKNOWLEDGEMENTS We sincerely thank the anonymous reviewers for their helpful and valuable suggestions.  ... 
arXiv:2005.01556v1 fatcat:p3fd2q6lajg55pmwfnq33kixua

Finding New News: Novelty Detection in Broadcast News [chapter]

Georgina Gaughan, Alan F. Smeaton
2005 Lecture Notes in Computer Science  
The automatic detection of novelty, or newness, as part of an information retrieval system would greatly improve a searcher's experience by presenting "documents" in order of how much extra information  ...  In this paper we present a novelty detection system evaluated on the AQUAINT text collection as part of our TREC 2004 Novelty Track experiments.  ...  This work is funded by Irish Research Council for Science Engineering and Technology and gratefully acknolowledged and supported by Science Foundation Ireland under grant 03/IN.3/I361.  ... 
doi:10.1007/11562382_54 fatcat:nbu5rtfmaffflbad6zcuvvr5t4
« Previous Showing results 1 — 15 out of 8,117 results