Filters








736 Hits in 4.8 sec

The Fifth PASCAL Recognizing Textual Entailment Challenge

Luisa Bentivogli, Bernardo Magnini, Ido Dagan, Hoa Trang Dang, Danilo Giampiccolo
2009 Text Analysis Conference  
This paper presents the Fifth Recognizing Textual Entailment Challenge (RTE-5).  ...  Moreover, a pilot Search Task was set up, consisting of finding all the sentences in a set of documents that entail a given hypothesis. 21 teams participated in the campaign, among which 20 in the Main  ...  This work is supported in part by the Pascal-2 Network of Excellence, ICT-216886-NOE.  ... 
dblp:conf/tac/BentivogliMDDG09 fatcat:biqc6hjbzjgh7lmgytljfjqfcm

Recognizing textual entailment: Rational, evaluation and approaches

IDO DAGAN, BILL DOLAN, BERNARDO MAGNINI, DAN ROTH
2009 Natural Language Engineering  
Work in this area has been largely driven by the PASCAL Recognizing Textual Entailment (RTE) challenges, which are a series of annual competitive meetings.  ...  The goal of identifying textual entailment -whether one piece of text can be plausibly inferred from another -has emerged in recent years as a generic core problem in natural language understanding.  ...  As for the future of this area, we believe that the long-term goal of textual entailment research is the development of robust entailment 'engines'.  ... 
doi:10.1017/s1351324909990209 fatcat:t7rpxvcw2jfpbbxzrejk6expuu

Recognizing textual entailment: Rational, evaluation and approaches – Erratum

IDO DAGAN, BILL DOLAN, BERNARDO MAGNINI, DAN ROTH
2010 Natural Language Engineering  
Work in this area has been largely driven by the PASCAL Recognizing Textual Entailment (RTE) challenges, which are a series of annual competitive meetings.  ...  The goal of identifying textual entailment -whether one piece of text can be plausibly inferred from another -has emerged in recent years as a generic core problem in natural language understanding.  ...  As for the future of this area, we believe that the long-term goal of textual entailment research is the development of robust entailment 'engines'.  ... 
doi:10.1017/s1351324909990234 fatcat:agnw7jv43jhjhdhd4nibnba6fe

Recognizing Question Entailment for Medical Question Answering

Asma Ben Abacha, Dina Demner-Fushman
2017 AMIA Annual Symposium Proceedings  
In this paper, we propose a new approach for the detection of similar questions based on Recognizing Question Entailment (RQE).  ...  With the increasing heterogeneity and specialization of medical texts, automated question answering is becoming more and more challenging.  ...  In a similar definition, the first PASCAL Recognizing Textual Entailment Challenge 9 (2004-2005) defined the task of Recognizing Textual Entailment (RTE) as deciding, given two text fragments, whether  ... 
pmid:28269825 pmcid:PMC5333286 fatcat:de4e5eavvrffhk3fcwz452zp5e

Sagan in TAC2009: Using Support Vector Machines in Recognizing Textual Entailment and TE Search Pilot task

Julio J. Castillo
2009 Text Analysis Conference  
This paper describes the Sagan system in the context of the Fifth Pascal Recognizing Textual Entailment (RTE-5) Evaluation Challenge and the new Textual Entailment Search Pilot Task.  ...  Additionally, we show an approach to deal with the problem of search entailment in a context of a set of document that uses co-reference analysis.  ...  The system is based on a machine learning approach for recognizing textual entailment.  ... 
dblp:conf/tac/Castillo09 fatcat:3jzd4p463rakji253fsjnqgvgm

The Seventh PASCAL Recognizing Textual Entailment Challenge

Luisa Bentivogli, Peter Clark, Ido Dagan, Danilo Giampiccolo
2011 Text Analysis Conference  
This paper presents the Seventh Recognizing Textual Entailment (RTE-7) challenge.  ...  This year's challenge replicated the exercise proposed in RTE-6, consisting of a Main Task, in which Textual Entailment is performed on a real corpus in the Update Summarization scenario; a Main subtask  ...  This work is supported in part by the Pascal-2 Network of Excellence, ICT-216886-NOE.  ... 
dblp:conf/tac/BentivogliCDG11 fatcat:kvs5jvc2ubb7rhmqnjspufn2pi

Understanding by Understanding Not: Modeling Negation in Language Models [article]

Arian Hosseini, Siva Reddy, Dzmitry Bahdanau, R Devon Hjelm, Alessandro Sordoni, Aaron Courville
2021 arXiv   pre-print
By training BERT with the resulting combined objective we reduce the mean top~1 error rate to 4% on the negated LAMA dataset. We also see some improvements on the negated NLI benchmarks.  ...  Despite being very successful on many tasks, state-of-the-art pre-trained language models often handle negation incorrectly.  ...  B.: The fifth pascal recognizing textual entailment challenge. In Proceedings of TAC 9.  ... 
arXiv:2105.03519v1 fatcat:j6xzqndrfva3lf3bt2gwhluql4

Asymmetric Attributional Word Similarity Measures to Detect the Relations of Textual Generality

Sebastião Pais, Gaël Dias
2020 Computers  
For this, we introduce a particular case of Textual Entailment (TE), namely Textual Entailment by Generality (TEG).  ...  We propose an unsupervised and language-independent method to recognize TEGs, from a pair ⟨T,H⟩ having an entailment relation.  ...  It then looks for negations not found in the mapping, and for the lexical edit distance of the mapping. These items are then entered into a decision tree to determine the overall entailment.  ... 
doi:10.3390/computers9040081 fatcat:vyt3our4rjfi5dgbparoo4trsy

Reliable Evaluations for Natural Language Inference based on a Unified Cross-dataset Benchmark [article]

Guanhua Zhang, Bing Bai, Jian Liang, Kun Bai, Conghui Zhu, Tiejun Zhao
2020 arXiv   pre-print
The lack of trustworthy evaluation settings and benchmarks stalls the progress of NLI research.  ...  Models utilizing these superficial clues gain mirage advantages on the in-domain testing set, which makes the evaluation results over-estimated.  ...  The third pascal recognizing textual entailment challenge. In Proceedings of the ACL-PASCAL workshop on textual entailment and paraphrasing, pages 1-9.  ... 
arXiv:2010.07676v1 fatcat:3u5acmz5cfgwbcoelrumn7j7yy

A Confidence Model for Syntactically-Motivated Entailment Proofs

Asher Stern, Ido Dagan
2011 Recent Advances in Natural Language Processing  
This paper presents a novel method for recognizing textual entailment which derives the hypothesis from the text through a sequence of parse tree transformations.  ...  Unlike related approaches based on tree-edit-distance, we employ transformations which better capture linguistic structures of entailment.  ...  Acknowledgements This work was partially supported by the Israel Science Foundation grant 1112/08 and by the PASCAL-2 Network of Excellence of the European Community FP7-ICT-2007-1-216886.  ... 
dblp:conf/ranlp/SternD11 fatcat:nzxb3vc2l5cvxh3dvlswhrxhpu

A Survey of Paraphrasing and Textual Entailment Methods

I. Androutsopoulos, P. Malakasiotis
2010 The Journal of Artificial Intelligence Research  
Textual entailment methods, on the other hand, recognize, generate, or extract pairs of natural language expressions, such that a human who reads (and trusts) the first element of a pair would most likely  ...  Paraphrasing can be seen as bidirectional textual entailment and methods from the two areas are often similar.  ...  This work was funded by the Greek PENED project "Combined research in the areas of information retrieval, natural language processing, and user modeling aiming at the development of advanced search engines  ... 
doi:10.1613/jair.2985 fatcat:g6yso7ae7zeizbjbxp7efexoiu

Automated Fact-Checking: A Survey [article]

Xia Zeng, Amani S. Abumansour, Arkaitz Zubiaga
2021 arXiv   pre-print
research in the development of different components.  ...  Researchers in the field of Natural Language Processing (NLP) have contributed to the task by building fact-checking datasets, devising automated fact-checking pipelines and proposing NLP methods to further  ...  Acknowledgments This work was supported by the Engineering and Physical Sciences Research Council (grant EP/V048597/1). Xia Zeng is funded by China Scholarship Council (CSC). Amani S.  ... 
arXiv:2109.11427v1 fatcat:6ezha6y5svf4zkq7brodmd3vke

Learning to Sample Replacements for ELECTRA Pre-Training [article]

Yaru Hao, Li Dong, Hangbo Bao, Ke Xu, Furu Wei
2021 arXiv   pre-print
Despite the compelling performance, ELECTRA suffers from the following two issues.  ...  We also prove that efficient sampling reduces the training variance of the discriminator.  ...  The Aaron C. Courville, and Yoshua Bengio. 2014. Gen- fifth pascal recognizing textual entailment challenge. erative adversarial networks. CoRR, abs/1406.2661.  ... 
arXiv:2106.13715v1 fatcat:v2wzdbd3xbfsfpjfdmajpi4irq

Comparing Test Sets with Item Response Theory [article]

Clara Vania, Phu Mon Htut, William Huang, Dhara Mungra, Richard Yuanzhe Pang, Jason Phang, Haokun Liu, Kyunghyun Cho, Samuel R. Bowman
2021 arXiv   pre-print
Recent years have seen numerous NLP datasets introduced to evaluate the performance of fine-tuned models on natural language understanding tasks.  ...  We find that Quoref, HellaSwag, and MC-TACO are best suited for distinguishing among state-of-the-art models, while SNLI, MNLI, and CommitmentBank seem to be saturated for current strong models.  ...  The Fifth PASCAL Recogniz- ing Textual Entailment Challenge. In TAC.  ... 
arXiv:2106.00840v1 fatcat:holqdsprhbb5fhdzvp3dzltd7m

Assessing the Role of Discourse References in Entailment Inference

Shachar Mirkin, Ido Dagan, Sebastian Padó
2010 Annual Meeting of the Association for Computational Linguistics  
On the basis of an in-depth analysis of entailment instances, we argue that discourse references have the potential of substantially improving textual entailment recognition, and identify a number of research  ...  Discourse references, notably coreference and bridging, play an important role in many text understanding applications, but their impact on textual entailment is yet to be systematically understood.  ...  Acknowledgements This work was partially supported by the PASCAL-2 Network of Excellence of the European Community FP7-ICT-2007-1-216886 and the Israel Science Foundation grant 1112/08.  ... 
dblp:conf/acl/MirkinDP10 fatcat:l63kiz7fnjc6pfr5byk5i5ds4q
« Previous Showing results 1 — 15 out of 736 results