Filters








39 Hits in 6.0 sec

SemEval-2007 Task 01: Evaluating WSD on Cross-Language Information Retrieval [chapter]

Eneko Agirre, Oier Lopez de Lacalle, Bernardo Magnini, Arantxa Otegi, German Rigau, Piek Vossen
Lecture Notes in Computer Science  
This paper presents a first attempt of an application-driven evaluation exercise of WSD. We used a CLIR testbed from the Cross Lingual Evaluation Forum.  ...  The task had two participants, and the organizer also provided an in-house WSD system for comparison.  ...  This task has been organized as a collaboration of SemEval 1 and the Cross-Language Evaluation Forum (CLEF 2 ).  ... 
doi:10.1007/978-3-540-85760-0_116 fatcat:bijrq4oho5aq7g572szrzkynue

SemEval-2007 task 01

Eneko Agirre, Bernardo Magnini, Oier Lopez de Lacalle, Arantxa Otegi, German Rigau, Piek Vossen
2007 Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07   unpublished
This paper presents a first attempt of an application-driven evaluation exercise of WSD. We used a CLIR testbed from the Cross Lingual Evaluation Forum.  ...  The task had two participants, and the organizer also provided an in-house WSD system for comparison.  ...  This task has been organized as a collaboration of SemEval 1 and the Cross-Language Evaluation Forum (CLEF 2 ).  ... 
doi:10.3115/1621474.1621475 fatcat:dio2poqv6na7vkexp3tkfu7aje

Computational semantic analysis of language: SemEval-2007 and beyond

Eneko Agirre, Lluís Màrquez, Richard Wicentowski
2009 Language Resources and Evaluation  
For more details on tasks and data sets consult the SemEval official website 01 Evaluating WSD on Cross-Language Information Retrieval 02 Evaluating Word Sense Induction and Discrimination Systems  ...  Although the natural candidates were papers detailing evaluation tasks from SemEval-2007, the call was also open to anyone who could report on substantial experimental evaluation of natural language semantics  ... 
doi:10.1007/s10579-009-9091-2 fatcat:kcfwku252zg6pcrznoikzox6wq

Explorations in lexical sample and all-words lexical substitution

RAVI SINHA, RADA MIHALCEA
2012 Natural Language Engineering  
cross-language information retrieval (Monz 2005; Etzioni et al.2007) .  ...  We use the same evaluation metrics as used for the lexical substitution task at Semeval-2007.  ... 
doi:10.1017/s1351324912000265 fatcat:db54xiphxzb7vbnfi7xtjwhirq

A semantic framework for textual data enrichment

Yoan Gutiérrez, Sonia Vázquez, Andrés Montoyo
2016 Expert systems with applications  
Our purpose is to use the semantic information provided by a set of integrated resources to enrich texts by conducting different NLP tasks: WSD, domain classification, semantic similarities and sentiment  ...  First of all, we describe the main characteristics of the semantic integrated resources with an exhaustive evaluation.  ...  pages and WordNet synsets) based on Wikipedia cross-language links and the output of a machine translation system.  ... 
doi:10.1016/j.eswa.2016.03.048 fatcat:i55w6cpyinai5nc3juharay25i

LMMS Reloaded: Transformer-based Sense Embeddings for Disambiguation and Beyond [article]

Daniel Loureiro, Alípio Mário Jorge, Jose Camacho-Collados
2021 arXiv   pre-print
We also emphasize the versatility of these sense embeddings in contrast to task-specific models, applying them on several sense-related tasks, besides WSD, while demonstrating improved performance using  ...  In this work we introduce a more principled approach to leverage information from all layers of NLMs, informed by a probing analysis on 14 NLM variants.  ...  Full results for SemEval 2020 -Task 3 On Table 25 we report complete leaderboard results for subtasks 1 and 2 of SemEval 2020 Task 3 (including other languages besides English), during the evaluation  ... 
arXiv:2105.12449v1 fatcat:h2ytxvdbwffk3hgoi75afcp6de

Disambiguation in the biomedical domain: The role of ambiguity type

Mark Stevenson, Yikun Guo
2010 Journal of Biomedical Informatics  
These results should be taken into account when deciding which information to use for WSD and the level of performance that can be expected.  ...  It employs both linguistic features, such as local collocations, and features derived from domain-specific knowledge sources, the Unified Medical Language System (UMLS) and Medical Subject Headings (MeSH  ...  Acknowledgments The authors are grateful to Abdulaziz Al Amri for his assistance in creating the corpus of ambiguous abbreviations and David Martinez for providing the initial version of the WSD system  ... 
doi:10.1016/j.jbi.2010.08.009 pmid:20816855 fatcat:7yivum7pmnezfno2blcotohfke

A Survey on Lexical Simplification

Gustavo H. Paetzold, Lucia Specia
2017 The Journal of Artificial Intelligence Research  
This task has wide applicability both as an assistive technology for readers with cognitive impairments or disabilities, such as Dyslexia and Aphasia, and as a pre-processing tool for other Natural Language  ...  Processing tasks, such as machine translation and summarisation.  ...  Introduction In the context of Natural Language Processing (NLP), the task of Lexical Simplification (LS) aims to perform Text Simplification (TS) by focusing on lexical information.  ... 
doi:10.1613/jair.5526 fatcat:vdzvoemabjh3pftykyyyz5a2me

Has Computational Linguistics Become More Applied? [chapter]

Kenneth Church
2009 Lecture Notes in Computer Science  
The system we present obtains similar results to the ones reported by the top three systems presented at the SEMEVAL 2007 competition. Abstract.  ...  We evaluate our method comparing the answers given by a traditional information retrieval systemvector space model adjusted for article retrieval, instead of document retrieval-and the answers to 21 questions  ...  Semeval 2007 workshop ([1]).  ... 
doi:10.1007/978-3-642-00382-0_1 fatcat:oddvfzds4nfwjam2ccqeaxe2y4

Weisfeiler-Leman in the Bamboo: Novel AMR Graph Metrics and a Benchmark for AMR Graph Similarity

Juri Opitz, Angel Daza, Anette Frank
2021 Transactions of the Association for Computational Linguistics  
Furthermore, we introduce a Benchmark for AMR Metrics based on Overt Objectives (Bamboo), the first benchmark to support empirical assessment of graph-based MR similarity metrics.  ...  MRP 2020: The second shared of the 2014 Conference on Empirical Meth- task on cross-framework and cross-lingual ods in Natural Language Processing (EMNLP), meaning representation  ...  In The 41st Interna- Conference on Parsing Technologies and the tional ACM SIGIR Conference on Research IWPT 2021 Shared Task on Parsing into En- & Development in Information Retrieval  ... 
doi:10.1162/tacl_a_00435 fatcat:enf4bnznqzefjaq24yoocmoh2a

Program Committee

2006 2006 Sixth IEEE International Workshop on Source Code Analysis and Manipulation  
Corpus-based Learning of Lexical Semantic Relations by Vered Shwartz (Bar-Ilan University), Inducing Interpretable Word Senses for WSD and Enrichment of Lexical Resources by Alexander Panchenko (University  ...  were partially supported by the NTU Centre for Liberal Arts and Social Sciences (CLASS) and the Singapore MOE TRF Grant Syntactic Well-Formedness Diagnosis and Error-Based Coaching in Computer Assisted Language  ...  Acknowledgments We wish to thank Georgia Sanna for the first joint analysis about the possibility of creating a wordnet for the Sardinian language.  ... 
doi:10.1109/scam.2006.23 dblp:conf/scam/X06c fatcat:2dhsf7loj5hlffu2jxpmlo2qcq

NewsReader: Using knowledge resources in a cross-lingual reading machine to generate more knowledge from massive streams of news

Piek Vossen, Rodrigo Agerri, Itziar Aldabe, Agata Cybulska, Marieke van Erp, Antske Fokkens, Egoitz Laparra, Anne-Lyse Minard, Alessio Palmero Aprosio, German Rigau, Marco Rospocher, Roxane Segers
2016 Knowledge-Based Systems  
This event-centric information is represented as episodic situational knowledge on individuals in an interoperable RDF format that allows for reasoning on the implications of the events.  ...  We demonstrate that our system performs at state-of-the-art level for various subtasks in the four languages of the project, but that we also consider the full integration of these tasks in an overall  ...  , challenge 4.4 -Area Intelligent Information Management.  ... 
doi:10.1016/j.knosys.2016.07.013 fatcat:bifn3yjo7vdfbj5przsfmhvqxu

Content Facets For Individual Information Needs In Media

Elisabeth Lex, Stefanie Lindstaedt, Michael Granitzer, Harald Kosch
2018 Zenodo  
From the media consumer perspective, navigating the haystack of information produced by media as well as finding content that meets ones quality demands is challenging.  ...  This enables any media consumer to search for information according to their personal information need. This is a substantial improvement to individualize search in media.  ...  Emotion classification has extensively been tackled in the SemEval challenge 2007 10 in form of an A↵ective Text Task.  ... 
doi:10.5281/zenodo.1196397 fatcat:udr3736ejbek5lzl34tu4g4ppq

Content Facets For Individual Information Needs In Media

Elisabeth Lex, Stefanie Lindstaedt, Michael Granitzer, Harald Kosch
2018 Zenodo  
From the media consumer perspective, navigating the haystack of information produced by media as well as finding content that meets ones quality demands is challenging.  ...  This enables any media consumer to search for information according to their personal information need. This is a substantial improvement to individualize search in media.  ...  Emotion classification has extensively been tackled in the SemEval challenge 2007 10 in form of an Affective Text Task.  ... 
doi:10.5281/zenodo.1195993 fatcat:ce3ljnthjfhkpir3y4atnnlicy

A Synset Relation-enhanced Framework with a Try-again Mechanism for Word Sense Disambiguation

Ming Wang, Yinglin Wang
2020 Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)   unpublished
Contextual embeddings are proved to be overwhelmingly effective to the task of Word Sense Disambiguation (WSD) compared with other sense representation techniques.  ...  Experiments on all-words and lexical sample datasets show that the proposed system achieves new state-ofthe-art results, defeating previous knowledge-based systems by at least 5.5 F1 measure.  ...  SemEval-2017 Task 1: Semantic Textual Similarity -Multilingual and Cross-lingual Focused Evaluation. In Proceedings of the SemEval workshop at ACL 2017, pages 1-14. using topic models.  ... 
doi:10.18653/v1/2020.emnlp-main.504 fatcat:hni4psiqbja5jnp6pda5ubpxpy
« Previous Showing results 1 — 15 out of 39 results