2,113 Hits in 5.1 sec

Statistical Analyses of Named Entity Disambiguation Benchmarks

Nadine Steinmetz, Magnus Knuth, Harald Sack
2013 International Semantic Web Conference  
This paper presents statistical analyses and mapping experiments on different benchmarks and dictionaries to identify characteristics and structure of the respective datasets.  ...  To compare the different approaches a ground truth namely an annotated benchmark is essential.  ...  The analyses included simple statistical information as well as type information of contained entities about the benchmarks.  ... 
dblp:conf/semweb/SteinmetzKS13 fatcat:4gad4bhlyvct3fdgyyobx2veva

Cheap and easy entity evaluation

Ben Hachey, Joel Nothman, Will Radford
2014 Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)  
The AIDA-YAGO dataset is a popular target for whole-document entity recognition and disambiguation, despite lacking a shared evaluation tool.  ...  We exemplify a new paradigm of distributed, shared evaluation, in which evaluation software and standardised, versioned system outputs are provided online.  ...  Ben Hachey is the recipient of an Australian Research Council Discovery Early Career Researcher Award (DE120102900).  ... 
doi:10.3115/v1/p14-2076 dblp:conf/acl/HacheyNR14 fatcat:55pyai2ldnasvaf5tfe65yzcte

Robustness Evaluation of Entity Disambiguation Using Prior Probes:the Case of Entity Overshadowing [article]

Vera Provatorova, Svitlana Vakulenko, Samarth Bhargav, Evangelos Kanoulas
2021 arXiv   pre-print
Entity disambiguation (ED) is the last step of entity linking (EL), when candidate entities are reranked according to the context they appear in.  ...  We evaluate and report the performance of popular EL systems on the ShadowLink benchmark.  ...  the University of Amsterdam, the H2020-EU.3.4.  ... 
arXiv:2108.10949v2 fatcat:zj56ladwejhtvo2ojamrygy7ma

The Qanary Ecosystem: Getting New Insights by Composing Question Answering Pipelines [chapter]

Dennis Diefenbach, Kuldeep Singh, Andreas Both, Didier Cherix, Christoph Lange, Sören Auer
2017 Lecture Notes in Computer Science  
Moreover, we show how the Qanary ecosystem can be used to analyse QA processes to detect weaknesses and research gaps.  ...  We illustrate this by focusing on the Entity Linking (EL) task w.r.t. textual natural language input, which is a fundamental step in most QA processes.  ...  Acknowledgments Parts of this work received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 642795, project: Answering  ... 
doi:10.1007/978-3-319-60131-1_10 fatcat:gfuwcmi6b5azppj674dlbvmx5e

Entity Disambiguation with Markov Logic Network Knowledge Graphs

Jiangtao Ma
2017 International Journal of Performability Engineering  
Then, we utilize MLN to inference the inconsistent relationship in the knowledge graph, and disambiguate the entities in the process of entity disambiguation.  ...  Disambiguating named entities is an important problem in natural language processing, knowledge base, question answering systems.  ...  Acknowledgements This research is supported by the National Natural Science Foundation of China, in part by Henan Province Science and Technology Committee, in part by Henan Province Educational Committee  ... 
doi:10.23940/ijpe.17.08.p11.12931303 fatcat:qxha7qaewnbw7onuj4gufdlrra

Lessons learnt from the Named Entity rEcognition and Linking (NEEL) challenge series

Giuseppe Rizzo, Bianca Pereira, Andrea Varga, Marieke van Erp, Amparo Elizabeth Cano Basave, Andreas Hotho, Robert Jäschke, Kristina Lerman, Andreas Hotho, Robert Jäschke, Kristina Lerman
2017 Semantic Web Journal  
The NEEL challenge series, established in 2013, has contributed to the collection of emerging trends in the field and definition of standardised benchmark corpora for entity recognition and linking in  ...  furthering the field of entity recognition and linking in tweets.  ...  Entity Linking Benchmark Initiatives The number of variations in Entity Linking makes it hard to benchmark Entity Linking systems.  ... 
doi:10.3233/sw-170276 fatcat:lr45tai2unbotp5nrag5z7pjxy

An analysis of the semantic annotation task on the linked data cloud

Michel Gagnon, Amal Zouaq, Francisco Aranha, Faezeh Ensan, Ludovic Jean Louis
2019 International Journal of Metadata, Semantics and Ontologies  
In this paper, we provide an evaluation of the performance of existing systems over three tasks: full semantic annotation, named entity recognition, and keyword detection.  ...  More specifically, the spotting capability (recognition of relevant surface forms in text) is evaluated for all three tasks, whereas the disambiguation (correctly associating an entity from Wikipedia or  ...  Acknowledgements This work was partly funded by the Royal Military College of Canada Academic Research Program and sabbatical leave fund and the NSERC discovery grant program.  ... 
doi:10.1504/ijmso.2019.102678 fatcat:f5ydsa7w7fcofgldjmntwi6wna

Identifying author–inventors from Spain: methods and a first insight into results

Stéphane Maraut, Catalina Martínez
2014 Scientometrics  
It aims to maximize precision and recall rates by taking into account national name writing customs in the name matching stage and by including a recursive validation step in the person disambiguation  ...  The aim of this paper is to describe a matching and disambiguation methodology for the identification of author--inventors located in the same country.  ...  Preliminary versions of the methodology were presented the name--game ESF--APE--INV workshops held in Paris December 2009 and Brussels September 2011, we thank participants for their comments.  ... 
doi:10.1007/s11192-014-1409-1 fatcat:fxir2gs665f6zdlz4xqatkhkyy

Combining Linked Data and Statistical Information Retrieval [chapter]

Ricardo Usbeck
2014 Lecture Notes in Computer Science  
In this article, we will outline an approach for creating a webscale, precise and efficient information system capable of understanding keyword, entity and natural language queries.  ...  Being a part of the Information Age, users are challenged with a tremendously growing amount of Web data which generates a need for more sophisticated information retrieval systems.  ...  Acknowledgements This work has been supported by the ESF and the Free State of Saxony.  ... 
doi:10.1007/978-3-319-07443-6_58 fatcat:jukjpnhkzfeftlt4twe6g3glzu

On the Importance of Drill-Down Analysis for Assessing Gold Standards and Named Entity Linking Performance

Fabian Odoni, Philipp Kuntschik, Adrian M.P. Braşoveanu, Albert Weichselbraun
2018 Procedia Computer Science  
Rigorous evaluations and analyses of evaluation results are key towards improving Named Entity Linking systems.  ...  (iii) performing Named Entity Linking evaluations with multiple versions of the included resources.  ...  Acknowledgements The research presented in this paper has been conducted as part of the DISCOVER Project (, funded by the Swiss Commission for Technology and Innovation (CTI).  ... 
doi:10.1016/j.procs.2018.09.004 fatcat:lfzfdn3u7jbknljxanfyimnvnu

Pair-Linking for Collective Entity Disambiguation: Two Could Be Better Than All [article]

Minh C. Phan and Aixin Sun and Yi Tay and Jialong Han and Chenliang Li
2018 arXiv   pre-print
Collective entity disambiguation aims to jointly resolve multiple mentions by linking them to their associated entities in a knowledge base.  ...  As a remedy, we introduce MINTREE, a new tree-based objective for the entity disambiguation problem.  ...  ACKNOWLEDGMENTS This work was supported by Singapore Ministry of Education Research Fund MOE2014-T2-2-066.  ... 
arXiv:1802.01074v3 fatcat:nvtwb2iz6va77e2gfe6lyagntm

Semantic annotation in biomedicine: the current landscape

Jelena Jovanović, Ebrahim Bagheri
2017 Journal of Biomedical Semantics  
This paper focuses on annotation of biomedical entity mentions with concepts from relevant biomedical knowledge bases such as UMLS.  ...  We also examine potential directions for further improvements of today's annotators which could make them even more capable of meeting the needs of real-world applications.  ...  Availability of data and materials Data sharing is not applicable to this article as no datasets were generated or analysed during the current study.  ... 
doi:10.1186/s13326-017-0153-x pmid:28938912 pmcid:PMC5610427 fatcat:jby2gq576vfdfmf4lsusahjrrm

Measuring semantic similarity between words using web search engines

2007 Proceedings of the 16th international conference on World Wide Web - WWW '07  
Moreover, the proposed semantic similarity measure significantly improves the accuracy (F -measure of 0.78) in a community mining task, and in an entity disambiguation task, thereby verifying the capability  ...  of 0.867.  ...  Entity Disambiguation Disambiguating named entities is important in various applications such as information retrieval [11] , social network extraction [23, 3, 4] , Word Sense Disambiguation (WSD) [  ... 
doi:10.1145/1242572.1242675 dblp:conf/www/BollegalaMI07 fatcat:prguxregfvhpfj6p6ul7jx4cqq

WiC-TSV: An Evaluation Benchmark for Target Sense Verification of Words in Context [article]

Anna Breit and Artem Revenko and Kiamehr Rezaee and Mohammad Taher Pilehvar and Jose Camacho-Collados
2021 arXiv   pre-print
We present WiC-TSV, a new multi-domain evaluation benchmark for Word Sense Disambiguation.  ...  This makes the dataset highly flexible for the evaluation of a diverse set of models and systems in and across domains.  ...  Related Work Word Sense Disambiguation and Entity Linking.  ... 
arXiv:2004.15016v3 fatcat:wgydbuxlnrgndcbhfv7hfna4de

No One is Perfect: Analysing the Performance of Question Answering Components over the DBpedia Knowledge Graph [article]

Kuldeep Singh and Ioanna Lytra and Arun Sethupat Radhakrishna and Saeedeh Shekarpour and Maria-Esther Vidal and Jens Lehmann
2020 arXiv   pre-print
In this article, we analyse and micro evaluate the behaviour of 29 available QA components for DBpedia knowledge graph that were released by the research community since 2010.  ...  DBpedia has been the most prominently used knowledge graph in this setting and most approaches currently use a pipeline of processing steps connecting a sequence of components.  ...  MOTIVATING EXAMPLES One of the major tasks in a QA system is Named Entity Disambiguation (NED).  ... 
arXiv:1809.10044v2 fatcat:j2kwwva3xrcphi26gksuqrskfq
« Previous Showing results 1 — 15 out of 2,113 results