102,594 Hits in 3.2 sec

Using ontologies and knowledge graphs to link multi-modal data across scales and disciplines

Anne Thessen
2021 Zenodo  
This talk will present methodologies for integrating multi-modal data across disciplines to enable large-scale, holistic studies of natural systems and discuss the team science aspects of this work in  ...  In addition, these holistic approaches require expertise and data from outside biology, such as geology, computer science, and economics to name a few.  ...  • The answer could require multiple, heterogeneous data sets from different disciplines • Generate hypotheses across discipline, taxon, and scale • Link data and knowledge in unprecedented ways  ... 
doi:10.5281/zenodo.5519456 fatcat:bzai3sr3jrajrlsnvna2fqaizm

Cross-Lingual Cross-Media Content Linking: Annotations and Joint Representations (Dagstuhl Seminar 15201)

Alexander G. Hauptmann, James Hodson, Juanzi Li, Nicu Sebe, Achim Rettinger, Marc Herbstritt
2015 Dagstuhl Reports  
Dagstuhl Seminar 15201 was conducted on "Cross-Lingual Cross-Media Content Linking: Annotations and Joint Representations".  ...  Seminar May 10-13, 2015 - Different types of content belonging to multiple modalities (text, audio, video) and languages are generated from various sources.  ...  Thus, implementing these solutions require a joint effort across research disciplines to relate the representations and to use them for linking languages and modalities.  ... 
doi:10.4230/dagrep.5.5.43 dblp:journals/dagstuhl-reports/HauptmannHLSR15 fatcat:sjqptft2m5cufcpzslggt7la5i

Three Birds (in the LLOD Cloud) with One Stone: BabelNet, Babelfy and the Wikipedia Bitaxonomy

Tiziano Flati, Roberto Navigli
2014 International Conference on Semantic Systems  
In this paper we present the current status of linguistic resources published as linked data and linguistic services in the LLOD cloud in our research group, namely BabelNet, Babelfy and the Wikipedia  ...  We describe them in terms of their salient aspects and objectives and discuss the benefits that each of these potentially brings to the world of LLOD NLP-aware services.  ...  The authors also acknowledge support from the LIDER project (No. 610782), a and Support Action funded by the European Commission under FP7.  ... 
dblp:conf/i-semantics/FlatiN14 fatcat:tn47jkmtwbhfdpolhnb5qhohhq

Guest Editorial: Image and Language Understanding

Margaret Mitchell, John C. Platt, Kate Saenko
2017 International Journal of Computer Vision  
They also add co-reference chains linking different mentions of the same region across multiple captions.  ...  The papers in this issue introduce new problems, solutions, and datasets in vision and language, advancing vision and language research towards deeper image understanding and the ability to communicate  ... 
doi:10.1007/s11263-017-0993-y fatcat:ybriwh2czfcwff63q5f3p7aw6y

Linking content in unstructured sources

Marie-Francine Moens
2010 Proceedings of the 19th international conference on World wide web - WWW '10  
To solve the problem we borrow methods from computational linguistics, computer vision and data mining.  ...  This tutorial focuses on the task of automated information linking in text and multimedia sources. In any task where information is fused from different sources, this linking is a necessary step.  ...  A first challenge is the development of generic algorithms for linking content across documents, languages and media.  ... 
doi:10.1145/1772690.1772928 dblp:conf/www/Moens10 fatcat:257kmivcgvhrxeiezpazifqf6u

Cross-lingual Linking on the Multilingual Web of Data

Jorge Gracia, Elena Montiel-Ponsoda, Asunción Gómez-Pérez
2012 International Semantic Web Conference  
That requires developing techniques for discovering and representing cross-lingual links on the Web of Data.  ...  Even so, mechanisms are still needed to automatically reconcile semantic information when it is expressed in different natural languages, so that access to Web information across language barriers can  ...  This work is supported by the EU project Monnet (FP7-248458), the Spanish national project BabeLData (TIN2010-17550), and the Spanish Ministry of Economy and Competitiveness within the Juan de la Cierva  ... 
dblp:conf/semweb/GraciaMG12 fatcat:cp5z2xh7rfdfbdgy3c4yivge3m

VisualSem: A High-quality Knowledge Graph for Vision and Language [article]

Houda Alberts, Teresa Huang, Yash Deshpande, Yibo Liu, Kyunghyun Cho, Clara Vania, Iacer Calixto
2021 arXiv   pre-print
An exciting frontier in natural language understanding (NLU) and generation (NLG) calls for (vision-and-) language models that can efficiently access external structured knowledge repositories.  ...  We also release a neural multi-modal retrieval model that can use images or sentences as inputs and retrieves entities in the KG.  ...  KC also thanks Naver, eBay, NVIDIA, and NSF Award 1922658 for support.  ... 
arXiv:2008.09150v2 fatcat:w7j5qgq47ng5vnfgoekums4t6m

Language Features Matter: Effective Language Representations for Vision-Language Tasks [article]

Andrea Burns, Reuben Tan, Kate Saenko, Stan Sclaroff, Bryan A. Plummer
2019 arXiv   pre-print
Shouldn't language and vision features be treated equally in vision-language (VL) tasks?  ...  To further elevate language features, we also show that knowledge in vision-language problems can be transferred across tasks to gain performance with multi-task training.  ...  This work is supported in part by DARPA and NSF awards IIS-1724237, CNS-1629700, CCF-1723379.  ... 
arXiv:1908.06327v1 fatcat:z7o4dq62aneprlxqmopuw3ymni

What Does a Language-And-Vision Transformer See: The Impact of Semantic Information on Visual Representations

Nikolai Ilinykh, Simon Dobnik
2021 Frontiers in Artificial Intelligence  
We also show that globally attended objects in deeper layers can be linked with entities described in image descriptions, indicating a critical finding - the indirect effect of language on visual representations  ...  Numerous studies have examined the knowledge captured by language models (LSTMs, transformers) and vision architectures (CNNs, vision transformers) for respective uni-modal tasks.  ...  In addition, similar entities co-occur across images in different conditions and configurations.  ... 
doi:10.3389/frai.2021.767971 pmid:34927063 pmcid:PMC8679841 fatcat:6cwzazualvg55gcdmdz3gnrxrm

Information Extraction and Linking in a Retrieval Context [chapter]

Marie-Francine Moens, Djoerd Hiemstra
2009 Lecture Notes in Computer Science  
In addition, content recognition techniques trigger automated linking of information across documents and even across media.  ...  Emerging information extraction and linking techniques that semantically enrich the data sources (mainly text): named entity recognition, cross-document co-reference resolution, entity linking by expectation  ... 
doi:10.1007/978-3-642-00958-7_93 fatcat:r6g2o7rkfnc4jbckz46u43zqrq

A Web Scale Entity Extraction System [article]

Xuanting Cai, Quanbin Ma, Pan Li, Jianyu Liu, Qi Zeng, Zhengkan Yang, Pushkar Tripathi
2021 arXiv   pre-print
Understanding the semantic meaning of content on the web through the lens of entities and concepts has many practical advantages.  ...  However, when building large-scale entity extraction systems, practitioners are facing unique challenges involving finding the best ways to leverage the scale and variety of data available on internet  ...  Conclusion And Future Work In this paper, we present the platform of the entity extraction at giant internet company's scale. We discuss the practical learnings from our work.  ... 
arXiv:2110.00423v1 fatcat:ftfhvkoieje3jbqfttru22zynq

Consolidating Heterogeneous Enterprise Data for Named Entity Linking and Web Intelligence

Albert Weichselbraun, Daniel Streiff, Arno Scharl
2015 International journal on artificial intelligence tools  
entity linking component.  ...  Linking named entities to structured knowledge sources paves the way for state-of-the-art Web intelligence applications which assign sentiment to the correct entities, identify trends, and reveal relations  ...  Acknowledgment The research presented in this paper has been conducted as part of the COMET Project (, funded by the Swiss Commission for Technology and Innovation (CTI), and the DecarboNet  ... 
doi:10.1142/s0218213015400084 fatcat:spepviuaercwlczu7lscf2k4mu

Named Entity Recognition and Linking Augmented with Large-Scale Structured Data [article]

Paweł Rychlikowski, Bartłomiej Najdecki, Adrian Łańcucki, Adam Kaczmarek
2021 arXiv   pre-print
With the aid of those resources, our system could recognize, normalize and link entities, while being trained with only small amounts of labeled data.  ...  The tasks focused on the analysis of Named Entities in multilingual Web documents in Slavic languages with rich inflection.  ...  We also would like to thank Adam Wawrzyński and Wojciech Janowski from VoiceLab AI for their support during conducting experiments and model training.  ... 
arXiv:2104.13456v1 fatcat:z5y3anpmzzbtpaissmccpra3re

An Empirical Meta-analysis of the Life Sciences (Linked?) Open Data on the Web [article]

Maulik R. Kamdar, Mark A. Musen
2020 arXiv   pre-print
heterogeneity across the LSLOD cloud.  ...  To tackle these challenges, the community has experimented with Semantic Web and linked data technologies to create the Life Sciences Linked Open Data (LSLOD) cloud.  ...  To achieve this vision, the Semantic Web community has developed several standards, languages, and technologies that aim to provide a common framework for data and knowledge representation -linking, sharing  ... 
arXiv:2006.04161v1 fatcat:e2b35ti4cbguhgj3rwf4wml7zq

Stacking With Auxiliary Features

Nazneen Fatema Rajani, Raymond J. Mooney
2017 Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence  
We demonstrate the success of our approach on three very different and challenging natural language and vision problems: Slot Filling, Entity Discovery and Linking, and ImageNet Object Detection.  ...  The instance features enable the stacker to discriminate across input instances and the provenance features enable the stacker to discriminate across component systems.  ...  and Linking tasks in NLP, and ImageNet object detection in computer vision.  ... 
doi:10.24963/ijcai.2017/367 dblp:conf/ijcai/RajaniM17 fatcat:e742hljldjbxbjmdapmfxswnd4
« Previous Showing results 1 — 15 out of 102,594 results