7 Hits in 4.1 sec

Barack's Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling

Robert Logan, Nelson F. Liu, Matthew E. Peters, Matt Gardner, Sameer Singh
2019 Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics  
To address this, we introduce the knowledge graph language model (KGLM), a neural language model with mechanisms for selecting and copying facts from a knowledge graph that are relevant to the context.  ...  We additionally compare different language models' ability to complete sentences requiring factual knowledge, and show that the KGLM outperforms even very large language models in generating facts.  ...  Acknowledgements First and foremost, we would like to thank Stephen Merity for sharing the materials used to collect the WikiText-2 dataset, and Nitish Gupta for modifying his entity linker to assist our  ... 
doi:10.18653/v1/p19-1598 dblp:conf/acl/LoganLPGS19 fatcat:nldh46dgcfdmbg7p77e6awfole

Knowledge-based Biomedical Data Science 2019 [article]

Tiffany J. Callahan, Ignacio J. Tripodi Computational Bioscience Program, Department of Pharmacology, University of Colorado Denver Anschutz Medical Campus
2019 arXiv   pre-print
Major themes include the relationships between knowledge graphs and machine learning, the use of natural language processing, and the expansion of knowledge-based approaches to novel domains, such as Chinese  ...  knowledge graphs.  ...  Barack's Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling 70. Wang Z, Xu S, Zhu L. 2018.  ... 
arXiv:1910.06710v1 fatcat:kvz5k643zvhpdiq67blc2v33wi

Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generation [article]

Sashank Santhanam, Behnam Hedayatnia, Spandana Gella, Aishwarya Padmakumar, Seokhwan Kim, Yang Liu, Dilek Hakkani-Tur
2021 arXiv   pre-print
We use this setup to annotate responses generated using different stateof-the-art models, knowledge snippets, and decoding strategies.  ...  Recently neural response generation models have leveraged large pre-trained transformer models and knowledge snippets to generate relevant and informative responses.  ...  Barack's wife hillary: Using knowledge graphs for fact-aware language modeling.  ... 
arXiv:2110.05456v1 fatcat:fqlrknyvfzct7ma5advoabdmb4

Unified Interpretation of Softmax Cross-Entropy and Negative Sampling: With Case Study for Knowledge Graph Embedding [article]

Hidetaka Kamigaito, Katsuhiko Hayashi
2021 arXiv   pre-print
In knowledge graph embedding, the theoretical relationship between the softmax cross-entropy and negative sampling loss functions has not been investigated.  ...  Under this interpretation, we can derive theoretical findings for fair comparison.  ...  Validation Score Table 7 , 8, and 9 show the best MRR scores of each loss for each model on the validation dataset. Device: In all models, we used a single NVIDIA RTX2080Ti for training.  ... 
arXiv:2106.07250v2 fatcat:k7ahr62cgnfkpl5yq7sqnk62ba

Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR [article]

Juri Opitz, Anette Frank
2021 arXiv   pre-print
The second pillar builds on a principle of (grammatical) form ℱ that measures the linguistic quality of the generated text, which we implement using SOTA language models.  ...  Systems that generate natural language text from abstract meaning representations such as AMR are typically evaluated using automatic surface matching metrics that compare the generated texts to reference  ...  Acknowledgments We are grateful to three anonymous reviewers for their valuable comments that have helped to improve this paper.  ... 
arXiv:2008.08896v3 fatcat:ezuzxvvmwnavbh7bzlra2jbemq

Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it?

Tobias Norlund, Lovisa Hagström, Richard Johansson
2021 Proceedings of the Fourth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP   unpublished
Barack’s wife Hillary: Using knowledge graphs for fact-aware lan- Shaoqing Ren, Kaiming He, Ross Girshick, and Jian guage modeling. In Proceedings of the 57th Annual Sun. 2015.  ...  world information from for example multimodal visual knowledge transfer to text for uni- or perception (Bisk et al., 2020; Bender and Koller, multimodal language models.  ... 
doi:10.18653/v1/2021.blackboxnlp-1.10 fatcat:nacqcm4tpvhchhoas5bvmqnira

An Afrocentric Analysis of the Oratory of President Barack Obama [article]

(:Unkn) Unknown, University, My, Molefi Kete Asante
My findings include, the need for an increase in the appreciation for incremental progress in the African/African American community and the need to refine the ability to recognize and benefit from multiple  ...  Afrocentricity I presented a methodology described as Beneficial Extraction method that will highlight the information, examples, strategies and attributes that can be utilized, salvaged and implemented for  ...  Complete with charts, graphs, models, diagrams, and other means of statistical analysis, the book proved a literary microscope of sorts that allowed the reader to glean far more from words and their relationships  ... 
doi:10.34944/dspace/3567 fatcat:76cotposyfcjxdrve23yqd7pce