A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
Filters
Barack's Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling
2019
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Preserved Fulltext
To address this, we introduce the knowledge graph language model (KGLM), a neural language model with mechanisms for selecting and copying facts from a knowledge graph that are relevant to the context. ...
We additionally compare different language models' ability to complete sentences requiring factual knowledge, and show that the KGLM outperforms even very large language models in generating facts. ...
Acknowledgements First and foremost, we would like to thank Stephen Merity for sharing the materials used to collect the WikiText-2 dataset, and Nitish Gupta for modifying his entity linker to assist our ...
doi:10.18653/v1/p19-1598
dblp:conf/acl/LoganLPGS19
fatcat:nldh46dgcfdmbg7p77e6awfole
Knowledge-based Biomedical Data Science 2019
[article]
2019
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
Major themes include the relationships between knowledge graphs and machine learning, the use of natural language processing, and the expansion of knowledge-based approaches to novel domains, such as Chinese ...
knowledge graphs. ...
Barack's Wife Hillary:
Using Knowledge Graphs for Fact-Aware Language Modeling
70. Wang Z, Xu S, Zhu L. 2018. ...
arXiv:1910.06710v1
fatcat:kvz5k643zvhpdiq67blc2v33wi
Rome was built in 1776: A Case Study on Factual Correctness in Knowledge-Grounded Response Generation
[article]
2021
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
We use this setup to annotate responses generated using different stateof-the-art models, knowledge snippets, and decoding strategies. ...
Recently neural response generation models have leveraged large pre-trained transformer models and knowledge snippets to generate relevant and informative responses. ...
Barack's wife hillary: Using knowledge graphs for fact-aware language modeling. ...
arXiv:2110.05456v1
fatcat:fqlrknyvfzct7ma5advoabdmb4
Unified Interpretation of Softmax Cross-Entropy and Negative Sampling: With Case Study for Knowledge Graph Embedding
[article]
2021
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
Other Versions
In knowledge graph embedding, the theoretical relationship between the softmax cross-entropy and negative sampling loss functions has not been investigated. ...
Under this interpretation, we can derive theoretical findings for fair comparison. ...
Validation Score Table 7 , 8, and 9 show the best MRR scores of each loss for each model on the validation dataset. Device: In all models, we used a single NVIDIA RTX2080Ti for training. ...
arXiv:2106.07250v2
fatcat:k7ahr62cgnfkpl5yq7sqnk62ba
Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR
[article]
2021
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
Note that this fulltext copy is not of the "primary" version of this work. The version it corresponds to is:
2021 pre-print arXiv:2008.08896v2 fatcat:4calqdizfnhmlckp4vmeugx7qyOther Versions
The second pillar builds on a principle of (grammatical) form ℱ that measures the linguistic quality of the generated text, which we implement using SOTA language models. ...
Systems that generate natural language text from abstract meaning representations such as AMR are typically evaluated using automatic surface matching metrics that compare the generated texts to reference ...
Acknowledgments We are grateful to three anonymous reviewers for their valuable comments that have helped to improve this paper. ...
arXiv:2008.08896v3
fatcat:ezuzxvvmwnavbh7bzlra2jbemq
Transferring Knowledge from Vision to Language: How to Achieve it and how to Measure it?
2021
Proceedings of the Fourth BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP
unpublished
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
Barack’s wife
Hillary: Using knowledge graphs for fact-aware lan- Shaoqing Ren, Kaiming He, Ross Girshick, and Jian
guage modeling. In Proceedings of the 57th Annual Sun. 2015. ...
world information from for example multimodal
visual knowledge transfer to text for uni- or perception (Bisk et al., 2020; Bender and Koller,
multimodal language models. ...
doi:10.18653/v1/2021.blackboxnlp-1.10
fatcat:nacqcm4tpvhchhoas5bvmqnira
An Afrocentric Analysis of the Oratory of President Barack Obama
[article]
2020
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
My findings include, the need for an increase in the appreciation for incremental progress in the African/African American community and the need to refine the ability to recognize and benefit from multiple ...
Afrocentricity I presented a methodology described as Beneficial Extraction method that will highlight the information, examples, strategies and attributes that can be utilized, salvaged and implemented for ...
Complete with charts, graphs, models, diagrams, and other means of statistical analysis, the book proved a literary microscope of sorts that allowed the reader to glean far more from words and their relationships ...
doi:10.34944/dspace/3567
fatcat:76cotposyfcjxdrve23yqd7pce