Filters








22,354 Hits in 9.8 sec

Faithfulness in Natural Language Generation: A Systematic Survey of Analysis, Evaluation and Optimization Methods [article]

Wei Li, Wenhao Wu, Moye Chen, Jiachen Liu, Xinyan Xiao, Hua Wu
2022 arXiv   pre-print
In this survey, we provide a systematic overview of the research progress on the faithfulness problem of NLG, including problem analysis, evaluation metrics and optimization methods.  ...  Many studies on analysis, evaluation, and optimization methods for faithfulness problems have been proposed for various tasks, but have not been organized, compared and discussed in a combined manner.  ...  In Section 2, we give a systematic analysis on the faithfulness problem in NLG, including categorization of unfaithful errors, manual annotations, challenges for evaluating and optimizing faithfulness,  ... 
arXiv:2203.05227v1 fatcat:q2u3ojyi6vb7pjt6ajwbinjmpa

Generative Phonology [chapter]

M. Kenstowicz
2006 Encyclopedia of Language & Linguistics  
generated by the syntactic component of the grammar and that this competence can be investigated in a serious scientific fashion.  ...  Noam Chomsky and Morris Halle founded the Generative School of Phonology in the late 1950's.  ...  SPE)is the first systematic exposition of generative phonology.  ... 
doi:10.1016/b0-08-044854-2/00087-0 fatcat:nm4tpqxiojewdexlccabam76ka

A Survey of Natural Language Generation [article]

Chenhe Dong, Yinghui Li, Haifan Gong, Miaoxin Chen, Junxin Li, Ying Shen, Min Yang
2021 arXiv   pre-print
This paper offers a comprehensive review of the research on Natural Language Generation (NLG) over the past two decades, especially in relation to data-to-text generation and text-to-text generation deep  ...  This survey aims to (a) give the latest synthesis of deep learning research on the NLG core tasks, as well as the architectures adopted in the field; (b) detail meticulously and comprehensively various  ...  A Survey of Natural Language Generation 1:25 2 BOT).  ... 
arXiv:2112.11739v1 fatcat:ygrpp6f25ja4vfbhcr5ycfpxhy

Development of the EMAP tool facilitating existential communication between general practitioners and cancer patients

Elisabeth Assing Hvidt, Dorte Gilså Hansen, Jette Ammentorp, Lars Bjerrum, Søren Cold, Pål Gulbrandsen, Frede Olesen, Susanne S. Pedersen, Jens Søndergaard, Connie Timmermann, Helle Timm, Niels Christian Hvidt
2017 European Journal of General Practice  
The tool utilized the acronym and mnemonic EMAP (existential communication in general practice) indicating the intention of the tool: to provide a map of possible existential problems and resources that  ...  A mixed-methods design was chosen comprising a literature search, focus group interviews with GPs and patients (n = 55) and a two-round Delphi procedure initiated by an expert meeting with 14 experts from  ...  Acknowledgements The authors wish to thank all the GPs and patients participating in this study for their time and interest.  ... 
doi:10.1080/13814788.2017.1326479 pmid:28799437 pmcid:PMC8816390 fatcat:pylitkfsizeahcdfmjtbjb6hme

Towards Explainable Evaluation Metrics for Natural Language Generation [article]

Christoph Leiter and Piyawat Lertvittayakumjorn and Marina Fomicheva and Wei Zhao and Yang Gao and Steffen Eger
2022 arXiv   pre-print
Finally, we provide a vision of future approaches to explainable evaluation metrics and their evaluation.  ...  In this concept paper, we identify key properties and propose key goals of explainable machine translation evaluation metrics.  ...  Introduction The field of evaluation metrics for Natural Language Generation (NLG) is currently in a deep crisis: While multiple high-quality evaluation metrics (Zhao et al. 2019; Rei et al. 2020; Sellam  ... 
arXiv:2203.11131v1 fatcat:lcfy3vs445btdd4am3sakroek4

Cross-Lingual Dialogue Dataset Creation via Outline-Based Generation [article]

Olga Majewska, Evgeniia Razumovskaia, Edoardo Maria Ponti, Ivan Vulić, Anna Korhonen
2022 arXiv   pre-print
Our Cross-lingual Outline-based Dialogue dataset (termed COD) enables natural language understanding, dialogue state tracking, and end-to-end dialogue modelling and evaluation in 4 diverse languages: Arabic  ...  Through this process we annotate a new large-scale dataset for training and evaluation of multilingual and cross-lingual ToD systems.  ...  Acknowledgements This work has been funded by the ERC PoC Grant MultiConvAI: Enabling Multilingual Conversational AI (no. 957356) and a research donation from Huawei.  ... 
arXiv:2201.13405v1 fatcat:burfwrksf5h33jy6tirttao4ga

Evaluation of Text Generation: A Survey [article]

Asli Celikyilmaz, Elizabeth Clark, Jianfeng Gao
2021 arXiv   pre-print
The paper surveys evaluation methods of natural language generation (NLG) systems that have been developed in the last few years.  ...  For each category, we discuss the progress that has been made and the challenges still being faced, with a focus on the evaluation of recently proposed NLG tasks and neural NLG models.  ...  We encourage researchers working in NLG and NLG evaluation to focus on these challenges moving forward, as they will help sustain and broaden the progress we have seen in NLG so far.  ... 
arXiv:2006.14799v2 fatcat:lmuybcpyerafjlvuq526cpslhq

IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation [article]

Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung
2021 arXiv   pre-print
Here we introduce IndoNLG, the first benchmark to measure natural language generation (NLG) progress in three low-resource -- yet widely spoken -- languages of Indonesia: Indonesian, Javanese, and Sundanese  ...  Natural language generation (NLG) benchmarks provide an important avenue to measure progress and develop better NLG systems.  ...  In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Lan- guage Processing (EMNLP-IJCNLP), pages 6100- 6113  ... 
arXiv:2104.08200v3 fatcat:txxm4lltvvhp3dwhxmejj7yjaq

From Generalized Trust to Street Smart

Carina Gunnarson
2018 Young - Nordic Journal of Youth Research  
Rather than referring to trust in people in general, about a third of the responses expressed themes related to rational trust, that is, trust is domainspecific and person-specific.  ...  It builds on unique material, including survey responses (N = 356) and letters (N = 28) from students aged 18-19 years, collected by the author in seven secondary schools in Stockholm.  ...  Acknowledgements I am grateful to the students who participated in this study, generously sharing their thoughts on social trust.  ... 
doi:10.1177/1103308818788407 fatcat:loyvyhrmzfftxetrxbwnnastny

Sustainability in Software Engineering Education: a case of general professional competencies

Serhiy Semerikov, Andrii Striuk, Larysa Striuk, Mykola Striuk, Hanna Shalatska, S. Semerikov, S. Chukharev, S. Sakhno, A. Striuk, V. Osadchyi, V. Solovieva, T. Vakaliuk (+3 others)
2020 E3S Web of Conferences  
patterns of the subject area development, its place in the general system of knowledge about nature and society and in the development of society, equipment's and technology, to use various types and  ...  A system of general professional competencies is designed to build sustainable professional competence of software engineering specialist: 1) ability for abstract thinking, analysis and synthesis; 2) ability  ...  Ability to communicate in a foreign language Sanjay Goel analyzes the results of a survey of Indian employers and includes English language skills in the list of 10 most important engineering and general  ... 
doi:10.1051/e3sconf/202016610036 fatcat:fnihtj2x65bhzej4tyz5fgydne

General Chairman's Message

2004 PLANS 2004 Position Location and Navigation Symposium (IEEE Cat No 04CH37556) PLANS-04  
We, thank Todd Grimm and Bruce Labaw for implementing support for our verification method in the SCR toolset.  ...  Acknowledgements We would like to thank Lincoln Wallen for drawing our attention to the connection between tailinvariants and our generalization critic.  ...  Evaluation Framework Framework Basis Our objective was to evaluate formal methods in a systematic manner, and an evaluation framework enabled us to generate a clear and complete set of evaluation criteria  ... 
doi:10.1109/plans.2004.1308961 fatcat:jrv2qudaw5e4fm7vtyfx4clip4

General Chairman's Message

1986 MILCOM 1986 - IEEE Military Communications Conference: Communications-Computers: Teamed for the 90's  
We, thank Todd Grimm and Bruce Labaw for implementing support for our verification method in the SCR toolset.  ...  Acknowledgements We would like to thank Lincoln Wallen for drawing our attention to the connection between tailinvariants and our generalization critic.  ...  Evaluation Framework Framework Basis Our objective was to evaluate formal methods in a systematic manner, and an evaluation framework enabled us to generate a clear and complete set of evaluation criteria  ... 
doi:10.1109/milcom.1986.4805639 fatcat:yv3yt6hivvg4bjtj5ftdxp7dke

General Chairman's Message

2006 2006 Proceedings of the First Mobile Computing and Wireless Communication International Conference  
We, thank Todd Grimm and Bruce Labaw for implementing support for our verification method in the SCR toolset.  ...  Acknowledgements We would like to thank Lincoln Wallen for drawing our attention to the connection between tailinvariants and our generalization critic.  ...  Evaluation Framework Framework Basis Our objective was to evaluate formal methods in a systematic manner, and an evaluation framework enabled us to generate a clear and complete set of evaluation criteria  ... 
doi:10.1109/mcwc.2006.4375180 fatcat:c4cqrusqb5bcrczqa2fu77zgfu

General Chairman's Message

1986 MILCOM 1986 - IEEE Military Communications Conference: Communications-Computers: Teamed for the 90's  
We, thank Todd Grimm and Bruce Labaw for implementing support for our verification method in the SCR toolset.  ...  Acknowledgements We would like to thank Lincoln Wallen for drawing our attention to the connection between tailinvariants and our generalization critic.  ...  Evaluation Framework Framework Basis Our objective was to evaluate formal methods in a systematic manner, and an evaluation framework enabled us to generate a clear and complete set of evaluation criteria  ... 
doi:10.1109/milcom.1986.4805724 fatcat:ywopnvuobzd7nfg5vqbicn6wcy

General Chairman's Message

1985 22nd ACM/IEEE Design Automation Conference  
We, thank Todd Grimm and Bruce Labaw for implementing support for our verification method in the SCR toolset.  ...  Acknowledgements We would like to thank Lincoln Wallen for drawing our attention to the connection between tailinvariants and our generalization critic.  ...  Evaluation Framework Framework Basis Our objective was to evaluate formal methods in a systematic manner, and an evaluation framework enabled us to generate a clear and complete set of evaluation criteria  ... 
doi:10.1109/dac.1985.1585898 fatcat:qcddxeqjfrgcnkywt4dlol5s2u
« Previous Showing results 1 — 15 out of 22,354 results