A Survey of Available Corpora for Building Data-Driven Dialogue Systems [article]

Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, Joelle Pineau
<span title="2017-03-21">2017</span> <i > arXiv </i> &nbsp; <span class="release-stage" >pre-print</span>
During the past decade, several areas of speech and language understanding have witnessed substantial breakthroughs from the use of data-driven models. In the area of dialogue systems, the trend is less obvious, and most practical systems are still built through significant engineering and expert knowledge. Nevertheless, several recent results suggest that data-driven approaches are feasible and quite promising. To facilitate research in this area, we have carried out a wide survey of publicly
more &raquo; ... vailable datasets suitable for data-driven learning of dialogue systems. We discuss important characteristics of these datasets, how they can be used to learn diverse dialogue strategies, and their other potential uses. We also examine methods for transfer learning between datasets and the use of external knowledge. Finally, we discuss appropriate choice of evaluation metrics for the learning objective.
<span class="external-identifiers"> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1512.05742v3">arXiv:1512.05742v3</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/lh34cnbvefcfxp2qwxfyiuuwhm">fatcat:lh34cnbvefcfxp2qwxfyiuuwhm</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200930192848/https://arxiv.org/pdf/1512.05742v3.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/53/9f/539fc98ebae8d7b18f9ab2ff26a0cd6194fb41f9.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/1512.05742v3" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>