Interaction Quality Estimation in Spoken Dialogue Systems Using Hybrid-HMMs

Stefan Ultes, Wolfgang Minker
2014 Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL)  
Research trends on SDS evaluation are recently focusing on objective assessment methods. Most existing methods, which derive quality for each systemuser-exchange, do not consider temporal dependencies on the quality of previous exchanges. In this work, we investigate an approach for determining Interaction Quality for human-machine dialogue based on methods modeling the sequential characteristics using HMM modeling. Our approach significantly outperforms conventional approaches by up to 4.5%
more » ... ative improvement based on Unweighted Average Recall metrics.
doi:10.3115/v1/w14-4328 dblp:conf/sigdial/UltesM14 fatcat:4wxit6fuvvc3vesspzov45bjjy