Forms2Dialog: Automatic dialog generation for Web tasks

Nobal B. Niraula, Amanda Stent, Hyuckchul Jung, Giuseppe Di Fabbrizio, I. Dan Melamed, Vasile Rus
2014 2014 IEEE Spoken Language Technology Workshop (SLT)  
Today, many common tasks (e.g. booking flights, ordering food) can be done by filling out web forms. Automatic processing of Web forms to support interactive speech input is useful for numerous reasons, including ease of use for mobile device users and accessibility for people with visual or print disabilities. In this paper, we propose an automated method to process web forms and convert them into dialog flows for spoken interaction. First we identify relevant information for each form element
more » ... (including element type, label, values and help messages) and key relationships between form elements (including ordering and dependencies). We then generate two types of dialog flow for each Web form. Experimental results show that the method generates efficient and informative dialog flows for web tasks, a key step for building virtual assistants. An Android application has been realized as a use case of the generated dialog flows.
doi:10.1109/slt.2014.7078643 dblp:conf/slt/NiraulaSJFMR14 fatcat:zzbf2mprirbcleqjyicfwipcnq