Multilingual Conversational Systems to Drive the Collection of PROs and Integration into Clinical Workflow

Daniel Hari, Valentino Šafran, Umut Arioz, Izidor Mlakar, Matej Rojc, Gazihan Alankus, Rafael Perez Luna
2021 WSEAS Transactions on Biology and Biomedicine  
Collection of patient-reported outcomes (PROs) remotely and their usage in the clinical workflow provide an improvement on both patient's quality of life and cancer care. However, adoption of collecting PROs into the clinical workflow is rare, and existing works still have a lot of issues providing a holistic approach. This paper offers enhancements in the process of collecting PROs by utilization of conversational systems that still provide quite a new but promising way to collect PROs
more » ... with spoken interaction. Our proposed system provides an interoperability with Fast Healthcare Interoperability Resources (FHIR) server by using a multimodal sensing network (MSN) prepared for the project PERSIST. We introduce components of multimodality while collecting PROs with the help of the mHealth App and Open Health Connect (OHC) platform. As a result, chatbots and 3D embodied conversational agents (ECA) were prepared to interact with the cancer patients in 5 different languages. The intercommunication was provided by MSN and the integration of cancer patients' PROs into clinical workflow was satisfied. This study was part of a Horizon 2020 project and a preparation phase for clinical trials with cancer patients and clinicians
doi:10.37394/23208.2021.18.13 fatcat:rk3ii7gaqvhwzeh2hoqo3zhc6a