Towards Multi-Modal Conversational Information Seeking

Yashar Deldjoo, Johanne R. Trippas, Hamed Zamani
2021 Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval  
Recent research on conversational information seeking (CIS) mostly focuses on uni-modal interactions and information items. This perspective paper highlights the importance of moving towards developing and evaluating multi-modal conversational information seeking (MMCIS) systems as they enable us to leverage richer context, overcome errors, and increase accessibility. We bridge the gap between the multi-modal and CIS research and provide a formal definition for MMCIS. We discuss potential
more » ... unities and research challenges in designing, implementing, and evaluating MMCIS systems. Based on this research, we propose and implement a practical open-source framework for facilitating MMCIS research.
doi:10.1145/3404835.3462806 fatcat:7rr7vbb4hzd2tcx2fmrx6ya42q