Multi-modal Interaction in Biomedicine [chapter]

Elena V. Zudilova, Peter M. A. Sloot
2005 Lecture Notes in Computer Science  
This chapter introduces the concept of multi-modal interaction and our findings related to the development of biomedical applications for two different projection modalities: virtual reality and desktop. The case study for this research is a simulation system for vascular reconstruction -the Virtual Radiology Explorer (VRE). The VRE is an interactive simulation-visualization complex aimed to help in making diagnosis and treatment planning for vascular disorders. To make the system functionality
more » ... available both in virtual reality and desktop settings, two versions of the VRE have been implemented. We present their qualitative comparison analysis in respect to the interaction capabilities provided. To check, which projection modality complies better with the expectations of potential users of the VRE, and to find out the possible place of the VRE in real life environments, two user groups -vascular surgeons and interventional radiologists -have been interviewed and their daily activities observed. Users' needs, everyday tasks and preferences have been analyzed; the main results are summarized in this chapter. Among others it has been found that the combination of virtual reality and desktop projection modalities within the same interaction-visualization environment may help to satisfy a wider range of the VRE users in comparison to the case, where only one projection modality is used. To finalise the chapter, we discuss three alternative solutions on how this concept can be deployed. To provide a clinician with an intuitive environment to solve a target class of problems, a biomedical application has to be built in such a way that a user can exploit modern technologies without specialised knowledge of underlying hardware and software [18] . Unfortunately, in reality the situation is different. Many developers do not take into account the fact that their potential users are people, who are mostly inexperienced computer users, and as a result they need intuitive interaction capabilities and a relevant feedback adapted to their knowledge and skills. User comfort is very important for the success of any software application [13] . But very often we forget that usability problems may arise not only from a 'uncomfortable' graphical user interface (GUI), but also from a projection modality chosen incorrectly for deploying an interactive environment [16] . Existing projection modalities have not been sufficiently investigated yet in respect to usability factors. Meanwhile, the selection of an appropriate projection modality in accordance with the user's tasks, preferences and personal features might help in building a motivated environment for biomedical purposes. In this chapter we summarise our recent findings related to this research and introduce a new concept of multi-modal interaction based on the combination of virtual reality (VR) and desktop projection modalities within the same system. For the case study of the research we used a biomedical application simulating vascular reconstruction [2, 22] . The rest of the chapter is organised as follows. Section 2 introduces concepts of a multi-modal interaction and projection modalities. Section 3 describes the biomedical application for vascular reconstruction deployed for two different projection modalities. Section 4 is devoted to the experiments on user profiling. Both the methodology, on which the user profiling was based, and the results are presented here. In section 5 the possibilities of how VR and desktop projection modalities can be combined are discussed. Finally, conclusions and plans for future research are presented in section 6. 2 Stenosis is a narrowing or blockage of the artery [21] 3 An aneurysmal disease is a balloon like swelling in the artery [21]
doi:10.1007/978-3-540-32263-4_9 fatcat:3abp7xbt2rhfjlyrz4xeuklrzu