Perception, Meaning and Transmodal Design

Mathias Nordvall, Mattias Arvola
2016 DRS2016: Future-Focused Thinking   unpublished
Our perceptual system allows us to experience and make meaning of the world through different modalities. We can move between feeling, seeing and hearing things and still makes sense of our world. Our cognitive activities are transmodal. In interaction design this means that both our design processes and our users' interactions are transmodal. We have gained insights into how transitions between modalities, both in the design context and in the users' interaction context, modulate meaning and
more » ... perience, by analysing three interactive systems: SimProv, VibEd, and Sightlence. We propose that a transmodal design approach facilitate designers to realize the communicative potential of different modalities, and hence present users with a transmodal perspective on their interaction space that allow for continuous rearrangement and use of modalities.
doi:10.21606/drs.2016.511 fatcat:yssyg3yrdvcejd6nh33wxs4le4