2,847 Hits in 5.8 sec

Multimodality, Cognitive Poetics, and Genre: Reading Grady Hendrix's novel Horrorstör

Alison Gibbons
2016 Multimodal Communication  
Brought to you by | Sheffield Hallam University Authenticated Download Date | 10/25/16 5:11 PM  ...  Nevertheless, the framework can and should be applied in genre analysis to other multimodal fictions. For instance, Mark Z.  ...  Danielewski's (2000) House of Leaves is also often discussed as a horror fiction; thus it would be beneficial to apply the model in order to reveal the mechanisms by which it aligns itself to such generic  ... 
doi:10.1515/mc-2016-0008 fatcat:n6vnfenefracxaielben5bx2pi

Cognitive Multimodal Processing

Alexandros Potamianos
2014 Proceedings of the 2014 Workshop on Roadmapping the Future of Multimodal Interaction Research including Business Opportunities and Challenges - RFMIR '14  
model are either biased cognitive abstractions of the real world or altogether fictional creations of our cognition.  ...  It is shown that such models can achieve good generalization and representation power, as well as model cognitive biases, a prerequisite for modeling and predicting human behavior.  ...  For example, it is well established that the sense of touch is organized as a two-dimensional map of the body (down from three dimensions in the physical world).  ... 
doi:10.1145/2666253.2666264 dblp:conf/icmi/Potamianos14 fatcat:xfdx5hnlarenjdmb4e7gw6m5ey

Multimodality and Expressivity in Videogames

Nelson Zagalo
2019 Observatorio (OBS*)  
recommendations, its launch still led to strong protests calling for the application 4 to be shut down.  ...  This article addresses multimodality and expressivity in digital games, from the perspective of audiovisual communication, discussing essential critical dimensions regarding game literacy and experience  ...  Acknowledgements This work was co-financed by the European Union through the European Regional Development Fund, the 2020 Center Program, under the project "Learn 21: Game-based m-learning for children  ... 
doi:10.15847/obsobs13120191411 fatcat:sqld6qt6ujfx3hlfdkb4eoalcq

Multimodal Emotion-Cause Pair Extraction in Conversations [article]

Fanfan Wang, Zixiang Ding, Rui Xia, Zhaoyu Li, Jianfei Yu
2021 arXiv   pre-print
We finally benchmark the task by establishing a baseline system that incorporates multimodal features for emotion-cause pair extraction.  ...  Preliminary experimental results demonstrate the potential of multimodal information fusion for discovering both emotions and causes in conversations.  ...  mechanism.  ... 
arXiv:2110.08020v1 fatcat:3h4nblvws5eylky33v4l4uv4ni

Supporting Multi-user Participation with Affective Multimodal Fusion

Céline Coutrix, Giulio Jacucci, Ivan Advouevski, Valentin Vervondel, Marc Cavazza, Stephen W. Gilroy, Lorenza Parisi
2011 2011 Ninth International Conference on Creating, Connecting and Collaborating through Computing  
We describe, through interaction analysis, how users utilised the different modalities, suggesting implications for implementing multimodal aesthetic applications to support multi-user participation: tracking  ...  In this paper, we present an application of affective computing as an art installation designed for group interaction.  ...  ACKNOWLEDGMENTS The authors would to thank members of the other partners in CALLAS who developed the modality components used in The  ... 
doi:10.1109/c5.2011.14 dblp:conf/c5/CoutrixJAVCGP11 fatcat:etfdazlaibhullvyvhr7dzzvym

Audio Description, Rhetoric and Multimodality

Cristina Álvarez de Morales
2011 Journal of Language Teaching and Research  
This paper constitutes a theoretical reflection within the Project AMATRA of the University of Granada (Spain), part of the European Project Technological on-line framework to integrate the work flow of  ...  We also are member of the Project PRA2 which is oriented towards creating a technological website platform open to any user, where people, regardless of the functional characteristics, can interact with  ...  We know that the pragmatic dimension of the speech act has to do with Semantics and Syntax as well.  ... 
doi:10.4304/jltr.2.5.949-956 fatcat:6tqidkxurnhofm2ywmzgfmdv6e

Creating Standardized Video Recordings of Multimodal Interactions across Cultures [chapter]

Matthias Rehm, Elisabeth André, Nikolaus Bee, Birgit Endrass, Michael Wissner, Yukiko Nakano, Afia Akhter Lipi, Toyoaki Nishida, Hung-Hsuan Huang
2009 Lecture Notes in Computer Science  
necessary to collect multimodal corpora in a standardized fashion in different cultures.  ...  To gain such insights in the interrelation of culture and behavior patterns, the information from the literature is often too anecdotal to serve as the basis for modeling a system's behavior, making it  ...  For this purpose, it is indespensable to take the semantics of Hofstede's dimensions into account.  ... 
doi:10.1007/978-3-642-04793-0_9 fatcat:cium2q4nvvhk3onffuwe7xggyy

Multimodality and Fantasy and Stories in University Teacher Training1

Adolf Piquer Vidal
2015 Procedia - Social and Behavioral Sciences  
What has been called multimodality provokes a variety of discourses that rain down on us with a combination of codes that makes semiotics more complex.  ...  ), and, finally, transposition to teaching in the classroom with various semiotic codes (oral, writing, images...).  ...  It is not necessary to be reminded the link with Jules Verne's science fiction narrative in De la Terre à la Lune Trajet direct en 97 heures (1863) -another dimension of Romantic fantasy according to  ... 
doi:10.1016/j.sbspro.2015.03.179 fatcat:tcn2gt5e5re65hs6qbabch2x2q

Humorous nonsense and multimodality in British and American children's poetry

Elzbieta Chrzanowska-Kluczewska
2017 The European Journal of Humour Research  
In all the poems to be analyzed multimodality has an important role to play in the creation and strengthening of the effect of humorous bisociation/incongruity.  ...  A tight intertwining of the phonetic, semantic and visual layers in such texts becomes an additional challenge for their translators. The theoretical keystone for our considerations remains H.  ...  That is, it is as if children's nonsense poetry takes the effect of hilariousness for granted.  ... 
doi:10.7592/ejhr2017.5.3.kluczewska fatcat:lulg7evhpjbfbef5s37o46fe5a

Multimodal Metaphor in Ten Dutch TV Commercials

Charles Forceville
2007 The public journal of semiotics  
On the basis of the case studies, the last sections of the paper discuss three issues that are crucial for further study: (1) the ways in which similarity is cued in multimodal, as opposed to verbal, metaphors  ...  Another limitation of the CMT paradigm is that it has tended to focus on deeply embedded metaphors rather than on creative metaphors of the kind that Black (1979) discusses.  ...  Acknowledgments I am indebted to John Kennedy and Paul Thibault for their extensive peer review comments on an earlier draft of this paper.  ... 
doi:10.37693/pjos.2007.1.8812 fatcat:xf5o6vl6wragzno2uqzd4tw6n4

Games Versus Reality? How Game Designers Deal with Current Topics of Geography Education

Joelle-Denise Lux, Alexandra Budke, Emmanuel Guardiola
2021 Multimodal Technologies and Interaction  
We found the most problematic one to be the prioritization of player expectations for the sake of perceived realism. This approach may lead to the depiction of stereotypes and common misconceptions.  ...  In many cases, the interviewees' approach to incorporating real-world issues can be regarded as beneficial for their games' educational potential, and some designers even pursued learning goals.  ...  This type of realism can again apply to completely fantastic settings as even in a fictional world, such as a science-fiction setting in another universe, outcomes of players' actions can be persistent  ... 
doi:10.3390/mti5110070 fatcat:gq3qc7yfqfawfc6ewd4wtfb5vy

The Adaptive Process of Multimodal Composition: How Developing Tacit Knowledge of Digital Tools Affects Creative Writing

R. Lyle Skains
2017 Computers and Composition  
shifting to a multimodal, digital composition process.  ...  These conclusions, drawn from an in-depth experimentation for the express purposes of research, have implications not only for individual creative writers, but for students and teachers moving into multimodal  ...  As my long-term memory, or explicit knowledge, of digital fiction and its affordances developed, my composition practice adapted to these additional dimensions.  ... 
doi:10.1016/j.compcom.2016.11.009 fatcat:br5cf55od5fahonwoxflkkjzla

The Semiotics of Typography in Literary Texts. A Multimodal Approach

Nina Nørgaard
2009 Orbis Litterarum  
To this end, the article deploys and examines the approach to multimodal discourse proposed, for instance, by Kress and Van Leeuwen (2001) and Baldry and Thibault (2006) , and, more specifically, the multimodal  ...  This article explores from a multimodal perspective the extent to which the visual aspect of printed verbal language is meaning-making in its own right, and how it interacts with other modes of meaning  ...  produced another hit', and so on (pp. 512-513) -this particular meaning arises as a multimodal construct.  ... 
doi:10.1111/j.1600-0730.2008.00949.x fatcat:lrxfzjuminhtbhfhu6pc4vu6b4

Towards Designing Diegetic Gaze in Games: The Use of Gaze Roles and Metaphors

Argenis Ramirez Gomez, Michael Lankes
2019 Multimodal Technologies and Interaction  
Within this work, the current literature in the field is analysed to seek examples that design around gaze mechanics and follow a diegetic approach that takes roles and metaphors into account.  ...  Gaze interaction roles represent ambiguous mechanics in gaze, whereas gaze metaphors serve as narrative figures that symbolise, illustrate, and are applied to the interaction dynamics.  ...  In another game, the player could take the role of the Midas character whose goal is to avoid looking at specific game entities.  ... 
doi:10.3390/mti3040065 fatcat:agemfrhbure7tcxllzgmzz4dam

A Survey on Audio Synthesis and Audio-Visual Multimodal Processing [article]

Zhaofeng Shi
2021 arXiv   pre-print
Meanwhile, significant efforts have been dedicated by researchers to handle multimodal tasks at present such as audio-visual multimodal processing.  ...  This survey can provide some guidance for researchers who are interested in the areas like audio synthesis and audio-visual multimodal processing.  ...  Audio-visual multimodal processing Audio-visual multimodal processing means to accurately extract the low-dimensional features of acoustic and visual information, and then modelling the correlations between  ... 
arXiv:2108.00443v1 fatcat:5xkj7lf7pfgpppvfqwynoqkqjm
« Previous Showing results 1 — 15 out of 2,847 results