5,830 Hits in 3.1 sec

A Multi-Modal Approach to Perceptual Tone Mapping

Sira Ferradans, Marcelo Bertalmío, Edoardo Provenzi, Vicent Caselles
2009 2009 Conference for Visual Media Production  
We present an improvement of TSTM, a recently proposed tone mapping operator for High Dynamic Range (HDR) images, based on a multi-modal analysis.  ...  Finally, we properly select the parameters in order to merge those equations into a continuous function.  ...  Caselles also wants to acknowledge "ICREA Acadèmia" prize for excellence in  ... 
doi:10.1109/cvmp.2009.16 fatcat:4r7dowcty5ex5nvwvflg6fkrkm

Interacting Perceptual Dimensions [chapter]

2004 Ecological Psychoacoustics  
On subsequent trials the listener is presented with different intensity tones and is asked to assign a number to the loudness that represents the relationship to the first tone heard.  ...  In many psychoacoustic experiments, the objective is to investigate some aspect of a particular perceptual dimension.  ...  perceptual modalities.  ... 
doi:10.1163/9780080477442_013 fatcat:azonzzw7arfwlehdjyra7quuea

Optimality and limitations of audio-visual integration for cognitive systems [article]

W. Paul Boyce, Tony Lindsay, Arkady Zgonnikov, Ignacio Rano, KongFatt Wong-Lin
2020 arXiv   pre-print
In humans, this process has often been shown to be statistically optimal, or near optimal: sensory information is combined in a fashion that minimises the average error in perceptual representation of  ...  Multimodal integration is an important process in perceptual decision-making.  ...  Acknowledgements The authors are also grateful to Shufan Yang for helpful discussions on the computational modelling.  ... 
arXiv:1912.00581v3 fatcat:p6h64uqenvdfnjjtbflr6b3cyy

Optimality and Limitations of Audio-Visual Integration for Cognitive Systems

William Paul Boyce, Anthony Lindsay, Arkady Zgonnikov, Iñaki Rañó, KongFatt Wong-Lin
2020 Frontiers in Robotics and AI  
In humans, this process has often been shown to be statistically optimal, or near optimal: sensory information is combined in a fashion that minimizes the average error in perceptual representation of  ...  Multimodal integration is an important process in perceptual decision-making.  ...  All authors contributed to structuring, revising, and proofreading of the manuscript. ACKNOWLEDGMENTS The authors are grateful to Shufan Yang for helpful discussions on the computational modeling.  ... 
doi:10.3389/frobt.2020.00094 pmid:33501261 pmcid:PMC7805627 fatcat:ms4sgukvuzecnfauzy4amjs6tu

A Survey on Quantitative Assessment of the Quality of Tone-Mapped Images using TMQI-LI

2017 International Journal of Innovations in Engineering and Technology  
It is; therefore; of particular importance and necessity to conduct experimental subjective evaluations of the computational approaches that incorporate various tone mapping operators to judge and validate  ...  Even though the knowledge of tone mapping is continuously developing, many unanswered questions and hypotheses still remain to be solved.  ...  The suitability of multi-scale fusion for other forensic features will be investigated. Positive results would indicate feasibility of a combined multi-modal and multi-scale approach.  ... 
doi:10.21172/ijiet.82.026 fatcat:py2jc77mbvbchkdst2ngstcyrq

Modality-independent representations of small quantities based on brain activation patterns

Saudamini Roy Damarla, Vladimir L. Cherkassky, Marcel Adam Just
2016 Human Brain Mapping  
The main finding demonstrated, for the first time, that quantities of dots were decodable by a classifier that was trained on the neural patterns evoked by quantities of auditory tones, and vice-versa.  ...  Here we apply these techniques to investigate whether neural representations of quantities depicted in one modality (say, visual) can be decoded from brain activation patterns evoked by quantities depicted  ...  ACKNOWLEDGMENTS The authors thank Justin A. Abernethy for assistance with the data collection, and Sandesh Aryal for help with data analysis.  ... 
doi:10.1002/hbm.23102 pmid:26749189 pmcid:PMC5384793 fatcat:m52mrzfv3fdedkgflq6js4bj5u

Digital interactions

Eleni Ira Panourgia, Finbar Wheelaghan, Xue Yang
2018 Airea Arts and Interdisciplinary Research  
Our practice-based approach entails the rendering of a three-dimensional digital object in Processing whose form changes over time according to specific actions.  ...  We use digital technology to look beyond basic synchronisation of sound and vision to a more complex cohesion of percepts, based on changes to myriad sonic and visual parameters experienced concurrently  ...  This work achieved an action-based digital approach that allowed precise and direct mapping of parameters of the transformation of both modalities.  ... 
doi:10.2218/airea.2732 fatcat:ajb5c3y7yvhqzl3cdq3s53ztui

Some Approaches To Representing Sound With Colour And Shape

Lindsay Vickery
2018 Zenodo  
This paper explores the implications of recent research into cross-modal colour-to-sound and shape-to sound map-pings for the application of colour and shape in musical scores.  ...  with alter-native notational approaches (gestural, action-based and graphical for example) in a single digital document.  ...  CROSS-MODAL CORRESPONDENCE The perceptual phenomenon now generally referred to as Cross-Modal Correspondence (CMC), defined by Marks as "natural correspondences between experiences in different sense modalities  ... 
doi:10.5281/zenodo.1289708 fatcat:apdd7yvqgzg23ap6wnwvqag5wy

Perceptual-motor determinants of auditory-verbal serial short-term memory

Robert W. Hughes, Cindy Chamberland, Sébastien Tremblay, Dylan M. Jones
2016 Journal of Memory and Language  
The results are incompatible with theories in which perceptual variability impairs serial recall due to a deficit in encoding items into a limited-capacity short-term memory space and instead point to  ...  The classic finding that serial recall is poorer with ear-alternating items was shown to be related to spatialsource localization, thereby confirming a basic tenet of the perceptual-motor account and disconfirming  ...  A. Supplementary material Supplementary data associated with this article can be found, in the online version, at j.jml.2016.04.006.  ... 
doi:10.1016/j.jml.2016.04.006 fatcat:brldfwjud5htvfxliqfvgtbb7m

Characterising switching behaviour in perceptual multi-stability

Susan Denham, Alexandra Bendixen, Robert Mill, Dénes Tóth, Thomas Wennekers, Martin Coath, Tamás Bőhm, Orsolya Szalardy, István Winkler
2012 Journal of Neuroscience Methods  
known as perceptual bi-stability or multi-stability.  ...  Here we propose a new approach to characterising switching behaviour based upon the extraction of transition matrices from the data, which provide a compact representation that is well-understood mathematically  ...  This method is generic and thus applicable to multi-stability experiments in any modality.  ... 
doi:10.1016/j.jneumeth.2012.04.004 pmid:22525854 fatcat:vhgctloisna6jmu7tjh6r4pvha

You Only Need Adversarial Supervision for Semantic Image Synthesis [article]

Vadim Sushko, Edgar Schönfeld, Dan Zhang, Juergen Gall, Bernt Schiele, Anna Khoreva
2021 arXiv   pre-print
with better alignment to their input label maps, making the use of the perceptual loss superfluous.  ...  Moreover, we enable high-quality multi-modal image synthesis through global and local sampling of a 3D noise tensor injected into the generator, which allows complete or partial image change.  ...  B.2 MULTI-MODAL IMAGE SYNTHESIS Multi-modal image synthesis for a given label map is easy for OASIS: we simply re-sample noise like in a conventional unconditional GAN model.  ... 
arXiv:2012.04781v3 fatcat:2sykoyoazre4ths5reamtqzne4

Interactive Sonification of Curve Shape and Curvature Data [chapter]

Simon Shelley, Miguel Alonso, Jacqueline Hollowood, Michael Pettitt, Sarah Sharples, Dik Hermes, Armin Kohlrausch
2009 Lecture Notes in Computer Science  
The system described here is part of a multi-modal augmented reality environment in which users interact with virtual models through the modalities vision, hearing and touch.  ...  This paper presents a number of different sonification approaches that aim to communicate geometrical data, specifically curve shape and curvature information, of virtual 3-D objects.  ...  The authors also wish to thank Patrick Bosinco for providing Fig. 1 .  ... 
doi:10.1007/978-3-642-04076-4_6 fatcat:jt4fp6es2zhovdhjwqlua56d5a

Crackle: A Dynamic Mobile Multitouch Topology For Exploratory Sound Interaction

Jonathan Reus
2011 Zenodo  
This paper describes the design of Crackle, a interactivesound and touch experience inspired by the CrackleBox.We begin by describing a ruleset for Crackle's interactionderived from the salient interactive  ...  Thepaper goes on to consider the potential of using Crackleas an encapsulated interaction paradigm for exploring arbitrary sound spaces, and concludes with lessons learned ondesigning for multitouch surfaces  ...  This mapping approach comes from personal observation of traditional instruments, where expected, "pleasant" tones are easy to find and control relative to more eccentric musical utterances.  ... 
doi:10.5281/zenodo.1178143 fatcat:trfvglyrk5cx7ozoihpoyq3j7a

Sound-Guided Semantic Image Manipulation [article]

Seung Hyun Lee, Wonseok Roh, Wonmin Byeon, Sang Ho Yoon, Chan Young Kim, Jinkyu Kim, Sangpil Kim
2021 arXiv   pre-print
Our audio encoder is trained to produce a latent representation from an audio input, which is forced to be aligned with image and text representations in the multi-modal embedding space.  ...  Here, we propose a framework that directly encodes sound into the multi-modal (image-text) embedding space and manipulates an image from the space.  ...  Audio-visual representation learning studies [3, 29, 46] aim to map both modalities to the same embedding space.  ... 
arXiv:2112.00007v1 fatcat:rcv7bt5ppvfihc57kqfa4d2pau

A Mechanism for Sensorimotor Translation in Singing

Peter Q. Pfordresher, Andrea R. Halpern, Emma B. Greenspon
2015 Music Perception  
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive.  ...  We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact  ...  Correspondence concerning this article should be addressed to Peter Q. Pfordresher, Department of Psychology, 362 Park Hall, University at Buffalo, Buffalo, NY 14260. E-mail:  ... 
doi:10.1525/mp.2015.32.3.242 fatcat:lz726bfotvccje2dvip4edrlxy
« Previous Showing results 1 — 15 out of 5,830 results