A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2018; you can also visit the original URL.
The file type is application/pdf
.
Filters
A Multi-Modal Approach to Perceptual Tone Mapping
2009
2009 Conference for Visual Media Production
We present an improvement of TSTM, a recently proposed tone mapping operator for High Dynamic Range (HDR) images, based on a multi-modal analysis. ...
Finally, we properly select the parameters in order to merge those equations into a continuous function. ...
Caselles also wants to acknowledge "ICREA Acadèmia" prize for excellence in ...
doi:10.1109/cvmp.2009.16
fatcat:4r7dowcty5ex5nvwvflg6fkrkm
Interacting Perceptual Dimensions
[chapter]
2004
Ecological Psychoacoustics
On subsequent trials the listener is presented with different intensity tones and is asked to assign a number to the loudness that represents the relationship to the first tone heard. ...
In many psychoacoustic experiments, the objective is to investigate some aspect of a particular perceptual dimension. ...
perceptual modalities. ...
doi:10.1163/9780080477442_013
fatcat:azonzzw7arfwlehdjyra7quuea
Optimality and limitations of audio-visual integration for cognitive systems
[article]
2020
arXiv
pre-print
In humans, this process has often been shown to be statistically optimal, or near optimal: sensory information is combined in a fashion that minimises the average error in perceptual representation of ...
Multimodal integration is an important process in perceptual decision-making. ...
Acknowledgements The authors are also grateful to Shufan Yang for helpful discussions on the computational modelling. ...
arXiv:1912.00581v3
fatcat:p6h64uqenvdfnjjtbflr6b3cyy
Optimality and Limitations of Audio-Visual Integration for Cognitive Systems
2020
Frontiers in Robotics and AI
In humans, this process has often been shown to be statistically optimal, or near optimal: sensory information is combined in a fashion that minimizes the average error in perceptual representation of ...
Multimodal integration is an important process in perceptual decision-making. ...
All authors contributed to structuring, revising, and proofreading of the manuscript.
ACKNOWLEDGMENTS The authors are grateful to Shufan Yang for helpful discussions on the computational modeling. ...
doi:10.3389/frobt.2020.00094
pmid:33501261
pmcid:PMC7805627
fatcat:ms4sgukvuzecnfauzy4amjs6tu
A Survey on Quantitative Assessment of the Quality of Tone-Mapped Images using TMQI-LI
2017
International Journal of Innovations in Engineering and Technology
It is; therefore; of particular importance and necessity to conduct experimental subjective evaluations of the computational approaches that incorporate various tone mapping operators to judge and validate ...
Even though the knowledge of tone mapping is continuously developing, many unanswered questions and hypotheses still remain to be solved. ...
The suitability of multi-scale fusion for other forensic features will be investigated. Positive results would indicate feasibility of a combined multi-modal and multi-scale approach. ...
doi:10.21172/ijiet.82.026
fatcat:py2jc77mbvbchkdst2ngstcyrq
Modality-independent representations of small quantities based on brain activation patterns
2016
Human Brain Mapping
The main finding demonstrated, for the first time, that quantities of dots were decodable by a classifier that was trained on the neural patterns evoked by quantities of auditory tones, and vice-versa. ...
Here we apply these techniques to investigate whether neural representations of quantities depicted in one modality (say, visual) can be decoded from brain activation patterns evoked by quantities depicted ...
ACKNOWLEDGMENTS The authors thank Justin A. Abernethy for assistance with the data collection, and Sandesh Aryal for help with data analysis. ...
doi:10.1002/hbm.23102
pmid:26749189
pmcid:PMC5384793
fatcat:m52mrzfv3fdedkgflq6js4bj5u
Digital interactions
2018
Airea Arts and Interdisciplinary Research
Our practice-based approach entails the rendering of a three-dimensional digital object in Processing whose form changes over time according to specific actions. ...
We use digital technology to look beyond basic synchronisation of sound and vision to a more complex cohesion of percepts, based on changes to myriad sonic and visual parameters experienced concurrently ...
This work achieved an action-based digital approach that allowed precise and direct mapping of parameters of the transformation of both modalities. ...
doi:10.2218/airea.2732
fatcat:ajb5c3y7yvhqzl3cdq3s53ztui
Some Approaches To Representing Sound With Colour And Shape
2018
Zenodo
This paper explores the implications of recent research into cross-modal colour-to-sound and shape-to sound map-pings for the application of colour and shape in musical scores. ...
with alter-native notational approaches (gestural, action-based and graphical for example) in a single digital document. ...
CROSS-MODAL CORRESPONDENCE The perceptual phenomenon now generally referred to as Cross-Modal Correspondence (CMC), defined by Marks as "natural correspondences between experiences in different sense modalities ...
doi:10.5281/zenodo.1289708
fatcat:apdd7yvqgzg23ap6wnwvqag5wy
Perceptual-motor determinants of auditory-verbal serial short-term memory
2016
Journal of Memory and Language
The results are incompatible with theories in which perceptual variability impairs serial recall due to a deficit in encoding items into a limited-capacity short-term memory space and instead point to ...
The classic finding that serial recall is poorer with ear-alternating items was shown to be related to spatialsource localization, thereby confirming a basic tenet of the perceptual-motor account and disconfirming ...
A. Supplementary material Supplementary data associated with this article can be found, in the online version, at http://dx.doi.org/10.1016/ j.jml.2016.04.006. ...
doi:10.1016/j.jml.2016.04.006
fatcat:brldfwjud5htvfxliqfvgtbb7m
Characterising switching behaviour in perceptual multi-stability
2012
Journal of Neuroscience Methods
known as perceptual bi-stability or multi-stability. ...
Here we propose a new approach to characterising switching behaviour based upon the extraction of transition matrices from the data, which provide a compact representation that is well-understood mathematically ...
This method is generic and thus applicable to multi-stability experiments in any modality. ...
doi:10.1016/j.jneumeth.2012.04.004
pmid:22525854
fatcat:vhgctloisna6jmu7tjh6r4pvha
You Only Need Adversarial Supervision for Semantic Image Synthesis
[article]
2021
arXiv
pre-print
with better alignment to their input label maps, making the use of the perceptual loss superfluous. ...
Moreover, we enable high-quality multi-modal image synthesis through global and local sampling of a 3D noise tensor injected into the generator, which allows complete or partial image change. ...
B.2 MULTI-MODAL IMAGE SYNTHESIS Multi-modal image synthesis for a given label map is easy for OASIS: we simply re-sample noise like in a conventional unconditional GAN model. ...
arXiv:2012.04781v3
fatcat:2sykoyoazre4ths5reamtqzne4
Interactive Sonification of Curve Shape and Curvature Data
[chapter]
2009
Lecture Notes in Computer Science
The system described here is part of a multi-modal augmented reality environment in which users interact with virtual models through the modalities vision, hearing and touch. ...
This paper presents a number of different sonification approaches that aim to communicate geometrical data, specifically curve shape and curvature information, of virtual 3-D objects. ...
The authors also wish to thank Patrick Bosinco for providing Fig. 1 . ...
doi:10.1007/978-3-642-04076-4_6
fatcat:jt4fp6es2zhovdhjwqlua56d5a
Crackle: A Dynamic Mobile Multitouch Topology For Exploratory Sound Interaction
2011
Zenodo
This paper describes the design of Crackle, a interactivesound and touch experience inspired by the CrackleBox.We begin by describing a ruleset for Crackle's interactionderived from the salient interactive ...
Thepaper goes on to consider the potential of using Crackleas an encapsulated interaction paradigm for exploring arbitrary sound spaces, and concludes with lessons learned ondesigning for multitouch surfaces ...
This mapping approach comes from personal observation of traditional instruments, where expected, "pleasant" tones are easy to find and control relative to more eccentric musical utterances. ...
doi:10.5281/zenodo.1178143
fatcat:trfvglyrk5cx7ozoihpoyq3j7a
Sound-Guided Semantic Image Manipulation
[article]
2021
arXiv
pre-print
Our audio encoder is trained to produce a latent representation from an audio input, which is forced to be aligned with image and text representations in the multi-modal embedding space. ...
Here, we propose a framework that directly encodes sound into the multi-modal (image-text) embedding space and manipulates an image from the space. ...
Audio-visual representation learning studies [3, 29, 46] aim to map both modalities to the same embedding space. ...
arXiv:2112.00007v1
fatcat:rcv7bt5ppvfihc57kqfa4d2pau
A Mechanism for Sensorimotor Translation in Singing
2015
Music Perception
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. ...
We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact support@jstor.org. ...
Correspondence concerning this article should be addressed to Peter Q. Pfordresher, Department of Psychology, 362 Park Hall, University at Buffalo, Buffalo, NY 14260. E-mail: pqp@buffalo.edu ...
doi:10.1525/mp.2015.32.3.242
fatcat:lz726bfotvccje2dvip4edrlxy
« Previous
Showing results 1 — 15 out of 5,830 results