Filters








6,069 Hits in 3.7 sec

Incongruence Detection in Audio-Visual Processing [chapter]

Michal Havlena, Jan Heller, Hendrik Kayser, Jörg-Hendrik Bach, Jörn Anemüller, Tomáš Pajdla
2012 Studies in Computational Intelligence  
Next we look at some examples of incongruences in audio-visual processing, ranging from 'low-level' to 'high-level' analysis.  ...  In this work we first investigate the theory of incongruence detection developed in [27, 32] and try to see it as a mechanism for theory testing, falsification, and rectification.  ...  Such a direct audio-visual classifier is able to detect up to one sounding human in an audio-visual frame.  ... 
doi:10.1007/978-3-642-24034-8_5 fatcat:h3rsj6skqnhqpnwhcozidg3vcq

The DIRAC AWEAR audio-visual platform for detection of unexpected and incongruent events

Jörn Anemüller, Misha Pavel, Akihiko Torii, Luc Van Gool, Alon Zweig, Hynek Hermansky, Jörg-Hendrik Bach, Barbara Caputo, Michal Havlena, Luo Jie, Hendrik Kayser, Bastian Leibe (+2 others)
2008 Proceedings of the 10th international conference on Multimodal interfaces - IMCI '08  
Acknowledgments: Support by the European Commission under integrated project DIRAC (Detection and Identification of Rare Audiovisual Cues) IST-027787 is gratefully acknowledged.  ...  AUDIO-VISUAL INCONGRUENCY DETECTION A multitude of audio-visual scenes with incongruencies across modalities has been recorded, covering in total over 100 scenes recorded with 27 speakers.  ...  The first example applications outlined here is an audio-visual gender detection task where incongruency is to be detected when gender estimates based on visual appearance and speech characteristics diverge  ... 
doi:10.1145/1452392.1452451 dblp:conf/icmi/AnemullerBCHJKLMPPTGZH08 fatcat:g2giyg7fazb6zh4acuk3p7xpjy

Catalog of Basic Scenes for Rare/Incongruent Event Detection [chapter]

Danilo Hollosi, Stefan Wabnik, Stephan Gerlach, Steffen Kortlang
2012 Studies in Computational Intelligence  
A catalog of basic audio-visual recordings containing rare and incongruent events for security and in-home-care scenarios for European research project Detection and Identification of Rare Audio-visual  ...  The purpose of this catalog is to provide a basic and atomistic testbed to the scientific community in order to validate methods for rare and incongruent event detection.  ...  This work was supported by the European Commission under the integrated project DIRAC (Detection and Identification of Rare Audio-visual Cues, IST-027787).  ... 
doi:10.1007/978-3-642-24034-8_6 fatcat:4o44jse2nze25aqvb47jx2dpbu

Colour Terms Affect Detection of Colour and Colour-Associated Objects Suppressed from Visual Awareness

Lewis Forder, Olivia Taylor, Helen Mankin, Ryan B. Scott, Anna Franklin, Suliann Ben Hamed
2016 PLoS ONE  
A potentially important study in this field has shown that when an object is suppressed from visual awareness using continuous flash suppression (a form of binocular rivalry), detection of the object is  ...  Detection sensitivity was significantly poorer on incongruent trials than congruent trials.  ...  on bottom-up neural activity in the visual processing system.  ... 
doi:10.1371/journal.pone.0152212 pmid:27023274 pmcid:PMC4811409 fatcat:tm3gssviy5ehbjyi5ucaddiwcy

Learning from Incongruence [chapter]

Tomáš Pajdla, Michal Havlena, Jan Heller
2012 Studies in Computational Intelligence  
We demonstrate the concept in an experiment with human audio-visual detection.  ...  The process of constructing a new concept is initiated when a significant disagreement -incongruence -has been observed between incoming data and the current model of the universe.  ...  In this work we look at an example of incongruence caused by the omission of an important concept in an example of audio-visual speaker detection and show how it can be improved.  ... 
doi:10.1007/978-3-642-24034-8_10 fatcat:yn33coqomfeijbabxame7k46ei

The effects of stereo disparity on the behavioural and electrophysiological correlates of perception of audio–visual motion in depth

Neil R. Harrison, Sian Witheridge, Alexis Makin, Sophie M. Wuerger, Alan J. Pegna, Georg F. Meyer
2015 Neuropsychologia  
We explored behavioural and electrophysiological correlates of congruent and incongruent audio-visual depth motion in conditions where auditory level changes, visual expansion, and visual disparity cues  ...  In Experiment 2, event-related potentials (ERPs) were collected during presentation of the 2D and 3D, looming and receding, audio-visual stimuli, while participants Page 2 of 44 detected an infrequent  ...  neural processes related to the processing of audio-visual motion in depth.  ... 
doi:10.1016/j.neuropsychologia.2015.09.023 pmid:26386322 fatcat:3wyh2o7ev5b2pfpf5d4phgdkyy

Multisensory Motion Perception in 3–4 Month-Old Infants

Elena Nava, Massimo Grassi, Viola Brenna, Emanuela Croci, Chiara Turati
2017 Frontiers in Psychology  
Importantly, we also found that congruently moving visuo-tactile and audio-visual stimuli were preferred over incongruently moving bimodal stimuli (Experiment 2).  ...  Three-to 4-month-old infants were presented with two bimodal pairings: visuo-tactile and audio-visual.  ...  incongruent: M = 41.82, SD = 11.73; audio-visual congruent: M = 42.55, SD = 12.56, audio-visual incongruent: M = 36.49, SD = 14.86, seeFigure 3).  ... 
doi:10.3389/fpsyg.2017.01994 pmid:29187829 pmcid:PMC5694769 fatcat:ngnizpqiabggflqsidcdzaokmq

Top-Down Predictions of Familiarity and Congruency in Audio-Visual Speech Perception at Neural Level

Orsolya B. Kolozsvári, Weiyong Xu, Paavo H. T. Leppänen, Jarmo A. Hämäläinen
2019 Frontiers in Human Neuroscience  
The stimuli were presented in audio-visual (congruent or incongruent), audio only, or visual only conditions.  ...  The results are in line with earlier studies reporting on the modulation of brain responses for audio-visual congruency around 250-500 ms.  ...  Auditory and visual cues can be presented either congruently or incongruently and this match or mismatch of features could be used to study the audio-visual processing of speech.  ... 
doi:10.3389/fnhum.2019.00243 pmid:31354459 pmcid:PMC6639789 fatcat:eevae44ikng3fnhd4ysppuzao4

Phasic Alertness and Multisensory Integration Contribute to Visual Awareness of Weak Visual Targets in Audio-Visual Stimulation under Continuous Flash Suppression

Anna Matilda Helena Cederblad, Juho Äijälä, Søren Krogh Andersen, Mary Joan MacLeod, Arash Sahraie
2022 Vision  
The first experiment had an audio-visual Redundant Signal Effect paradigm, in which we found faster reaction times in the audio-visual condition compared to responses to auditory or visual signals alone  ...  Multisensory stimulation is associated with behavioural benefits, including faster processing speed, higher detection accuracy, and increased subjective awareness.  ...  The Incongruent condition solely outperformed the No Audio condition in detection accuracy when participants reported to be aware of the visual target.  ... 
doi:10.3390/vision6020031 pmid:35737418 pmcid:PMC9228768 fatcat:x57qzwk2erdfdglwsze2ybl3fm

Audio–visual interaction in visual motion detection: Synchrony versus Asynchrony

Stephanie Rosemann, Inga-Maria Wefel, Volkan Elis, Manfred Fahle
2017 Journal of Optometry  
Additionally, detection was significantly better in abstract congruent than incongruent trials.  ...  Results: We found that incongruent audiovisual stimuli led to significantly inferior detection compared to the visual only condition.  ...  This research received no specific grant from any funding agency in the public, commercial, or notfor-profit sectors.  ... 
doi:10.1016/j.optom.2016.12.003 pmid:28237358 pmcid:PMC5595265 fatcat:w43qls2msjgqhbjvvoj3bfjb2m

A matter of attention: Crossmodal congruence enhances and impairs performance in a novel trimodal matching paradigm [article]

Jonas Misselhorn, Jonathan Daume, Andreas K. Engel, Uwe Friese
2015 bioRxiv   pre-print
Largest crossmodal effects were seen in visual?tactile matching, intermediate effects for audio?visual and smallest effects for audio?tactile matching.  ...  If the attended modalities were incongruent, the distractor impaired performance due to its congruence relation to one of the attended modalities.  ...  In an audio-visual redundant signal detection paradigm, auditory detection was delayed by redundant visual presentation while visual detection was speeded by redundant auditory presentation.  ... 
doi:10.1101/015958 fatcat:oe5337xjofexro4khcnskysw7y

Auditory, Visual, and Cross-Modal Mismatch Negativities in the Rat Auditory and Visual Cortices

Tomoyo Isoguchi Shiramatsu, Kanato Mori, Kotaro Ishizu, Hirokazu Takahashi
2021 Frontiers in Human Neuroscience  
, (iv) incongruent visual deviants, and (v) incongruent auditory deviants in the audio-visual oddball paradigm, eliciting cross-modal MMN.  ...  In particular, we studied whether and how cross-modal information processing affected MMN in rodents.  ...  , (iv) incongruent visual deviants, and (v) incongruent auditory deviants in the audio-visual oddball paradigm, eliciting cross-modal MMN.  ... 
doi:10.3389/fnhum.2021.721476 pmid:34602996 pmcid:PMC8484534 fatcat:7emdqjx6xranboct4vyday2fxy

Cortical operational synchrony during audio–visual speech integration

Andrew A. Fingelkurts, Alexander A. Fingelkurts, Christina M. Krause, Riikka Möttönen, Mikko Sams
2003 Brain and Language  
The temporal synchronization of cortical operations processing unimodal stimuli at different cortical sites reveals the importance of the temporal features of auditory and visual stimuli for audio-visual  ...  Information from different sensory modalities is processed in different cortical regions.  ...  in audio-visual information processing (audio-visual temporal synchronyasynchrony detection) (Bushara, Grafman, & Hallett, 2001) .  ... 
doi:10.1016/s0093-934x(03)00059-2 pmid:12735946 fatcat:xqy65zwihfaatoaroggady5ofm

Perceptual congruency of audio-visual speech affects ventriloquism with bilateral visual stimuli

Shoko Kanaya, Kazuhiko Yokosawa
2010 Psychonomic Bulletin & Review  
Congruent pairing of audio-visual utterances elicited greater localization bias than incongruent pairing, while previous studies have reported little dependency on the reality of stimuli in ventriloquism  ...  Many studies on multisensory processes have focused on performance in simplified experimental situations, with a single stimulus in each sensory modality.  ...  The outcome of audio-visual speech processing has regulated participants' audio-visual spatial judgments.  ... 
doi:10.3758/s13423-010-0027-z pmid:21327355 fatcat:hfcqejlbynf25ofpcht27buyb4

Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex

Gemma A. Calvert, Ruth Campbell, Michael J. Brammer
2000 Current Biology  
Ten human subjects were exposed to varying epochs of semantically congruent and incongruent audio-visual speech and to each modality in isolation.  ...  This strategy identified an area of heteromodal cortex in the left superior temporal sulcus that exhibited significant supra-additive response enhancement to matched audio-visual inputs and a corresponding  ...  In contrast, incongruent audio-visual inputs reduced the response in these voxels to less than 50% of the summed unimodal responses.  ... 
doi:10.1016/s0960-9822(00)00513-3 pmid:10837246 fatcat:omquf7f7jbhwrkvnd6f27z2gwe
« Previous Showing results 1 — 15 out of 6,069 results