Filters








146,618 Hits in 6.6 sec

Modulating early visual processing by language [article]

Harm de Vries, Florian Strub, Jérémie Mary, Hugo Larochelle, Olivier Pietquin, Aaron Courville
2017 arXiv   pre-print
Our ablation study shows that modulating from the early stages of the visual processing is beneficial.  ...  In this paper, we deviate from this classic pipeline and propose to modulate the entire visual processing by linguistic input.  ...  To summarize, our contributions are three fold: • We propose conditional batch normalization to modulate the entire visual processing by language from the early processing stages, • We condition the batch  ... 
arXiv:1707.00683v3 fatcat:awftow23wrfi3ny2l5fheasa6m

Language Guided Networks for Cross-modal Moment Retrieval [article]

Kun Liu, Huadong Ma, Chuang Gan
2020 arXiv   pre-print
Specifically, the early modulation unit is designed to modulate the visual feature extractor's feature maps by a linguistic embedding.  ...  In the first feature extraction stage, we propose to jointly learn visual and language features to capture the powerful visual information which can cover the complex semantics in the sentence query.  ...  Early Modulation Unit. In this section, we propose a novel method to modulate visual processing by a linguistic input.  ... 
arXiv:2006.10457v2 fatcat:eqnjjsvpvfc2darsrkayd3qvxm

The Visual QA Devil in the Details: The Impact of Early Fusion and Batch Norm on CLEVR [article]

Mateusz Malinowski, Carl Doersch
2018 arXiv   pre-print
In particular, we find that early fusion of language and vision provides large performance improvements. This contrasts with the late fusion approaches popular at the dawn of Visual QA.  ...  Visual QA is a pivotal challenge for higher-level reasoning, requiring understanding language, vision, and relationships between many objects in a scene.  ...  Although late fusion may work on more biased Visual QA datasets [8, 9, 13, 14] , where exploiting language biases plays a more prominent role, we believe the early fusion is more important on less biased  ... 
arXiv:1809.04482v1 fatcat:ptaaaefzjrhwpi7rloa57qzoyi

Early deafness leads to re-shaping of functional connectivity beyond the auditory cortex

Kamil Bonna, Karolina Finc, Maria Zimmermann, Lukasz Bola, Piotr Mostowski, Maciej Szul, Pawel Rutkowski, Wlodzislaw Duch, Artur Marchewka, Katarzyna Jednoróg, Marcin Szwed
2020 Brain Imaging and Behavior  
Early sensory deprivation, such as deafness, shapes brain development in multiple ways.  ...  Deprived auditory areas become engaged in the processing of stimuli from the remaining modalities and in high-level cognitive tasks.  ...  We thank Karolina Dukala for administrative assistance, Monika Boruta-Żywiczyńska and Michael Timberlake for language editing.  ... 
doi:10.1007/s11682-020-00346-y pmid:32700256 fatcat:kzhfnj2ayve7xkx6ygrsu3jw4m

Page 1728 of Journal of Cognitive Neuroscience Vol. 20, Issue 9 [page]

2008 Journal of Cognitive Neuroscience  
So far, there is no strong evidence for early perceptual modulation within language-specific areas.  ...  We expected different task demands to modulate ERP components associated with separate stages of visual word process- ing.  ... 

Influence of language backgrounds on audiovisual speech perception across the lifespan

Kaoru Sekiyama
2020 Acoustical Science and Technology  
Although this illusion suggests a universal process of audiovisual integration, the process has been shown to be modulated by language backgrounds.  ...  In these examinations with behavioral and neural data, it is shown that native speakers of English use visual speech cues more than those of Japanese, with different neural underpinnings for the two language  ...  BEHAVIORAL FINDINGS Modulation by Native Language We started by testing native Japanese speakers (JSs) to replicate the McGurk effect.  ... 
doi:10.1250/ast.41.37 fatcat:zjisn7dy4jd2hex7khdflwfngq

Task related modulation of the motor system during language processing

M SATO, M MENGARELLI, L RIGGIO, V GALLESE, G BUCCINO
2008 Brain and Language  
The present findings demonstrate that during language processing the modulation of the motor system crucially occurs while performing a semantics decision task, thus supporting the notion that this involvement  ...  In Experiment 1, in which a semantics decision task with an early delivery of the go signal (during processing language material) was used, slower responses were found for hand action-related verbs than  ...  Acknowledgments This work was supported by the Ministero Italiano dell'Istruzione, dell'Universita e della Ricerca and by VolkswagenStiftung.  ... 
doi:10.1016/j.bandl.2007.10.001 pmid:18054379 fatcat:ufxvo3fd3vhilhobxicpaovcfa

Top-down modulation of early sensory cortex

M. Corbetta, G.L. Shulman, R.L. Buckner, F.M. Miezin, M.E. Raichle, S.E. Petersen
1996 NeuroImage  
Significant modulation of medial visual regions was observed in six of nine studies, indicating that top-down processes can affect early visual cortex.  ...  The analysis examined whether active visual processing (i) increases blood flow in medial visual regions early in the visual hierarchy and (ii) decreases blood flow in auditory and somatosensory cortex  ...  This work was supported by NIH grants NS06833, NS32979, EY08775, HL13851, the Charles A. Dana Foundation and the McDonnell Center for the study of Higher Brain Function.  ... 
doi:10.1016/s1053-8119(96)80178-9 fatcat:5ssg7rv2dbhdnphblu573drz6q

Attention Modulates Initial Stages of Visual Word Processing

María Ruz, Anna C. Nobre
2008 Journal of Cognitive Neuroscience  
A cueing paradigm focused attention at different levels of word representations on a trial-by-trial basis to study the time course of attentional modulation on visual word processing by means of a high-density  ...  These results suggest that top-down attention has the capacity to enhance initial perceptual stages of visual word processing and support the flexibility of attention in modulating different levels of  ...  N. and by an Astor Junior Research Fellowship, New College (Oxford, UK) to M. R.  ... 
doi:10.1162/jocn.2008.20119 pmid:18345981 fatcat:asxk3pmktzfevc53kfacxl3bwm

Top-down modulation of early sensory cortex

G. Shulman
1997 Cerebral Cortex  
Significant modulation of medial visual regions was observed in six of nine studies, indicating that top-down processes can affect early visual cortex.  ...  The analysis examined whether active visual processing (i) increases blood flow in medial visual regions early in the visual hierarchy and (ii) decreases blood flow in auditory and somatosensory cortex  ...  This work was supported by NIH grants NS06833, NS32979, EY08775, HL13851, the Charles A. Dana Foundation and the McDonnell Center for the study of Higher Brain Function.  ... 
doi:10.1093/cercor/7.3.193 pmid:9143441 fatcat:ggtmme7b5vdxnaasqoylvfszdy

The Influence of Language on Perception: Listening to Sentences about Faces Affects the Perception of Faces

A. N. Landau, L. Aziz-Zadeh, R. B. Ivry
2010 Journal of Neuroscience  
interference on subsequent visual processing.  ...  These results provide novel evidence of the influence of language on early perceptual processes and suggest a surprising mechanistic description of this interaction: linguistic primes produce content-specific  ...  early perceptual process marked by this ERP component is influenced by language.  ... 
doi:10.1523/jneurosci.2046-10.2010 pmid:21068330 pmcid:PMC6633823 fatcat:cr3uopayzvbepn5wjic4higxl4

What is needed for simple spatial language capabilities in VQA? [article]

Alexander Kuhnle, Ann Copestake
2019 arXiv   pre-print
Visual question answering (VQA) comprises a variety of language capabilities.  ...  Following this approach, we focus on spatial language capabilities and investigate the question: what are the key ingredients to handle simple visual-spatial relations?  ...  Alexander Kuhnle is grateful for being supported by a Qualcomm Research Studentship and an EPSRC Doctoral Training Studentship.  ... 
arXiv:1908.06336v2 fatcat:gdndskxx7vg2jlsozfnciepg4u

Linguistic priors shape categorical perception

Irina Simanova, Jolien C. Francken, Floris P. de Lange, Harold Bekkering
2015 Language, Cognition and Neuroscience  
The studies by Puri et al. and Brouwer and Heeger demonstrate the sharpening effect of language in regions of the visual stream that are specific for processing of complex visual features: region V4  ...  At the same time, other studies found no direct evidence for the interaction between language and visual perception in the visual processing stream.  ... 
doi:10.1080/23273798.2015.1072638 fatcat:tnsle44wf5duhpm3hdtc3fglxu

Page 797 of Journal of Cognitive Neuroscience Vol. 20, Issue 5 [page]

2008 Journal of Cognitive Neuroscience  
, Vogel, et al., 1998; Hillyard & Mangun, 1987) After the modulation of early visual potentials, spatial orienting also affected later, language-related potentials, especially during the time period of  ...  As predicted, spa- tial orienting enhanced the processing of word stimuli starting from early visual analysis.  ... 

The Complex Pre-Execution Stage of Auditory Cognitive Control: ERPs Evidence from Stroop Tasks

Bo Yu, Xunda Wang, Lin Ma, Liang Li, Haifeng Li, Francesco Di Russo
2015 PLoS ONE  
Cognitive control has been extensively studied from Event-Related Potential (ERP) point of view in visual modality using Stroop paradigms.  ...  These early ERP components imply that both a perceptual stage and an identification stage exist in the auditory Stroop effect.  ...  Previous visual researches did not prove that the early modulations (the N1 effect and the Ninc) involved in cognitive control possibly because of the higher automatic processing of the color in the visual  ... 
doi:10.1371/journal.pone.0137649 pmid:26368570 pmcid:PMC4569364 fatcat:qnsg5w6q5vhstarf2rewboua3i
« Previous Showing results 1 — 15 out of 146,618 results