Filters








16,346 Hits in 6.3 sec

Text as Neural Operator: Image Manipulation by Text Instruction [article]

Tianhao Zhang, Hung-Yu Tseng, Lu Jiang, Honglak Lee, Irfan Essa, Weilong Yang
2020 arXiv   pre-print
The key idea is to treat text as neural operators to locally modify the image feature. We show that the proposed model performs favorably against recent baselines on three public datasets.  ...  In recent years, text-guided image manipulation has gained increasing attention in the image generation research field.  ...  We accomplish this task by modeling instructions as neural operators to locally modify the image feature.  ... 
arXiv:2008.04556v3 fatcat:wj6cvomd4jflzoed7s2ecpbzuu

Text as Neural Operator:Image Manipulation by Text Instruction

Tianhao Zhang, Hung-Yu Tseng, Lu Jiang, Weilong Yang, Honglak Lee, Irfan Essa
2021 Proceedings of the 29th ACM International Conference on Multimedia  
manipulation by text instruction.  ...  The input is multimodal consisting of a reference image and a text instruction. The results are synthesized images by our model.  ...  We proposed an approach modeling text instructions as neural operators to locally modify the image feature.  ... 
doi:10.1145/3474085.3475343 fatcat:jf6uwy2b7rhlxenwy4yjtfhhaq

Operator support in human–robot collaborative environments using AI enhanced wearable devices

Nikos Dimitropoulos, Thodoris Togias, George Michalos, Sotiris Makris
2021 Zenodo  
Reality based instructions.  ...  Direct interaction approach with the use of push buttons or indirect-gesture based interaction, which are most often adopted by the researchers, require operators to constantly occupy their hands performing  ...  www.sherlock-project.eu ) funded by the European Commission.  ... 
doi:10.5281/zenodo.5579528 fatcat:zxuotoozz5bufgdvwd5hkosaya

Toward a warfighter's associate: eliminating the operator control unit

Hobart R. Everett, Estrellina B. Pacis, Greg Kogut, Nathan M. Farrington, S. Khurana, Douglas W. Gage
2004 Mobile Robots XVII  
There exists a definite tradeoff between the value added by the robot, in terms of how it contributes to the performance of the mission, and the loss of effectiveness associated with the operator control  ...  This need is particularly critical if the intent is to operate in conjunction with human forces in a military application, as any low-level distractions can seriously reduce a warfighter's chances of survival  ...  Information overlays augmenting the virtual model, such as text labels for room identification, can also be directly entered by the operator.  ... 
doi:10.1117/12.571458 dblp:conf/mr/EverettPKFK02 fatcat:byaualjfw5adtocvdzsaphayd4

Neural substrates of mathematical reasoning: A functional magnetic resonance imaging study of neocortical activation during performance of the necessary arithmetic operations test

Vivek Prabhakaran, Bart Rypma, John D. E. Gabrieli
2001 Neuropsychology  
Findings suggest a dissociation in mathematical problem solving between reasoning, mediated by frontal cortex, and text processing, mediated by temporal cortex.  ...  Participants solved 3 types of problems: 2-operation problems requiring mathematical reasoning and text processing, 1-operation problems requiring text processing but minimal mathematical reasoning, and  ...  From this perspective, analyzing the initial 10 s in these different problem types may isolate only neural substrates involved in text processing rather than neural substrates involved in mathematical  ... 
doi:10.1037//0894-4105.15.1.115 pmid:11216882 fatcat:dvv4mhy3yvggnhbqfnrlh6fytm

Elemental operations in vision

P ROELFSEMA
2005 Trends in Cognitive Sciences  
computer programs can be composed of sequences of instructions.  ...  Here, I outline a new theory of how these processing steps are implemented in vision by networks of neurons that span several areas of the cerebral cortex.  ...  This work was supported by a HFSP Young Investigators grant.  ... 
doi:10.1016/j.tics.2005.03.012 pmid:15866149 fatcat:clgfy5r46bekfcbp5cinsre47q

Operation-Specific Lexical Consistency Effect in Fronto-Insular-Parietal Network During Word Problem Solving

Chan-Tat Ng, Tzu-Chen Lung, Ting-Ting Chang
2021 Frontiers in Human Neuroscience  
Using functional magnetic resonance imaging methods, we examined compare word problems that included relational statements, such as "A dumpling costs 9 dollars.  ...  and manipulated lexical consistency (consistent: the relational term consistent with the operation to be performed, e.g., more—addition/inconsistent: e.g., less—addition) and problem operation (addition  ...  This research was supported by grants from the Ministry of Science and Technology (Grant Numbers: MOST106-2420-H-004-010-MY2 and MOST108-2410-H-004-101-MY2). ACKNOWLEDGMENTS We thank Dr.  ... 
doi:10.3389/fnhum.2021.631438 pmid:33776671 pmcid:PMC7987662 fatcat:w622dxgfpva7bfgsknbzz4not4

Neural substrates of mathematical reasoning: A functional magnetic resonance imaging study of neocortical activation during performance of the necessary arithmetic operations test

Vivek Prabhakaran, Bart Rypma, John D. E. Gabrieli
2001 Neuropsychology  
Findings suggest a dissociation in mathematical problem solving between reasoning, mediated by frontal cortex, and text processing, mediated by temporal cortex.  ...  Participants solved 3 types of problems: 2-operation problems requiring mathematical reasoning and text processing, 1-operation problems requiring text processing but minimal mathematical reasoning, and  ...  From this perspective, analyzing the initial 10 s in these different problem types may isolate only neural substrates involved in text processing rather than neural substrates involved in mathematical  ... 
doi:10.1037/0894-4105.15.1.115 fatcat:qc46si7745gllevfpjyzk75aty

Dynamic Operator Instructions Based on Augmented Reality and Rule-based Expert Systems

Anna Syberfeldt, Oscar Danielsson, Magnus Holm, Lihui Wang
2016 Procedia CIRP  
This study aims to increase the knowledge of the adaptation and usability of augmented reality for the training of operators.  ...  A new approach of using dynamic information content is proposed that is automatically adjusted to the individual operator and his/her learning progress for increased efficiency and shorter learning times  ...  Fig. 6 . 6 Rule 1 -basic text instruction is shown. Fig. 7 . 7 Rule 2 -detailed text instructions is shown.  ... 
doi:10.1016/j.procir.2015.12.113 fatcat:wbmpsj7g4ffuhgzpxmp3wmzuiu

Cognition and Operator Performance [chapter]

Jacob D. Oury, Frank E. Ritter
2021 Global Usability  
Operators must perceive information before they can act in response, and the interface design affects operator accuracy and speed via known mechanisms (i.e., effects of color on visual search time).  ...  After perceiving the information, operators also must comprehend and interpret the information.  ...  Task-related information must be analyzed, manipulated, and transformed into useful information that can guide the actions taken by the operator.  ... 
doi:10.1007/978-3-030-47775-2_3 fatcat:dbovk36ovjdohavakgdifhr5uq

VR/AR Technology in Human Anatomy Teaching and Operation Training

Yuan Zhou, Jiejun Hou, Qi Liu, Xu Chao, Nan Wang, Yu Chen, Jianjun Guan, Qi Zhang, Yongchang Diwu, Yang Gao
2021 Journal of Healthcare Engineering  
This paper takes the VR/AR operation simulation system of an Irish company as an example and evaluates the learning effect of 41 students in our hospital.  ...  This paper first shows the learning environment and platform of the VR/AR system, then explains the interface and operation of the system, and evaluates the teaching situation.  ...  VR/AR Instruction Set Algorithm Based on Neural Network.  ... 
doi:10.1155/2021/9998427 pmid:34211684 pmcid:PMC8205599 fatcat:ffycoi4dpvb57jg72mpy6y56am

Embodied AI-Driven Operation of Smart Cities: A Concise Review [article]

Farzan Shenavarmasouleh, Farid Ghareh Mohammadi, M. Hadi Amini, Hamid R. Arabnia
2021 arXiv   pre-print
A smart city can be seen as a framework, comprised of Information and Communication Technologies (ICT).  ...  It focuses on learning through interaction with the surrounding environment, as opposed to Internet AI which tries to learn from static datasets.  ...  Meaning that the trained model can only take one type of data (eg. image, text, video) as the input and perform a single task that it is asked for.  ... 
arXiv:2108.09823v1 fatcat:xcjyq2ad3jgbborpldopgcd3vm

A novel attention training paradigm based on operant conditioning of eye gaze: Preliminary findings

Rebecca B. Price, Inez M. Greven, Greg J. Siegle, Ernst H. W. Koster, Rudi De Raedt
2016 Emotion  
Preliminary results suggest that operant conditioning of eye gaze towards happy faces buffers against stress-induced effects on mood, particularly in individuals who show sufficient baseline neural engagement  ...  Baseline neural function (pupil dilation) may be a key mechanism, aiding in iterative refinement of this approach.  ...  =arbitrary units, recorded by EyeLink II software on the basis of the number of pixels considered to be pupil within the camera image.  ... 
doi:10.1037/emo0000093 pmid:26389646 pmcid:PMC4718871 fatcat:kig5zmqdqneadantqddhrlfxny

LatteGAN: Visually Guided Language Attention for Multi-Turn Text-Conditioned Image Manipulation

Shoya Matsumori, Yuki Abe, Kosuke Shingyouchi, Komei Sugiura, Michita Imai
2021 IEEE Access  
Text-guided image manipulation tasks have recently gained attention in the vision-and-language community.  ...  Previous models for this task successfully generate images iteratively, given a sequence of instructions and a previously generated image.  ...  ACKNOWLEDGEMENTS The experiments were partially conducted on the AI Bridging Cloud Infrastructure (ABCI) provided by the National Institute of Advanced Industrial Science and Technology (AIST).  ... 
doi:10.1109/access.2021.3129215 fatcat:cb2p5xpyozcwrancnnxmjs424q

Operant Conditioning of Primate Prefrontal Neurons

Shunsuke Kobayashi, Wolfram Schultz, Masamichi Sakagami
2010 Journal of Neurophysiology  
Operant conditioning of primate prefrontal neurons.  ...  First, we tracked the activity of a single neuron by using a strict template-matching algorithm (see earlier text).  ...  B: a magnetic resonance imaging showing the lateral surface of the brain. The recording area is indicated by shade. percentage of the criterion achieved.  ... 
doi:10.1152/jn.00173.2009 pmid:20107129 pmcid:PMC2853276 fatcat:gxwlfui4qrar7fs5nvcafi3g4a
« Previous Showing results 1 — 15 out of 16,346 results