Filters








3,286 Hits in 3.2 sec

Patch-Based Stochastic Attention for Image Editing [article]

Nicolas Cherel, Andrés Almansa, Yann Gousseau, Alasdair Newson
2022 arXiv   pre-print
We refer to our proposed layer as a "Patch-based Stochastic Attention Layer" (PSAL).  ...  We propose an efficient attention layer based on the stochastic algorithm PatchMatch, which is used for determining approximate nearest neighbors.  ...  we name Patch-Based Stochastic Attention Layer (PSAL).  ... 
arXiv:2202.03163v2 fatcat:76ncey4su5epnewb6bpe55powy

Segmenter: Transformer for Semantic Segmentation [article]

Robin Strudel, Ricardo Garcia, Ivan Laptev, Cordelia Schmid
2021 arXiv   pre-print
Image segmentation is often ambiguous at the level of individual image patches and requires contextual information to reach label consensus.  ...  We leverage models pre-trained for image classification and show that we can fine-tune them on moderate sized datasets available for semantic segmentation.  ...  We resize attention maps to the original image size. For each image, we analyze attention maps of a patch on a small instance, for example lamp, cow or car.  ... 
arXiv:2105.05633v3 fatcat:si63vqmphvdktblgs6dnqnkweu

Weighted Symbols-Based Edit Distance for String-Structured Image Classification [chapter]

Cécile Barat, Christophe Ducottet, Elisa Fromont, Anne-Claire Legrand, Marc Sebban
2010 Lecture Notes in Computer Science  
In this paper, we propose a new way for representing images in the form of strings whose symbols are weighted according to a TF-IDF-based weighting scheme, inspired from information retrieval.  ...  distances-based approaches.  ...  The resulting stochastic edit distance (usually learned using an EM-based approach) can either be used in more performing neighborhood-based classifiers, or wrapped into edit kernels for improving Support  ... 
doi:10.1007/978-3-642-15880-3_11 fatcat:2as6o6cxqvcfnef47ek4xb65tu

THAN: task-driven hierarchical attention network for the diagnosis of mild cognitive impairment and Alzheimer's disease

Zhehao Zhang, the Alzheimer's Disease NeuroImaging Initiative, Linlin Gao, Guang Jin, Lijun Guo, Yudong Yao, Li Dong, Jinming Han
2021 Quantitative Imaging in Medicine and Surgery  
It outperformed advanced attention-based and patch-based methods.  ...  We proposed a task-driven hierarchical attention network (THAN) taking advantage of the merits of patch-based and attention-based convolutional neural networks for MCI and AD diagnosis.  ...  Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved  ... 
doi:10.21037/qims-21-91 pmid:34249658 pmcid:PMC8249997 fatcat:devchrr7orcbbesyyct5fiawei

Dual Attention Multiple Instance Learning with Unsupervised Complementary Loss for COVID-19 Screening [article]

Philip Chikontwe, Miguel Luna, Myeongkyun Kang, Kyung Soo Hong, June Hong Ahn, Sang Hyun Park
2020 medRxiv   pre-print
Attention based pooling is applied to implicitly select key slices in latent space, and spatial attention learns slice spatial context for interpretable diagnosis.  ...  In this study, we propose an attention-based end-to-end weakly supervised framework for the rapid diagnosis of COVID-19 and bacterial pneumonia based on multiple instance learning (MIL).  ...  For the patch and slice-based approaches to be effective, infected regions must be well selected for training.  ... 
doi:10.1101/2020.09.14.20194654 fatcat:fsz2x427qraw3imbnotnqscgl4

An Enhanced Visual Attention Siamese Network That Updates Template Features Online

Wenqiu Zhu, Guang Zou, Qiang Liu, Zhigao Zeng, Yuan Yuan
2021 Security and Communication Networks  
The method is based on a deep convolutional neural network, which integrates channel attention and spatial self-attention to improve the discriminative ability of the tracker for positive and negative  ...  However, for most Siamese trackers, only a frame of the video sequence is used as the template, and the template is not updated in inference process, which makes the tracking success rate inferior to the  ...  Authors' Contributions ZWQ and ZG were responsible for conceptualization, original draft preparation, and review and editing. ZWQ, ZG, ZZG, and LQ validated the study.  ... 
doi:10.1155/2021/9719745 fatcat:5tzzjuqapbbbdd2sgpnfaanwqq

Look here! A parametric learning based approach to redirect visual attention [article]

Youssef Alami Mejjati and Celso F. Gomez and Kwang In Kim and Eli Shechtman and Zoya Bylinskii
2020 arXiv   pre-print
Extensions of our model allow for multi-style edits and the ability to both increase and attenuate attention in an image region.  ...  Motivated by professional workflows, we introduce an automatic method to make an image region more attention-capturing via subtle image edits that maintain realism and fidelity to the original.  ...  Here we discuss the key properties of each method.MEC (Mechrez et al.[32] 4 ): Being patch-based, this approach is limited to reusing colors and textures from the same image.  ... 
arXiv:2008.05413v1 fatcat:jukte3ddwvdf5c63p6kxpgwvze

Artwork Style Recognition Using Vision Transformers and MLP Mixer

Lazaros Alexios Iliadis, Spyridon Nikolaidis, Panagiotis Sarigiannidis, Shaohua Wan, Sotirios K. Goudos
2021 Technologies  
Through the extensive study of transformers, attention mechanisms have emerged as potentially more powerful than sequential recurrent processing and convolution.  ...  In addition, a comparative study between the most common optimizers was conducted obtaining useful information for future studies.  ...  Adam: Adam has been introduced as an algorithm for the first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lowerorder moments [25] .  ... 
doi:10.3390/technologies10010002 fatcat:2lh7rinolfdatp6z6kpqcz5bea

Adding geodesic information and stochastic patch-wise image prediction for small dataset learning

Adam Hammoumi, Maxime Moreaud, Christophe Ducottet, Sylvain Desroziers
2021 Neurocomputing  
Ducottet et al., Adding geodesic information and stochastic patch-wise image prediction for small dataset learning, Neurocomputing, https://doi.  ...  To handle cases with limited number of training samples, we propose a patch-based procedure with a stratified sampling method at inference.  ...  Acknowledgment The authors would like to thank Mohamed El Khamlichi for his contributions in a prior version of the used U-Net patch-based code.  ... 
doi:10.1016/j.neucom.2021.01.108 fatcat:osyofienczdcbg3dx5lyd56tkm

Finding good composition in panoramic scenes

Yuan-Yang Chang, Hwann-Tzong Chen
2009 2009 IEEE 12th International Conference on Computer Vision  
The task of finding good photo composition through a viewfinder is formulated as a search problem, and we present a stochastic search algorithm to look for good viewing configurations and to choose suitable  ...  reference images from the collection of masterpiece photographs.  ...  We thank the artists for giving us permission to use their photographs in our paper.  ... 
doi:10.1109/iccv.2009.5459470 dblp:conf/iccv/ChangC09 fatcat:aclfv6i7wvbfrm6crizu56p22u

Stone Weathering in a Photograph

Su Xue, Julie Dorsey, Holly Rushmeier
2011 Computer graphics forum (Print)  
These challenging effects involve significant geometry changes, which are intractable for previous image-based editing techniques.  ...  In this paper, we present a simple visual simulation pipeline for creating weathering effects on stone within a single image.  ...  Acknowledgement The authors thank the anonymous reviewers for their comments. Photos monkey and temple are courtesy of Digital Collections of Yale University Library.  ... 
doi:10.1111/j.1467-8659.2011.01977.x fatcat:2577w65tivcaxejvcpwdaufwhm

Color Sails: Discrete-Continuous Palettes for Deep Color Exploration [article]

Maria Shugrina, Amlan Kar, Karan Singh, Sanja Fidler
2018 arXiv   pre-print
Then, the user can adjust color sail parameters to change the base colors, their blending behavior and the number of colors, exploring a wide range of options for the original design.  ...  We propose a Neural Network that can fit a color sail to any image.  ...  We are also grateful to Nicole Sultanum for help with the user study design, and to Chris De Paoli for discussion.  ... 
arXiv:1806.02918v1 fatcat:gh5fla25qfgepfw7rlzrepcf24

Global and Local Attention-Based Free-Form Image Inpainting

Uddin S. M. Nadim, Yong Ju Jung
2020 Sensors  
Deep-learning-based image inpainting methods have shown significant promise in both rectangular and irregular holes.  ...  When depending solely on convolutional neural network (CNN) or adversarial supervision, plausible inpainting results cannot be guaranteed because irregular holes need attention-based guidance for retrieving  ...  values for image editing application [14] .  ... 
doi:10.3390/s20113204 pmid:32512949 pmcid:PMC7308970 fatcat:ppjgice335bcbdifyal6lku5ri

Deep Learning-Based Crowd Scene Analysis Survey

Sherif Elbishlawi, Mohamed H. Abdelpakey, Agwad Eltantawy, Mohamed S. Shehata, Mostafa M. Mohamed
2020 Journal of Imaging  
This paper surveys deep learning-based methods for analyzing crowded scenes. The reviewed methods are categorized as (1) crowd counting and (2) crowd actions recognition.  ...  Recently, our world witnessed major events that attracted a lot of attention towards the importance of automatic crowd scene analysis.  ...  In [62] , the author provided two inputs to the network: the parent patch and the child patch. The parent patch is the whole image, while the child patch is 2 × 2 sub-patches.  ... 
doi:10.3390/jimaging6090095 pmid:34460752 fatcat:qomcb354xrh4xdg7f5ac4qvujq

DeepProp: Extracting Deep Features from a Single Image for Edit Propagation

Yuki Endo, Satoshi Iizuka, Yoshihiro Kanamori, Jun Mitani
2016 Computer graphics forum (Print)  
Edit propagation is a technique that can propagate various image edits (e.g., colorization and recoloring) performed via user strokes to the entire image based on similarity of image features.  ...  We also develop a learning algorithm for our DNN that does not suffer from the vanishing gradient problem, and hence avoids falling into undesirable locally optimal solutions.  ...  Olga Diamanti for proofreading our paper. We also thank anonymous reviewers for their insightful suggestions. Yoshihiro Kanamori is funded by JSPS Postdoctoral Fellowships for Research Abroad.  ... 
doi:10.1111/cgf.12822 fatcat:7bvipakvtvbt3luflr5hgbeehy
« Previous Showing results 1 — 15 out of 3,286 results