37,335 Hits in 5.8 sec

Multimodal biomedical image retrieval using hierarchical classification and modality fusion

Md Mahmudur Rahman, Daekeun You, Matthew S. Simpson, Sameer K. Antani, Dina Demner-Fushman, George R. Thoma
2013 International Journal of Multimedia Information Retrieval  
To minimize limitations of low-level feature representations in content-based image retrieval (CBIR), and to complement text-based search, we propose a multi-modal image search approach that exploits hierarchical  ...  Finally, the multi-modal search consists of a weighted linear combination of similarity scores of independent output results from textual and visual search approaches (inter modality).  ...  Perform feature selection on the text feature vector to combine with visual feature vector. 3: Perform text-based image retrieval in Essie search engine and retrieve top most similar images (maximum 1000  ... 
doi:10.1007/s13735-013-0038-4 fatcat:cl7yikyncjaknivblsixnjbe74

Image Similarity Learning through Rankboost Mechanism Based On Keywords and Content Queries

Veena Sharanya .M
2013 IOSR Journal of Computer Engineering  
Content based image retrieval (CBIR) model uses the visual information of the images. Image search methods use the text annotation and image visual features.  ...  They are query keyword based model and content based image retrieval models. Text query strings are used in the textual image retrieval model.  ...  It requires the user to click on one query image with minimum effort and images from a pool retrieved by text-based search are reranked based on both visual and textual content.  ... 
doi:10.9790/0661-0854751 fatcat:2xvuovpnyjdsrlampjyacebxsy

Co-reranking by mutual reinforcement for image search

Ting Yao, Tao Mei, Chong-Wah Ngo
2010 Proceedings of the ACM International Conference on Image and Video Retrieval - CIVR '10  
Observing that multi-modality cues carry complementary relevant information, we propose the idea of co-reranking for image search, by jointly exploring the visual and textual information.  ...  Most existing reranking approaches to image search focus solely on mining "visual" cues within the initial search results.  ...  In contrast, co-reranking mutually takes the advantage of textual and visual cues from each other for simultaneous improvement of text and visual search.  ... 
doi:10.1145/1816041.1816048 dblp:conf/civr/YaoMN10 fatcat:6jeidijmmbbm3cqeb7sx5jwpam

Improving web image search results using query-relative classifiers

Josip Krapac, Moray Allan, Jakob Verbeek, Frederic Juried
2010 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition  
They combine textual features, based on the occurence of query terms in web pages and image meta-data, and visual histogram representations of images.  ...  Top-ranked images for the query 'eiffel tower', using (a) a text-based image search engine and (b) our model, ordered left-to-right.  ...  We thank ANR project R2I for financial support, and Exalead for image collection and labeling.  ... 
doi:10.1109/cvpr.2010.5540092 dblp:conf/cvpr/KrapacAVJ10 fatcat:6e6eqpp6zndg5gfmw2h2ubtls4

A Feature Analysis for Multimodal News Retrieval [article]

Golsa Tahmasebzadeh, Sherzod Hakimov, Eric Müller-Budack, Ralph Ewerth
2020 arXiv   pre-print
To this end, we consider five feature types for image and text and compare the performance of the retrieval system using different combinations.  ...  Experimental results show that retrieval results can be improved when considering both visual and textual information.  ...  Acknowledgements This project has received funding from the European Unions Horizon 2020 research and innovation programme under the Marie Skodowska-Curie grant agreement no 812997.  ... 
arXiv:2007.06390v2 fatcat:fgzrpwtrevedjngjsdaypetgpa

IntentSearch: Capturing User Intention for One-Click Internet Image Search

Xiaoou Tang, Ke Liu, Jingyu Cui, Fang Wen, Xiaogang Wang
2012 IEEE Transactions on Pattern Analysis and Machine Intelligence  
It only requires the user to click on one query image with minimum effort and images from a pool retrieved by text-based search are reranked based on both visual and textual content.  ...  Inside each category, a specific weight schema is used to combine visual features adaptive to this kind of image to better rerank the text-based search result. 2) Based on the visual content of the query  ...  ACKNOWLEDGMENTS This work is partially supported by Hong Kong SAR through RGC project 416510 and by Guangdong Province through Introduced Innovative R&D Team of Guangdong Province 201001D0104648280.  ... 
doi:10.1109/tpami.2011.242 pmid:22156100 fatcat:jdy234e23raoddgo2ftz3ezxbu

Visual Reranking: From Objectives to Strategies

xinmei tian, Dacheng Tao
2011 IEEE Multimedia  
Searching with textual queries is more natural for users, and it leads to another important search style, that is, text-based multimedia search.  ...  Text-based multimedia search completely relies on indexing the associated textual information of images, such as image tags, webpage filenames, and surrounding text.  ...  Reranking strategy At the early stage of improving text-based search results by incorporating visual information, simple linear combination was used to combine the search results derived from textual and  ... 
doi:10.1109/mmul.2011.36 fatcat:ti34miqu4vbqnhto3oa6q7znpu

Joint Visual-Textual Embedding for Multimodal Style Search [article]

Gil Sadeh, Lior Fritz, Gabi Shalev, Eduard Oks
2019 arXiv   pre-print
This joint visual-textual embedding space enables manipulating catalog images semantically, based on textual refinement requirements.  ...  We propose a method to retrieve similar items, based on a query item image and textual refinement properties.  ...  These feature vectors can be used to search for products, with similar visual or textual properties, in a dedicated catalog.  ... 
arXiv:1906.06620v1 fatcat:hma2wxq4rfaurov7s53zwovmay

Boosting image retrieval through aggregating search results based on visual annotations

Ximena Olivares, Massimiliano Ciaramita, Roelof van Zwol
2008 Proceeding of the 16th ACM international conference on Multimedia - MM '08  
image retrieval techniques to complement the text-based search.  ...  Textual annotations are used not only to describe the visual content of an image, but also subjective, spatial, temporal and social dimensions, complicating the task of keywordbased search.  ...  On the one hand, we focus on combining visual and textual search to improve the quality of our search results.  ... 
doi:10.1145/1459359.1459386 dblp:conf/mm/OlivaresCZ08 fatcat:5ehhsdbdlbfwvaq4bn6z3ruzqm

Sloth Search System at the Video Browser Showdown 2018 - Final Notes [article]

Nattachai Watcharapinchai, Sitapa Rujikietgumjorn, Sanparith Marukatat
2018 arXiv   pre-print
This short paper provides further details of the Sloth Search System, which was developed by the NECTEC team for the Video Browser Showdown (VBS) 2018.  ...  In order to combine the results from textual and visual search, the weighed formulation is used in Eq. 1.  ...  with video shot. • combining the text-based and sketch-based search by using weighted technique. • two display modes for the retrieval results: sort all frame by the similarity score and group the frames  ... 
arXiv:1806.01081v1 fatcat:uhetntlh4fhyjntoosx6jsqja4

A multimedia interactive search engine based on graph-based and non-linear multimodal fusion

Anastasia Moumtzidou, Ilias Gialampoukidis, Theodoros Mironidis, Dimitris Liparas, Stefanos Vrochidis, Ioannis Kompatsiaris
2016 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI)  
This paper presents an interactive multimedia search engine, which is capable of searching into multimedia collections by fusing textual and visual information.  ...  Apart from multimedia search, the engine is able to perform text search and image retrieval independently using both high-level and lowlevel information.  ...  ACKNOWLEDGMENTS This work was partially supported by the European Commission by the projects MULTISENSOR (FP7-610411), HOMER (FP7-312883) and KRISTINA (H2020-645012).  ... 
doi:10.1109/cbmi.2016.7500276 dblp:conf/cbmi/MoumtzidouGMLVK16 fatcat:zx3tgnl6dbcljaaezmakgmc72y

Semantic combination of textual and visual information in multimedia retrieval

Stéphane Clinchant, Julien Ah-Pine, Gabriela Csurka
2011 Proceedings of the 1st ACM International Conference on Multimedia Retrieval - ICMR '11  
These techniques emerge from the observation that image and textual queries are expressed at different semantic levels and that a single image query is often ambiguous.  ...  The goal of this paper is to introduce a set of techniques we call semantic combination in order to efficiently fuse text and image retrieval systems in the context of multimedia information access.  ...  There exist many text based search engines and content based image retrieval (CBIR) systems that respectively address text search and image search tasks.  ... 
doi:10.1145/1991996.1992040 dblp:conf/mir/ClinchantAC11 fatcat:b7tqeaadpfgz3dfbg5gq6j4vva

A Multimodal Learning to Rank model for Web Pages

2020 International Journal of Engineering and Advanced Technology  
The multimodal LTR which integrates the visual and textual features shows an improvement of 10-15% in web search accuracy.  ...  Researches have proven that a multimodality based search would improve the rank list populated. The multiple modalities considered here are the text on a webpage as well as the images on a webpage.  ...  [6] A multimodal web reranking that combines the text ranking with the image descriptors exploited a pure text-based search engine to find a ranked list of candidate web pages for a given query.  ... 
doi:10.35940/ijeat.f1442.089620 fatcat:2kfk6m47i5hhnfotnn7enheqzy

Late Semantic Fusion Approaches for Multimedia Information Retrieval with Automatic Tag Generation

Pooja Shinde, J.V. Shinde
2015 International Journal of Computer Applications  
Five late semantic fusion approaches are used for text based and content based image retrieval of any dataset.  ...  An image contains several types of visual information which are difficult to extract and combine manually by humans.  ...  They proposed semantic combination models for textual and visual information fusion can significantly improve multimedia retrieval performances while being more robust with respect to the choice of the  ... 
doi:10.5120/ijca2015906966 fatcat:qh64szjxd5bkheeiynex2mq3by

Web Image Retrieval using Hashing Technique: A Survey

Dattatray Waghole, Rupesh Bagul, Sandeep Turai, Ashwini Dawlekar
2015 International Journal of Engineering Research and  
moreover the textual and image based features.  ...  And then, users select the images based on their textual queries but it is in the form of visual images pool.  ...  moreover the textual and image based features.  ... 
doi:10.17577/ijertv4is020855 fatcat:4hlbcnwllnb4zeqescf7odq7vy
« Previous Showing results 1 — 15 out of 37,335 results