Filters








3,614 Hits in 5.1 sec

Query-Adaptive Fusion for Multimodal Search

L. Kennedy, Shih-Fu Chang, A. Natsev
2008 Proceedings of the IEEE  
| We conduct a broad survey of query-adaptive search strategies in a variety of application domains, where the internal retrieval mechanisms used for search are adapted in response to the anticipated needs  ...  While these query-adaptive approaches can range from meta-search over text collections to multimodal search over video databases, we propose that all such systems can be framed and discussed in the context  ...  .: Query-Adaptive Fusion for Multimodal Search .J. Watson Research Center Hawthorne, NY. He joined IBM Research in 2001.  ... 
doi:10.1109/jproc.2008.916345 fatcat:izn34ieavjf3vmul55kjqq4bnu

Rescue Tail Queries

Xiaopeng Yang, Tao Mei, Yongdong Zhang
2014 Proceedings of the ACM International Conference on Multimedia - MM '14  
We therefore propose a novel query-dependent learning to re-rank approach for tail queries, called "click-wise multimodal fusion."  ...  Existing commercial search engines achieve very limited image search performance for tail queries.  ...  Thus, we believe that using click-through data for personal search is an interesting research topic in the future. ACKNOWLEDGMENTS  ... 
doi:10.1145/2647868.2654900 dblp:conf/mm/YangMZ14 fatcat:plpat2pfrjgqtbqwiad4whqowi

A Survey on Visual Search Reranking

Thalla Shankar, Lalitha Manglaram, Murali Sadak
2014 IOSR Journal of Computer Engineering  
However the problem is not trivial especially when we are considering multiple features or modalities for search in image and video retrieval.  ...  This paper suggests a new kind of reranking algorithm, the circular reranking, that supports the mutual exchange of information across multiple modalities for improving search performance, and follows  ...  Query-classdependent models for multimodal search by defining query classes through a clustering process according to search method performance and semantic features.  ... 
doi:10.9790/0661-16197881 fatcat:7txgqtlicnfcffteakolplwdji

Image Retrieval and Re-Ranking Techniques - A Survey

Mayuri D. Joshi, Revati M. Deshmukh, Kalashree N.Hemke, Ashwini Bhake, Rakhi Wajgi
2014 Signal & Image Processing An International Journal  
This re-ranking process aids the mutual transfer of information across multiple modalities to improvise search performance to facilitate authentic searching.  ...  In contrast to the existing techniques, the re-ranking method fosters the interaction between modalities to find a tranquillity which is helpful for re-ranking.  ...  Query-class-dependent models for multimodal search by defining query classes through a clustering process according to search method performance and semantic features.  ... 
doi:10.5121/sipij.2014.5201 fatcat:gusz6wizpbgsfgjt6asf7s44fi

A Multimodal Search Engine for Medical Imaging Studies

Eduardo Pinho, Tiago Godinho, Frederico Valente, Carlos Costa
2016 Journal of digital imaging  
Multimodal information retrieval . Query fusion . Web services  ...  This paper proposes an extensible platform for multimodal medical image retrieval, integrated in an open-source PACS software with profile-based CBIR capabilities.  ...  The query interface manager contains adapters for delegating queries to specific providers, according to the kind of query requested by the engine.  ... 
doi:10.1007/s10278-016-9903-z pmid:27561754 pmcid:PMC5267596 fatcat:6zplir2l6zdn3ktpfuwpr2ykna

A multimodal tensor-based late fusion approach for satellite image search in Sentinel 2 images

Ilias Gialampoukidis, Anastasia Moumtzidou, Marios Bakratsas, Stefanos Vrochidis, Ioannis Kompatsiaris
2021 Zenodo  
The multimodal character of EO Big Data requires eective combination of multiple modalities for similarity search.  ...  Quantitative and qualitative results show that the proposed method outperforms search by a single modality and other late fusion methods.  ...  Section 2 presents relevant works in multimodal fusion for similarity search in information retrieval.  ... 
doi:10.5281/zenodo.4293265 fatcat:lqibjpr27zbyljyz3um53xciny

Query-Document-Dependent Fusion: A Case Study of Multimodal Music Retrieval

Zhonghua Li, Bingjun Zhang, Yi Yu, Jialie Shen, Ye Wang
2013 IEEE transactions on multimedia  
By investigating multimodal fusion strategies adaptive to both queries and documents, we demonstrate that existing multimodal fusion approaches are special cases of QDDF and propose two QDDF approaches  ...  We thus propose a general multimodal fusion framework, query-document-dependent fusion (QDDF), which derives the optimal fusion strategy for each query-document pair via intelligent content analysis of  ...  each query-document pair by analyzing the content of both queries and documents. • Based on how fusion strategies adapt to queries and documents, we re-categorize existing multimodal fusion approaches  ... 
doi:10.1109/tmm.2013.2280437 fatcat:7io6qmo4bre5vagrtaaap7lgcm

An adaptable search engine for multimodal information retrieval

Gilles Hubert, Josiane Mothe
2009 Journal of the American Society for Information Science and Technology  
This paper is an overview of multimodal information retrieval, challenges in the progress of multimodal information retrieval. General Terms Multi Modal Information Retrieval, Information Retrieval.  ...  Multimodal information retrieval is a research problem of great interest in all domains, due to the huge collections of multimedia data available in different contexts like text, image, audio and video  ...  A novel unified framework for multimodal search and retrieval by introducing a novel data representation for multimodal data in Content Object (CO) is described in [12] .  ... 
doi:10.1002/asi.21091 fatcat:jgcvyun6zna7vkze5wcliibzxu

Rank Fusion and Multimodal Per-topic Adaptiveness for Diverse Image Retrieval

Rodrigo Tripodi Calumby, Iago Breno Alves do Carmo Araujo, Felipe Souza Cordeiro, Fabiana Bertoni, Sérgio D. Canuto, Fabiano Belém, Marcos André Gonçalves, Ícaro C. Dourado, Javier Munoz, Lin Li, Ricardo da Silva Torres
2017 MediaEval Benchmarking Initiative for Multimedia Evaluation  
For diversification, we use diversity-oriented reranking and also propose a clustering-based query-adaptive diversity promotion approach.  ...  Our proposal for relevance improvement relies on text and credibility-based reranking and rank aggregation.  ...  ACKNOWLEDGMENTS The authors thank FAPESP, FAPEMIG, CAPES, CNPq, and FAPESB (grant #4098/2016) for partially funding this work.  ... 
dblp:conf/mediaeval/CalumbyACBCBGDM17 fatcat:gdhyped7zbe4hdpit6ilacnl54

Design of Multimodal Dissimilarity Spaces for Retrieval of Video Documents

E. Bruno, N. Moenne-Loccoz, S. Marchand-Maillet
2008 IEEE Transactions on Pattern Analysis and Machine Intelligence  
This paper proposes a novel representation space for multimodal information, enabling fast and efficient retrieval of video data.  ...  The problem of automatic kernel setting to adapt the learning process to the queries is also discussed. The properties of our strategies are studied and validated on artificial data.  ...  Consequently, an automatic kernel parameter setting is derived to enable the SVM to adapt online to the user feedback. In section IV, various strategies for multimodal fusion are detailed.  ... 
doi:10.1109/tpami.2007.70801 pmid:18617712 fatcat:2f2egkuiwvecfc6awmj2b7wvaa

I-SEARCH

Thomas Steiner, Laurent Joyeux, Jonas Etzold, Paul Grimm, Athanasios Mademlis, Sotiris Malassiotis, Petros Daras, Apostolos Axenopoulos, Dimitrios Tzovaras, Lorenzo Sutton, Sabine Spiller, Marilena Lazzaro (+5 others)
2012 Proceedings of the 21st international conference companion on World Wide Web - WWW '12 Companion  
In this paper, we report on work around the I-SEARCH EU (FP7 ICT STREP) project whose objective is the development of a multimodal search engine.  ...  Multimodal search can be used in two senses; (i), in the sense of multimodal result output based on unimodal query input, and (ii), in the sense of multimodal result output and multimodal query input.  ...  PROJECT GOALS With the I-SEARCH project, we aim for the creation of a multimodal search engine that allows for both multimodal in-and output.  ... 
doi:10.1145/2187980.2188031 dblp:conf/www/SteinerSSLNCMCVJEGMMDAT12 fatcat:4o62ypj7jjdm5pvjb4f5hus4rm

Multimodal Graph-Based Reranking for Web Image Search

Meng Wang, Hao Li, Dacheng Tao, Ke Lu, Xindong Wu
2012 IEEE Transactions on Image Processing  
This paper introduces a web image search reranking approach that explores multiple modalities in a graphbased learning scheme.  ...  In this way, the effects of different modalities can be adaptively modulated and better reranking performance can be achieved.  ...  of the i -th search result for query q.  ... 
doi:10.1109/tip.2012.2207397 pmid:22829401 fatcat:wu4blv6cpnehvbphu64kchw33u

Comprehensive query-dependent fusion using regression-on-folksonomies

Bingjun Zhang, Qiaoliang Xiang, Huanhuan Lu, Jialie Shen, Ye Wang
2009 Proceedings of the seventeen ACM international conference on Multimedia - MM '09  
In this paper, we study the problem of integrating multiple online information sources to conduct effective query dependent fusion (QDF) of multiple search experts for music retrieval.  ...  All test data will be released to the public for better research synergy in multimodal music search.  ...  ACKNOWLEDGEMENT Figure 1 : 1 The framework of regression-on-folksonomy based query-dependent fusion for effective multimodal search.  ... 
doi:10.1145/1631272.1631303 dblp:conf/mm/ZhangXLSW09 fatcat:aswjlvrnyjglro6oncjwooc5uu

Early_and_Late_Fusion_of_Multiple_Modalities_in_Sentinel_Image_Retrieval

Wei Yao, Anastasia Moumtzidou, Corneliu Octavian Dumitru, Stelios Andreadis, Ilias Gialampoukidis, Stefanos Vrochidis, Mihai Datcu, Ioannis Kompatsiaris
2020 Zenodo  
The retrieval of relevant information based on a target query or event is critical for operational purposes, for example, to monitor flood events in urban areas, and crop monitoring for food security scenarios  ...  To that end, we propose an early fusion (low-level features) and late fusion (high-level concepts) mechanism that combines the results of two EU-funded projects for information retrieval in Sentinel imagery  ...  Section 2 presents relevant works in multimodal fusion for the two main fusion strategies.  ... 
doi:10.5281/zenodo.4280738 fatcat:qv7nqqqumrbifodqt5jrgvkhva

Combining multimodal preferences for multimedia information retrieval

Eric Bruno, Jana Kludas, Stephane Marchand-Maillet
2007 Proceedings of the international workshop on Workshop on multimedia information retrieval - MIR '07  
In this paper we address more specifically the problem of multimedia content retrieval by first defining a novel preference-based representation particularly adapted to the fusion problem, and then, by  ...  investigating the RankBoost algorithm to combine those preferences and a learn multimodal retrieval model.  ...  We compare multimodal retrieval techniques with the best monomodal search (hierarchical SVM in D ASR P ). In that case, the retrieval accuracy benefits from multimodal fusion.  ... 
doi:10.1145/1290082.1290095 dblp:conf/mir/BrunoKM07 fatcat:mlbohdvs2jflzh3gmpwqcnhekq
« Previous Showing results 1 — 15 out of 3,614 results