Filters








24,868 Hits in 4.7 sec

Modality-dependent Cross-media Retrieval [article]

Yunchao Wei, Yao Zhao, Zhenfeng Zhu, Shikui Wei, Yanhui Xiao, Jiashi Feng, Shuicheng Yan
2015 arXiv   pre-print
Different from previous works, we propose a modality-dependent cross-media retrieval (MDCR) model, where two couples of projections are learned for different cross-media retrieval tasks instead of one  ...  In this paper, we investigate the cross-media retrieval between images and text, i.e., using image to search text (I2T) and using text to search images (T2I).  ...  MODALITY-DEPENDENT CROSS-MEDIA RETRIEVAL In this section, we detail the proposed supervised cross-media retrieval method, which we call modality-dependent cross-media retrieval (MDCR).  ... 
arXiv:1506.06628v2 fatcat:vbnedfrefzdldk67prpojzl2v4

Deep Learning Techniques for Future Intelligent Cross-Media Retrieval [article]

Sadaqat ur Rehman, Muhammad Waqas, Shanshan Tu, Anis Koubaa, Obaid ur Rehman, Jawad Ahmad, Muhammad Hanif, Zhu Han
2020 arXiv   pre-print
In this paper, we provide a novel taxonomy according to the challenges faced by multi-modal deep learning approaches in solving cross-media retrieval, namely: representation, alignment, and translation  ...  and the potential solutions of deep learning assisted cross-media retrieval.  ...  [128] introduced a novel Dependency Tree Recursive Neural Networks (DT-RNNs) model which embed one modality (e.g., sentences) into a vector space using dependency trees in order to retrieve cross-modality  ... 
arXiv:2008.01191v1 fatcat:t63bg55w2vdqjcprzaaidrmprq

A Cross-Media Retrieval Method Based on Semisupervised Learning and Alternate Optimization

Junzheng Li, Wei Zhu, Yanchun Yang, Xiyuan Zheng
2021 Mobile Information Systems  
The most difficult task for cross-media retrieval lies in the potential correlation between different modalities data and how to overcome the semantic gap.  ...  Cross-media retrieval is a prime example, aiming at retrieving various forms of data, for example, text, image, audio, video, and other forms.  ...  A Cross-Media Retrieval Method Based on Semisupervised Learning and Alternate Optimization Modality-Dependent Cross-media Retrieval (MDCR) [30] method improves the accuracy of each single retrieval and  ... 
doi:10.1155/2021/9947644 doaj:90a40b8f33a34c6fa8e02d33c8713613 fatcat:3hfjrkeerfa3tgbtlmwd3o6qd4

Survey Paper on Generating Correlation among Different Modalities by Using Parallel Processing for Cross-Media Retrieval

Rokkam SrikanthReddy
2017 International Journal for Research in Applied Science and Engineering Technology  
In the proposed method retrieve cross-media information using multi core processer and multi-threading.  ...  To retrieving cross-media information from large data sets it causes difficulties to process and retrieve the information at run time.  ...  INTRODUCTION The main aim of the proposed system is to increase the efficiency of retrieving cross-media information.  ... 
doi:10.22214/ijraset.2017.8309 fatcat:5j65haeztfdedoljvqrczo2pxq

Cross-Media Scientific Research Achievements Retrieval Based on Deep Language Model [article]

Benzhi Wang, Meiyu Liang, Feifei Kou, Mingying Xu
2022 arXiv   pre-print
Key words science and technology big data ; cross-media retrieval; cross-media semantic association learning; deep language model; semantic similarity  ...  between different modal data.Experimental results show that the proposed CARDL method achieves better cross-modal retrieval performance than existing methods.  ...  This paper proposes a cross-media scientific research achievement retrieval method (CARDL) based on the deep language model, to realize the efficient and accurate cross-media retrieval of massive scientific  ... 
arXiv:2203.15595v1 fatcat:wy4nvtsxq5awliyvxuodrcv4lu

Cross-media analysis and reasoning: advances and directions

Yu-xin Peng, Wen-wu Zhu, Yao Zhao, Chang-sheng Xu, Qing-ming Huang, Han-qing Lu, Qing-hua Zheng, Tie-jun Huang, Wen Gao
2017 Frontiers of Information Technology & Electronic Engineering  
graph construction and learning methodologies; (4) cross-media knowledge evolution and reasoning; (5) cross-media description and generation; (6) cross-media intelligent engines; and (7) cross-media intelligent  ...  To address these issues, we provide an overview as follows: (1) theory and model for cross-media uniform representation; (2) cross-media correlation understanding and deep mining; (3) cross-media knowledge  ...  The distances between MMDs are related to each modality, and in this way we can perform cross-media retrieval.  ... 
doi:10.1631/fitee.1601787 fatcat:dqnizhdlbfhpvodzkhv5nlarxq

Modality-Dependent Cross-Modal Retrieval Based on Graph Regularization

Guanhua Wang, Hua Ji, Dexin Kong, Na Zhang
2020 Mobile Information Systems  
In order to fully exploit the potential correlation of different modalities, we propose a cross-modal retrieval framework based on graph regularization and modality dependence (GRMD).  ...  Nowadays, the heterogeneity gap of different modalities is the key problem for cross-modal retrieval.  ...  Wei et al. proposed a modality-dependent cross-media retrieval method [40] . e method focuses on the retrieval direction and uses the semantic information of the query modality to project the data into  ... 
doi:10.1155/2020/4164692 fatcat:2ku7xp5x65bkhggvu7x7skspja

Semantic Correlation based Deep Cross-Modal Hashing for Faster Retrieval

2019 VOLUME-8 ISSUE-10, AUGUST 2019, REGULAR ISSUE  
However, due to flexible requirements of users, cross-modal retrieval plays very important role which works across the modalities.  ...  So many deep-based cross-modal hashing techniques were proposed which improves the performance in comparison with non-deep cross-modal techniques.  ...  STUDY ON CROSS-MODAL RETRIEVAL METHODS Cross-Modal retrieval system is broadly divided into common subspace-learning and cross-modal hashing methods [31] .  ... 
doi:10.35940/ijitee.i8157.0881019 fatcat:jy2hfk7vx5dpzcr74lbvtvml7i

Cross-Media Retrieval via Semantic Entity Projection [chapter]

Lei Huang, Yuxin Peng
2016 Lecture Notes in Computer Science  
Cross-media retrieval is becoming increasingly important nowadays.  ...  Finally, the semantic abstraction of high-level concepts is generated by using logistic regression to conduct cross-media retrieval.  ...  jointly learns a set of mapping functions across different modalities for cross-media retrieval.  ... 
doi:10.1007/978-3-319-27671-7_23 fatcat:zhy4dmfgarho5oe2pwfahmvudu

MMED: A Multi-domain and Multi-modality Event Dataset [article]

Zhenguo Yang, Zehang Lin, Min Cheng, Qing Li, Wenyin Liu
2019 arXiv   pre-print
We hope that the release of the MMED dataset can stimulate innovate research on related challenging problems, such as event discovery, cross-modal (event) retrieval, and visual question answering, etc.  ...  In this work, we construct and release a multi-domain and multi-modality event dataset (MMED), containing 25,165 textual news articles collected from hundreds of news media sites (e.g., Yahoo News, Google  ...  ., event discovery, cross model (event) retrieval, and visual question answering, etc. The real-world dataset is well-labeled, can be used for other scenarios with an open mind.  ... 
arXiv:1904.02354v2 fatcat:mxwxuzgt5nbqflvfawsbowchfy

Kernelizing Semantic Similarity Measurement Using Bi-directional Learning Ranking for Cross-Modal Retrieval

SHUANG LIU, LIANG BAI, XIANG-AN HENG, YAN-LI HU
2018 DEStech Transactions on Computer Science and Engineering  
which is more suitable for cross-modal retrieval tasks.  ...  Aiming at measuring the inner semantic similarities between different modal data, cross-modal retrieval tries to map heterogenous features to a hidden common subspace in which they can be reasonably compared  ...  Cross-media retrieval refers to the realization of text, images, video and other multi-modal information retrieval.  ... 
doi:10.12783/dtcse/ceic2018/24530 fatcat:daslx4hzyfeq3oxsdvcdp5qsk4

Semi-supervised learning based semantic cross-media retrieval

Xiyuan Zheng, Wei Zhu, Zhenmei Yu, Meijia Zhang
2021 IEEE Access  
With the growth of multimedia data, the key problem faced by cross-media retrieval technology is how to quickly retrieve multimedia data with different modalities of the same semantic.  ...  INDEX TERMS Cross-media retrieval, Semi-supervised learning, Manual labeling  ...  Such as Modality-dependent Cross-media Retrieval (MDCR) [28] . Mao et al. [15] proposed a Parallel Field Alignment Retrieval method (PFAR).  ... 
doi:10.1109/access.2021.3080976 fatcat:q3247flvm5f7nkx2tndatep7he

Learning a Semantic Space by Deep Network for Cross-media Retrieval

Zhao Li, Wei Lu, Egude Bao, Weiwei Xing
2015 Proceedings of the 21st International Conference on Distributed Multimedia Systems  
With the growth of multimedia data, the problem of cross-media (or cross-modal) retrieval has attracted considerable interest in the cross-media retrieval community.  ...  In this paper, we propose a simple but effective deep learning method to address the cross-media retrieval problem between images and text documents for samples either with single or multiple labels.  ...  This is because the performance of cross-media retrieval between images and text is highly dependent on visual feature representation, but traditional feature extraction techniques have been undergoing  ... 
doi:10.18293/dms2015-005 dblp:conf/dms/LiLBX15 fatcat:rshxdcbrcveyldjiehh7sj6afa

Using the MPEG Query Format for Cross-Modal Identification

Matthias Gruhne, Peter Dunker, Ruben Tous
2009 Journal of Multimedia  
During the last years, the cross-modal search of visual and audio information has become more and more important.  ...  The interface between user and database is described in detail, examples are given and extensive results for the cross-modal search are presented.  ...  Another application for cross-modal retrieval is compensating corrupted (or absent) media sources.  ... 
doi:10.4304/jmm.4.5.266-276 fatcat:ckcjqoa4qrcvtge2eyewooj4ry

Multi-modal Mutual Topic Reinforce Modeling for Cross-media Retrieval

Yanfei Wang, Fei Wu, Jun Song, Xi Li, Yueting Zhuang
2014 Proceedings of the ACM International Conference on Multimedia - MM '14  
By investigating the cross-modal topic-related distribution information, M 3 R encourages to disentangle the semantically consistent cross-modal topics (containing some common semantic information across  ...  Experimental results over two benchmark datasets demonstrate the effectiveness of the proposed M 3 R in crossmodal retrieval.  ...  data with the same category as the query forward than those with other categories, when it is applied to cross-media retrieval.  ... 
doi:10.1145/2647868.2654901 dblp:conf/mm/WangWSLZ14 fatcat:rb65bjlp4zbjnh2qxc64x5w3da
« Previous Showing results 1 — 15 out of 24,868 results