Filters








11,877 Hits in 4.3 sec

Structured Query-Based Image Retrieval Using Scene Graphs [article]

Brigit Schroeder, Subarna Tripathi
2020 arXiv   pre-print
In this paper we present a method which uses scene graph embeddings as the basis for an approach to image retrieval.  ...  We examine how visual relationships, derived from scene graphs, can be used as structured queries.  ...  As noted in [1] [2] , this is why content-based image retrieval is more successful when using complex structured queries (e.g.  ... 
arXiv:2005.06653v1 fatcat:uhfmzpvupbewxlig2tk62tj5r4

Scene Graph based Image Retrieval – A case study on the CLEVR Dataset [article]

Sahana Ramnath, Amrita Saha, Soumen Chakrabarti, Mitesh M. Khapra
2019 arXiv   pre-print
To facilitate this, we represent the catalog and caption as scene-graphs and model the retrieval task as a learnable graph matching problem, trained end-to-end with a REINFORCE algorithm.  ...  With the prolification of multimodal interaction in various domains, recently there has been much interest in text based image retrieval in the computer vision community.  ...  Conclusion We introduced a scene graph based image retrieval framework which models the task as a learnable graph matching problem over the query and catalog graph.  ... 
arXiv:1911.00850v1 fatcat:j5lktzr65ffbna5x77uu5bnksy

Image retrieval using scene graphs

Justin Johnson, Ranjay Krishna, Michael Stark, Li-Jia Li, David A. Shamma, Michael S. Bernstein, Li Fei-Fei
2015 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)  
We use these scene graphs as queries to retrieve semantically related images.  ...  This paper develops a novel framework for semantic image retrieval based on the notion of a scene graph.  ...  We gratefully acknowledge the support of NVIDIA Corporation with the donation of the GPUs used for this research.  ... 
doi:10.1109/cvpr.2015.7298990 dblp:conf/cvpr/JohnsonKSLSBL15 fatcat:tsii3gl3qnbt3c3bh2md46lvum

Graph-Based Indexing and Retrieval of Lifelog Data [chapter]

Manh-Duy Nguyen, Binh T. Nguyen, Cathal Gurrin
2021 Lecture Notes in Computer Science  
In this work, every lifelog image is represented by a scene graph, and at retrieval time, this scene graph is compared with the semantic graph, parsed from a textual query.  ...  In this paper, a graphical data structure, named "Scene Graph", is utilized to represent an encoded informative visual relationship graph for an image, which we suggest has a wide range of potential applications  ...  Image Retrieval After building the graph structure for both images and a query, the retrieval problem became how to calculate the similarity between the semantic graph of the topic with the set of scene  ... 
doi:10.1007/978-3-030-67835-7_22 fatcat:6zfz6jfxabbithxg7a7r5pkali

Semantic content based image retrieval using object-process diagrams [chapter]

Dov Dori, Hagit Hel-Or
1998 Lecture Notes in Computer Science  
This paper presents a new approach to image retrieval in which image content, based on the "visual scene", is the basis for both retrieval and user interface.  ...  Querying is is performed by representing the sought image with an Object-Process Diagram and nding the images in the database whose Object-Process Diagrams best match the query. 7th International Workshop  ...  Structure Matching is performed between two VOPDs by comparing the underlying graph structures using graph matching techniques 17].  ... 
doi:10.1007/bfb0033224 fatcat:hbkpkvrw2rcirgnzu22ltify7a

Modeling of Remote Sensing Image Content Using Attributed Relational Graphs [chapter]

Selim Aksoy
2006 Lecture Notes in Computer Science  
Finally, scenes are modeled using attributed relational graphs that combine region class information and spatial arrangements.  ...  First, scenes are decomposed into regions using pixel-based classifiers and an iterative split-and-merge algorithm.  ...  Symbolic representation of scenes and retrieval of images based on these representations are very challenging and popular topics in structural and syntactic pattern recognition.  ... 
doi:10.1007/11815921_52 fatcat:ntpnfhcq7nbgnbsd55v7vscowe

Analytical Review on Textual Queries Semantic Search based Video Retrieval

Prof. Suvarna L. Kattimani, Miss. Saba Parveen Bougdadi
2014 IJARCCE  
First textual query is matched to concept. The advantage of textual queries approach is object appearance and motion by using structure prediction.  ...  Semantic search based video retrieval is hard problem due to limited set of vocabulary.  ...  Content based image retrieval is a technique for image retrieval which is depends on feature of content of the image.  ... 
doi:10.17148/ijarcce.2017.64163 fatcat:d6hyjjzudbgg3g5dwnbjbildwq

Multi-Modal Retrieval using Graph Neural Networks [article]

Aashish Kumar Misraa, Ajinkya Kale, Pranav Aggarwal, Ali Aminian
2020 arXiv   pre-print
This graph structure helps us learn multi-modal node embeddings using Graph Neural Networks.  ...  ) and conceptually (i.e. containing the same salient objects) as a query image.  ...  This graph structure helps us learn multi-modal node embeddings using Graph Neural Networks.  ... 
arXiv:2010.01666v1 fatcat:mtp43eajpbabnhownf6tqaxhki

Graph Edit Distance Reward: Learning to Edit Scene Graph [article]

Lichang Chen, Guosheng Lin, Shijie Wang, Qingyao Wu
2020 arXiv   pre-print
To be specific, in order to learn editing scene graphs as the semantics given by texts, we propose a Graph Edit Distance Reward, which is based on the Policy Gradient and Graph Matching algorithm, to optimize  ...  Scene Graph, as a vital tool to bridge the gap between language domain and image domain, has been widely adopted in the cross-modality task like VQA.  ...  What's more, cross-modality image retrieval is also extended to real-world scenes such as recipe to food image retrieval where the input query is recipe, food image to recipe retrieval, using deep metric  ... 
arXiv:2008.06651v1 fatcat:7tes63oszfavvjieogdpn5nbfu

VISION-BASED INDOOR LOCALIZATION VIA A VISUAL SLAM APPROACH

M. Li, F. Rottensteiner
2019 The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences  
The relative poses of query images provide a pose graph-based geometric constraint which is used to assess the validity of image retrieval results.  ...  Instead of querying by a single image, a short sequence of images in the query site are used to extract both features and their relative poses, which is a local visual SLAM procedure.  ...  Another type of VBL systems (direct methods) is based on fine pose localization, which uses 3D structure information to retrieve images and estimate the poses.  ... 
doi:10.5194/isprs-archives-xlii-2-w13-827-2019 fatcat:ok7lurnjcfgydbdqx7nt2isym4

Compact Scene Graphs for Layout Composition and Patch Retrieval [article]

Subarna Tripathi and Sharath Nittur Sridhar and Sairam Sundaresan and Hanlin Tang
2019 arXiv   pre-print
We additionally demonstrate how scene graphs can be used to retrieve pose-constrained image patches that are semantically similar to the source query.  ...  Improving structured scene graph representations for rendering or retrieval is an important step towards realistic image generation.  ...  Applications include image synthesis or scene composition from scene graphs [8] and graph-based image patch retrieval.  ... 
arXiv:1904.09348v1 fatcat:fdlyouwf7vhgndkg4rhirvr2h4

Graph-Based Image Retrieval: State of the Art [chapter]

Imane Belahyane, Mouad Mammass, Hasna Abioui, Ali Idarrou
2020 Lecture Notes in Computer Science  
We review a number of recently available graph-based approaches in Image Retrieval aiming to determine factors adding semantic aspect in Image Retrieval system.  ...  This paper presents a state of the art of Image Retrieval approaches using graph theory due to the growing interest given to graphs in terms of performance, representation and its ability to ingrate semantic  ...  graph model Context based Image Retrieval using structure of the image [18] Generic context Simple graph model Query annotation Table 2 shows image-based approaches, classified according to the graph  ... 
doi:10.1007/978-3-030-51935-3_32 fatcat:gxjtwwvn5nam3ah5jxlt7ftcjy

Attribute-Graph: A Graph based approach to Image Ranking [article]

Nikita Prabhu, R. Venkatesh Babu
2015 arXiv   pre-print
The graph nodes characterise objects as well as the overall scene context using mid-level semantic attributes, while the edges capture the object topology.  ...  We propose a novel image representation, termed Attribute-Graph, to rank images by their semantic similarity to a given query image.  ...  Content based image retrieval techniques such as [6, 42] use image queries. Zheng et al.  ... 
arXiv:1509.06658v2 fatcat:hz3el6eawfhgdeh7lbohszvxdu

Graph-Based Image Matching for Indoor Localization

Mario Manzo
2019 Machine Learning and Knowledge Extraction  
This representation is integrated into a Content-Based Image Retrieval (CBIR) system, designed for the vision-based positioning task.  ...  In this context, the aim is to propose an alternative graph-based image representation. An image is encoded by a Region Adjacency Graph (RAG), based on Multicolored Neighborhood (MCN) clustering.  ...  As can seen, the images retrieved were very similar, in terms of the structure of scene, to each query.  ... 
doi:10.3390/make1030046 fatcat:kqreo5crjvagljzgzf2jv4lmhe

Cross-modal Scene Graph Matching for Relationship-aware Image-Text Retrieval

Sijin Wang, Ruiping Wang, Ziwei Yao, Shiguang Shan, Xilin Chen
2020 2020 IEEE Winter Conference on Applications of Computer Vision (WACV)  
We achieve state-ofthe-art results on Flickr30k and MS COCO, which verifies the advantages of our graph matching based approach for image-text retrieval.  ...  The image-text retrieval task is then naturally formulated as cross-modal scene graph matching.  ...  Most of these methods benefit from the use of scene graphs to present images.  ... 
doi:10.1109/wacv45572.2020.9093614 dblp:conf/wacv/Wang0YSC20 fatcat:tn2z4u3em5htbj7tkb3wxyuuim
« Previous Showing results 1 — 15 out of 11,877 results