Filters








2,445 Hits in 3.5 sec

Sketch Me That Shoe

Qian Yu, Feng Liu, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales, Chen Change Loy
2016 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)  
We investigate the problem of fine-grained sketch-based image retrieval (SBIR), where free-hand human sketches are used as queries to perform instance-level retrieval of images.  ...  In this paper, for the first time, we address all these challenges, providing a step towards the capabilities that would underpin a commercial sketch-based image retrieval application.  ...  Free-hand sketch is ideal for fine-grained instance-level image retrieval.  ... 
doi:10.1109/cvpr.2016.93 dblp:conf/cvpr/YuLSXHL16 fatcat:oikyif7ihvck7djhowzmvaboxy

Hard Example Generation by Texture Synthesis for Cross-domain Shape Similarity Learning [article]

Huan Fu, Shunming Li, Rongfei Jia, Mingming Gong, Binqiang Zhao, Dacheng Tao
2020 arXiv   pre-print
Image-based 3D shape retrieval (IBSR) aims to find the corresponding 3D shape of a given 2D image from a large 3D shape database.  ...  While metric learning with some adaptation techniques seems to be a natural solution to shape similarity learning, the performance is often unsatisfactory for fine-grained shape retrieval.  ...  However, their performance is often unsatisfactory for fine-grained shape retrieval.  ... 
arXiv:2010.12238v2 fatcat:rafxackjgjbprmfvc3zitlmwxe

CustomCut: On-demand Extraction of Customized 3D Parts with 2D Sketches

Xuekun Guo, Juncong Lin, Kai Xu, Siddhartha Chaudhuri, Xiaogang Jin
2016 Computer graphics forum (Print)  
In contrast to earlier work on sketch-based retrieval of predefined parts, our approach can extract arbitrary parts from input shapes and does not rely on a prior segmentation into semantic components.  ...  Several applications in shape modeling and exploration require identification and extraction of a 3D shape part matching a 2D sketch. We present CustomCut, an on-demand part extraction algorithm.  ...  We address these challenges with a new super-face graph representation (SFG) for a 3D shape. The super-face graph is a discretized yet fine-grained version of the original model.  ... 
doi:10.1111/cgf.12966 fatcat:rshalrq2djggfdvet5bkl2ee6m

Generative Domain-Migration Hashing for Sketch-to-Image Retrieval [chapter]

Jingyi Zhang, Fumin Shen, Li Liu, Fan Zhu, Mengyang Yu, Ling Shao, Heng Tao Shen, Luc Van Gool
2018 Lecture Notes in Computer Science  
Due to the succinct nature of free-hand sketch drawings, sketch-based image retrieval (SBIR) has abundant practical use cases in consumer electronics.  ...  Comprehensive experiments of both category-level and fine-grained SBIR on multiple large-scale datasets demonstrate the consistently balanced superiority of GDH in terms of efficiency, memory costs and  ...  (ISN) [56] , 3D shape (3DS) [50] and Triplet Sketch-a-Net (TSN) [55] .  ... 
doi:10.1007/978-3-030-01216-8_19 fatcat:nbf4lhsfpbafhf3tzblzmkq6mi

FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Context [article]

Pinaki Nath Chowdhury and Aneeshan Sain and Yulia Gryaditskaya and Ayan Kumar Bhunia and Tao Xiang and Yi-Zhe Song
2022 arXiv   pre-print
Each sketch is augmented with its text description. Using our dataset, we study for the first time the problem of the fine-grained image retrieval from freehand scene sketches and sketch captions.  ...  In addition, we propose new solutions enabled by our dataset (i) We adopt meta-learning to show how the retrieval model can be fine-tuned to a new user style given just a small set of sketches, (ii) We  ...  [42, 46, 60] or 3D shapes [39] .  ... 
arXiv:2203.02113v2 fatcat:pzyg7m7a25bktdiby7uzkxfvmq

Fine-Grained Image Analysis with Deep Learning: A Survey [article]

Xiu-Shen Wei and Yi-Zhe Song and Oisin Mac Aodha and Jianxin Wu and Yuxin Peng and Jinhui Tang and Jian Yang and Serge Belongie
2021 arXiv   pre-print
image recognition and fine-grained image retrieval.  ...  In this paper we present a systematic survey of these advances, where we attempt to re-define and broaden the field of FGIA by consolidating two fundamental fine-grained research areas -- fine-grained  ...  Application to 3D Fine-Grained Tasks: Most existing FGIA approaches target 2D fine-grained images and the value of 3D information (e.g., 3D pose labels or 3D shape information) is under-explored.  ... 
arXiv:2111.06119v2 fatcat:ninawxsjtnf4lndtqquuwl3weq

RealPoint3D: An Efficient Generation Network for 3D Object Reconstruction from a Single Image

Yang Zhang, Zhen Liu, Tianpeng Liu, Bo Peng, Xiang Li
2019 IEEE Access  
INDEX TERMS 3D reconstruction, nearest shape retrieval, point cloud generation, single image, projection.  ...  the decoder to obtain fine-grained point clouds.  ...  Compared with voxel-based projection, the projection of point clouds delineates fine-grained parts.  ... 
doi:10.1109/access.2019.2914150 fatcat:b2wy72ufing27gmcry2ygu3zve

Interactive Annotation of 3D Object Geometry using 2D Scribbles [article]

Tianchang Shen, Jun Gao, Amlan Kar, Sanja Fidler
2020 arXiv   pre-print
The key idea behind our approach is to exploit strong priors that humans have about the 3D world in order to interactively annotate complete 3D shapes.  ...  First, we make an automatic guess of the 3D shape and allow the user to provide feedback about large errors by drawing scribbles in desired 2D views.  ...  [23] proposed to learn the correlation between 2D sketches and 3D shape.  ... 
arXiv:2008.10719v2 fatcat:efmdbwwvq5akjbjrt2ivu7trju

Triplet-Center Loss for Multi-View 3D Object Retrieval [article]

Xinwei He, Yang Zhou, Zhichao Zhou, Song Bai, Xiang Bai
2018 arXiv   pre-print
Extensive experimental results on two popular 3D object retrieval benchmarks and two widely-adopted sketch-based 3D shape retrieval benchmarks consistently demonstrate the effectiveness of our proposed  ...  features with deep metric learning for 3D object retrieval is more or less neglected.  ...  Sketch-based 3D shape retrieval task Considering the huge visual gap between sketch and 3D shape, sketch-based shape retrieval is a quite challenging problem.  ... 
arXiv:1803.06189v1 fatcat:ief3zlpv35dv3i2ptbouveldy4

SketchLattice: Latticed Representation for Sketch Manipulation [article]

Yonggang Qi, Guoyao Su, Pinaki Nath Chowdhury, Mingkang Li, Yi-Zhe Song
2021 arXiv   pre-print
leverages the structural information of drawing orders using sequential RNN-based methods.  ...  Existing work predominantly utilizes either, (i) a pixelative format that treats sketches as natural images employing off-the-shelf CNN-based networks, or (ii) an elaborately designed vector format that  ...  Cross-domain generative learning for fine- grained sketch-based image retrieval.  ... 
arXiv:2108.11636v1 fatcat:ytlolhn4sfhgbg2ekqqdekgmma

Triplet-Center Loss for Multi-view 3D Object Retrieval

Xinwei He, Yang Zhou, Zhichao Zhou, Song Bai, Xiang Bai
2018 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition  
Extensive experimental results on two popular 3D object retrieval benchmarks and two widely-adopted sketch-based 3D shape retrieval benchmarks consistently demonstrate the effectiveness of our proposed  ...  features with deep metric learning for 3D object retrieval is more or less neglected.  ...  Sketch-based 3D shape retrieval task Considering the huge visual gap between sketch and 3D shape, sketch-based shape retrieval is a quite challenging problem.  ... 
doi:10.1109/cvpr.2018.00208 dblp:conf/cvpr/HeZZBB18 fatcat:fezd3t3durgghjcb5xxtbdauby

Open Cross-Domain Visual Search [article]

William Thong, Pascal Mettes, Cees G.M. Snoek
2020 arXiv   pre-print
Our approach is competitive with respect to existing closed settings, where we obtain state-of-the-art results on several benchmarks for three sketch-based search tasks.  ...  For example, we may want to sketch an airplane and retrieve photographs of airplanes. Despite considerable progress, the search occurs in a closed setting between two pre-defined domains.  ...  Many-shot sketch-based 3D shape retrieval Setup Sketch-based 3D shape retrieval focuses on retrieving 3D shape models from a sketch query, where both training and testing samples share the same set of  ... 
arXiv:1911.08621v2 fatcat:gbdy2ltxufa37jop47mjrvtegi

Open cross-domain visual search

William Thong, Pascal Mettes, Cees G.M. Snoek
2020 Computer Vision and Image Understanding  
Our approach is competitive with respect to existing closed settings, where we obtain state-of-the-art results on several benchmarks for three sketch-based search tasks.  ...  For example, we may want to sketch an airplane and retrieve photographs of airplanes. Despite considerable progress, the search occurs in a closed setting between two pre-defined domains.  ...  Many-shot sketch-based 3D shape retrieval Setup.  ... 
doi:10.1016/j.cviu.2020.103045 fatcat:fpwc73iq6bhcre4gzpvuipfvl4

Mixing realities for sketch retrieval in Virtual Reality [article]

Daniele Giunchi, Stuart james, Donald Degraen, Anthony Steed
2019 arXiv   pre-print
While these techniques allow for mid-air sketching of basic shapes, it remains difficult for users to create detailed and comprehensive 3D models.  ...  In our work, we focus on supporting the user in designing the virtual environment around them by enhancing sketch-based interfaces with a supporting system for interactive model retrieval.  ...  [41] , where they developed a learning model based on triplets to describe the images considering fine-grained similarities. This approach was extensively used in recent works like in Wang et al.  ... 
arXiv:1910.11637v2 fatcat:ru6btg7v2ff6thbkhlf57hq4ai

Sketch-to-Design: Context-Based Part Assembly

Xiaohua Xie, Kai Xu, Niloy J. Mitra, Daniel Cohen-Or, Wenyong Gong, Qi Su, Baoquan Chen
2013 Computer graphics forum (Print)  
We rethink model design as navigating through different possible combinations of part assemblies based on a large collection of pre-segmented 3D models.  ...  The sketched strokes are analyzed individually and in context with the other parts to generate relevant shape suggestions via a design gallery interface.  ...  Sketch-based retrieval. Inspired by Funkhouser et al. [FMK * 03], many image-based approaches have been proposed towards sketch-based shape retrieval (see [SXY * 11] and references therein).  ... 
doi:10.1111/cgf.12200 fatcat:rmitw4e7tffjdklmu5ilaqhyyy
« Previous Showing results 1 — 15 out of 2,445 results