Predicting Entry-Level Categories

Vicente Ordonez, Wei Liu, Jia Deng, Yejin Choi, Alexander C. Berg, Tamara L. Berg
2015 International Journal of Computer Vision  
Entry-level categories -the labels people use to name an object -were originally defined and studied by psychologists in the 1970s and 80s. In this paper we extend these ideas to study entry-level categories at a larger scale and to learn models that can automatically predict entrylevel categories for images. Our models combine visual recognition predictions with linguistic resources like WordNet and proxies for word "naturalness" mined from the enormous amount of text on the web. We
more » ... the usefulness of our models for predicting nouns (entry-level words) associated with images by people, and for learning mappings between concepts predicted by existing visual recognition systems and entry-level concepts. In this work we make use of recent successful efforts on convolutional network models for visual recognition by training classifiers for 7,404 object categories on ConvNet activation features. Results for category mapping and entry-level category prediction for images show promise for producing more natural human-like labels. We also demonstrate the potential applicability of our results to the task of image description generation.
doi:10.1007/s11263-015-0815-z fatcat:mexsullvebgebpvrpawmkc62ye