Image and Video Tag Aggregation

Olga Kanishcheva, Natalia Sharonova
2018 International Joint Conference on the Analysis of Images, Social Networks and Texts  
In this paper, we explore the task of tag aggregations for the video and image files. In our work, we describe recent achievements image description generation, discuss tags and tagging. We present the result of our experiments based on the lexical resources and natural language processing approaches. In our work, we use the auto-tagging program from Imagga company as the generating program. As data, we use 5 videos which were split into shots for future processing. We identified two subtasks
more » ... r tag aggregation: 1) creation of general set tags for the whole video file and 2) creation separate sets of tags for each video shots. Our detailed tag analysis and experiment results showed that pipeline with NLP methods received good results for the whole video, but for each shot, in future work, we need to use such resources as Nasari vectors, SensEmbed vectors or word2vec. We present all our experiments with graphs, tables etc. Our future work will be related to aggregation of video descriptions.
dblp:conf/aist/KanishchevaS18 fatcat:zb7ulsr4gvb4zl727ze7ntt35y