3,846 Hits in 4.6 sec

Learned Lexicon-Driven Interactive Video Retrieval [chapter]

Cees Snoek, Marcel Worring, Dennis Koelma, Arnold Smeulders
2006 Lecture Notes in Computer Science  
Top ranking results show that the lexicon-driven search engine is highly effective for interactive video retrieval.  ...  We combine in this paper automatic learning of a large lexicon of semantic concepts with traditional video retrieval methods into a novel approach to narrow the semantic gap.  ...  The benchmark results demonstrate that lexicon-driven interactive retrieval yields state-of-the-art accuracy.  ... 
doi:10.1007/11788034_2 fatcat:azl3fcra7be5pm2j2yseji22hq

A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval

C.G.M. Snoek, M. Worring, D.C. Koelma, A.W.M. Smeulders
2007 IEEE transactions on multimedia  
In addition, we show that the lexicon-driven search engine outperforms all state-of-the-art video retrieval systems in both TRECVID 2004 and 2005.  ...  Index Terms-Benchmarking, concept learning, content analysis and indexing, interactive systems, multimedia information systems, video retrieval.  ...  We propose a lexicon-driven paradigm to video retrieval. The uniqueness of the proposed paradigm lies in its emphasis on automatic learning of a large lexicon of concepts.  ... 
doi:10.1109/tmm.2006.886275 fatcat:e6jbqy6zlbca3hwngn3b5rpfvy


Cees G. M. Snoek, Marcel Worring, Jan van Gemert, Jan-Mark Geusebroek, Dennis Koelma, Giang P. Nguyen, Ork de Rooij, Frank Seinstra
2005 Proceedings of the 13th annual ACM international conference on Multimedia - MULTIMEDIA '05  
Based on this lexicon we demonstrate how users can obtain highly relevant retrieval results using query-byconcept.  ...  A search engine that facilitates access to news video archives at a semantic level. The core of the system is an unprecedented lexicon of 100 automatically detected semantic concepts.  ...  Within the MediaMill system we explore advanced visualizations for novel video retrieval applications. We take the lexicon of semantic concepts as a basis.  ... 
doi:10.1145/1101149.1101188 dblp:conf/mm/SnoekWGGKNRS05 fatcat:xt25w2snvjaspjsf53ix7ku5pe

The MediaMill TRECVID 2005 Semantic Video Search Engine (Draft Version)

Cees G. M. Snoek, Jan C. van Gemert, Jan-Mark Geusebroek, Bouke Huurnink, Dennis C. Koelma, Giang P. Nguyen, Ork de Rooij, Frank J. Seinstra, Arnold W. M. Smeulders, Cor J. Veenman, Marcel Worring
2005 TREC Video Retrieval Evaluation  
The lexicon-driven retrieval paradigm aids substantially in all search tasks.  ...  When coupled with interaction, exploiting several novel browsing schemes of our semantic video search engine, results are excellent. We obtain a top-3 result for 19 out of 24 search topics.  ...  Lexicon-driven Retrieval We propose a lexicon-driven retrieval paradigm to equip users with semantic access to multimedia archives.  ... 
dblp:conf/trecvid/SnoekGGHKNRSSVW05 fatcat:wymhnhhlsvh6fnpnqgsnecmgie

Lexicon-based Browsers for Searching in News Video Archives

M. Worring, C.G.M. Snoek, D.C. Koelma, G.P. Nguyen, O. de Rooij
2006 18th International Conference on Pattern Recognition (ICPR'06)  
In this paper we present the methods and visualizations used in the MediaMill video search engine. The basis for the engine is a semantic indexing process which derives a lexicon of 101 concepts.  ...  Structuring the video collection The aim of our interactive retrieval is to retrieve from a multimedia archive A, which is composed of n unique shots {s 1 , s 2 , . . . , s n }, the best possible answer  ...  Semantic similarity space Computing visual features and similarity is common practice in all interactive content based video retrieval systems.  ... 
doi:10.1109/icpr.2006.760 dblp:conf/icpr/WorringSKNR06 fatcat:alhdjfsk6fgtbmwzscrmtbis44

Semantic Video Search

A.W.M. Smeulders, J.C. van Gemert, B. Huurnink, D.C. Koelma, O. de Rooij, K.E.A. van de Sande, C.G.M. Snoek, C.J. Veenman, M. Worring
2007 14th International Conference of Image Analysis and Processing - Workshops (ICIAPW 2007)  
To handle such a large thesaurus in retrieval, an engine is developed which allows users to select relevant concept detectors based on interactive browsing using advanced visualizations.  ...  Similar to previous years our best interactive search runs yield top performance, ranking 2nd and 6th overall.  ...  Acknowledgments This research is sponsored by the BSIK MultimediaN project, the NWO MuNCH project, and the EU 6th Framework project VIDI-Video.  ... 
doi:10.1109/iciapw.2007.39 fatcat:lsb6nuqx4nefjb2higadnf47ze

A Survey on Multimodal Video Representation for Semantic Retrieval

J. Calic, N. Campbell, S. Dasiopoulou, Y. Kompatsiaris
2005 EUROCON 2005 - The International Conference on "Computer as a Tool"  
This paper surveys the approaches to video representation, focusing on semantic analysis for content-based indexing and retrieval.  ...  Furthermore, the concept of video multimodality is reevaluated and redefined in order to introduce modalities such as editing technique or affect to the audience.  ...  Therefore, a balanced interaction between feature driven bottomup approaches and top-down algorithms could be a solution to a generic model for video representation. IV.  ... 
doi:10.1109/eurcon.2005.1629877 fatcat:e25kjkfqx5fplht6rrnavhwy54

AI-Josyu: Thinking Support System in Class by Real-time Speech Recognition and Keyword Extraction

Kyohei Matsumoto, Takafumi Nakanishi, Toshitada Sakawa, Kengo Onodera, Shinichiro Orimo, Hiroyuki Kobayashi
2019 Emitter: International Journal of Engineering Technology  
AI-Josyu is implemented based on media-driven real-time content management framework. The system links real world media and legacy media contents together.  ...  This system records teacher's voice of its lecture in real time and presents retrieved legacy media contents corresponding to subject of the lecture.  ...  The speech recognition has been used for quickly searching keywords to retrieve text or video lecture content [8] [9] [10] .  ... 
doi:10.24003/emitter.v7i1.373 fatcat:roit2636ifdixcbfthih65ts74

The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing

G.G.M. Snoek, M. Worring, J.M. Geusebroek, D.C. Koelma, F.J. Seinstra, A.W.M. Smeulders
2006 IEEE Transactions on Pattern Analysis and Machine Intelligence  
To show the generality of this novel indexing approach, we develop detectors for a lexicon of 32 concepts and we evaluate the semantic pathfinder against the 2004 NIST TRECVID video retrieval benchmark  ...  of an authoring-driven process.  ...  We use the authoring-driven process of video production as the leading principle for generic video indexing.  ... 
doi:10.1109/tpami.2006.212 pmid:16986547 fatcat:sdvlvg7s4zayno7iekrn44qzl4

The MediaMill TRECVID 2006 Semantic Video Search Engine

Cees G. M. Snoek, Jan C. van Gemert, Theo Gevers, Bouke Huurnink, Dennis C. Koelma, M. van Liempt, Ork de Rooij, Koen E. A. van de Sande, Frank J. Seinstra, Arnold W. M. Smeulders, Andrew H. C. Thean, Cor J. Veenman (+1 others)
2006 TREC Video Retrieval Evaluation  
Again a lot has been learned during this year's TRECVID campaign, we highlight the most important lessons at the end of this paper.  ...  Our Challenge experiments focus specifically on visual-only analysis of video (run id: B MM).  ...  Semantic Video Retrieval Our TRECVID 2006 search task efforts have concentrated on automatic and interactive retrieval using the lexicon of 491 learned concept detectors.  ... 
dblp:conf/trecvid/SnoekGGHKLRSSST06 fatcat:qykmp4arizgn5lmdsfzhy7fawi

Semantic Video Indexing [chapter]

Cees G. M. Snoek, Marcel Worring, Jan-Mark Geusebroek, Dennis C. Koelma, Frank J. Seinstra, Arnold W. M. Smeulders
2007 Multimedia Retrieval  
In addition to interactive search, the set of indexes is also applicable in a personalized retrieval setting.  ...  We use the authoring-driven process of video production as the leading principle for generic video indexing.  ... 
doi:10.1007/978-3-540-72895-5_8 fatcat:6ddzaktyxngubdy3pdpn4mif74

Extracting Semantics from Multimedia Content: Challenges and Solutions [chapter]

Lexing Xie, Rong Yan
2008 Signals and Communication Technology  
We start with an system overview with the five major components that extracts and uses semantic metadata: data annotation, multimedia ontology, feature representation, model learning and retrieval systems  ...  amounts of training data, and finally leveraging media semantics in retrieval systems.  ...  [42] described a joint text/image modeling approach for video retrieval that allows the full interaction between multi-modalities to result in a considerable performance improvement in TRECVID datasets  ... 
doi:10.1007/978-0-387-76569-3_2 fatcat:jul6fw7esfaurct6erjnvpcq6q


Filippo Chiarello, Elena Coli, Vito Giordano, Gualtiero Fantoni, Andrea Bonaccorsi
2021 Proceedings of the Design Society  
Firstly, we retrieve a corpus of scientific papers related to ED; then, we build two lexicons to recognize ED phases and data types; finally, we collect these entities within ED papers and map the relations  ...  between them.The methodology application allows the building of a network graph for visualizing the relations among data lexicon and ED lexicon.  ...  For this reason, we merged 4 publicly available lexicons: (1) the Machine Learning vocabulary developed by Google, (2) the Glossary of common Machine Learning, Statistics and Data Science terms by Analytics  ... 
doi:10.1017/pds.2021.82 fatcat:cuvj5xfwnnfxrmm43bc7r2cseq

Recent Advances and Challenges of Semantic Image/Video Search

Shih-Fu Chang, Wei-Ying Ma, Arnold Smeulders
2007 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07  
Such semantic indexing paradigm has been driven by the increasing availability of the large resources of corpora, novel labeling approaches, innovative image features, and machine learning techniques for  ...  Index Terms -semantic indexing, image and video search, content labeling, statistical modeling  ...  Many new ideas and results have been shown, culling knowledge from multi-modal content analysis, machine learning, information retrieval, and user interaction.  ... 
doi:10.1109/icassp.2007.367292 dblp:conf/icassp/ChangMS07 fatcat:wgnw233c4ndbtc5zrvrb4g5wqe

Interactive multi-user video retrieval systems

Marco Bertini, Alberto Del Bimbo, Andrea Ferracani, Lea Landucci, Daniele Pezzatini
2011 Multimedia tools and applications  
In this paper we present two interactive multi-user systems for video search and browsing.  ...  levels of responsiveness and interactivity typical of a desktop application.  ...  The framework The interactive multi-user video retrieval systems presented in this paper are part of a complex framework for management, annotation, browsing and retrieval of multimedia data.  ... 
doi:10.1007/s11042-011-0888-9 fatcat:jjujazyudbechkzojnkfp3i34e
« Previous Showing results 1 — 15 out of 3,846 results