340,394 Hits in 5.8 sec

How robust are multilingual information retrieval systems?

Thomas Mandl, Christa Womser-Hacker, Giorgio Di Nunzio, Nicola Ferro
2008 Proceedings of the 2008 ACM symposium on Applied computing - SAC '08  
Our analysis shows that a small decrease of performance of biand multi-lingual retrieval goes along with a tremendous difference between the geometric mean and the average of topics.  ...  The results of information retrieval evaluations are often difficult to apply to practical challenges.  ...  ROBUSTNESS IN INFORMATION RETRIEVAL EVALUATION The RIA workshop [7] on reliable information access investigated the performance of systems for difficult topics in detail.  ... 
doi:10.1145/1363686.1363949 dblp:conf/sac/MandlWNF08 fatcat:lpeokm4nfvbbbew2l3dqza5ng4

Current Developments in Information Retrieval Evaluation [chapter]

Thomas Mandl
2009 Lecture Notes in Computer Science  
Topic Difficulty and Topic Specific Treatment The evaluation of robust retrieval has been motivated by the fact that the variance for topics has been very large even for top performing systems.  ...  Evaluations based on the Cranfield paradigm requires basically topics as descriptions of information needs, a document collection, systems to compare, human jurors to judge the documents retrieved by the  ... 
doi:10.1007/978-3-642-00958-7_92 fatcat:iprijydqk5fzxoyuetsa6fimsy

Google's "I'm Feeling Lucky", Truly a Gamble? [chapter]

Roelof van Zwol, Herre van Oostendorp
2004 Lecture Notes in Computer Science  
Often when a retrieval system is developed the evaluation focuses either on the retrieval performance analysis of the retrieval strategy, or on the usability testing of the interface offered by the retrieval  ...  of retrieval systems.  ...  On the other hand retrieval performance experiments are used to measure the performance of the retrieval strategy implemented by the retrieval system in terms of recall and precision, irrespective of user  ... 
doi:10.1007/978-3-540-30480-7_39 fatcat:sqkddzzozrhkvhnlorb3zgg3uu

Moving More Quickly toward Full Term Relations in Information Space

Gregory B. Newby
1999 Text Retrieval Conference  
The paper describes an implementation of a multidimensional tree structure for retrieval from information space based on the kd-tree.  ...  This goal was achieved, but retrieval performance was not as good as for TREC7. System details for the AdHoc task, small Web task, and large Web (VLC) task are presented.  ...  The purpose of the TeraScale Retrieval project is to investigate problems of information retrieval through the development and evaluation of high-performance modular retrieval system components.  ... 
dblp:conf/trec/Newby99 fatcat:ir66y5gka5bcnmxh3wbzkxex4i

Semantic Retrieval of Web Documents using Topic Modeling Based Weighted Nearest Neighborhood Technique

Information retrieval systems are used to retrieve documents based on the keyword search.  ...  In this paper, a methodology based on topic modelling is proposed to determine the retrieval of information for user to increase the accuracy of documents using Latent Dirichlet Allocation (LDA) and Weighted  ...  This is based on LSI model, extraction of topic is one of the popular topic for retrieval of information.  ... 
doi:10.35940/ijitee.i7636.078919 fatcat:syavf4ztazcbpi2img32pd6j7q

Proactive Information Retrieval via Screen Surveillance

Tung Vuong, Giulio Jacucci, Tuukka Ruotsalo
2017 Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR '17  
Topic modeling is then applied to detect the user's topical activity context to retrieve information.  ...  We demonstrate a system that proactively retrieves information from a user's activity history being observed on the screen when the user is performing unseen activities on a personal computer.  ...  ACKNOWLEDGEMENTS is research was partially funded by TEKES (Re:Know) and the Academy of Finland (278090, 305739).  ... 
doi:10.1145/3077136.3084151 dblp:conf/sigir/TungJR17 fatcat:pxcimpbugvetdo3uaaaklsnnwy

NICTA i2d2 in GeoCLEF 2005

Baden Hughes
2005 Conference and Labs of the Evaluation Forum  
We review the design of our runs and the results of our submitted and subsequent experiments; and contribute a range of suggestions for future instantiations of a geospatial information retrieval track  ...  We present some background information about NICTA i2d2 project to motivate our involvement; describing our systems and experimental interests.  ...  Acknowledgements National ICT Australia is funded by the Australian Government's Department of Communications, Information Technology, and the Arts and the Australian Research Council through Backing Australia's  ... 
dblp:conf/clef/Hughes05 fatcat:snyytqixvjgzbio6jyl4ggwxue

The relative effectiveness of concept-based versus content-based video retrieval

Meng Yang, Barbara M. Wildemuth, Gary Marchionini
2004 Proceedings of the 12th annual ACM international conference on Multimedia - MULTIMEDIA '04  
The results have implications for topic/task analysis for video retrieval research, and also for the implementation of hybrid video retrieval systems.  ...  The hypothesis that the combined system would perform better than both the text-only and the features-only systems was not supported, and large topic effects were found.  ...  Figure 2 . 2 Recall, by system and topic type Table 1 . 1 Summary of performance, by system Precision Recall Mean s.d. Mean s.d.  ... 
doi:10.1145/1027527.1027613 dblp:conf/mm/YangWM04 fatcat:cujyigtny5dgtb2shp5ftbr3bm

跨語言資訊檢索中查詢問題特性於檢索效益之影響 Influences of Query Characteristics to Retrieval Performance in Cross-Language Information Retrieval

Kuang-Hua Chen, Tien-An Wu
2008 Journal of Educational Media & Library Sciences  
; fielded information did not show significant effects on retrieval performance but some fielded information performed better than others.  ...  The results concluded that only subject out of other textual characteristics demonstrated significant effects on retrieval performance; linguistic characteristics showed great impacts on retrieval performance  ...  , and fielded characteristics of topics on the retrieval performance for Cross-Language Information Retrieval.  ... 
doaj:e42bd14e9a654fe392a9ab91a64fbccd fatcat:bfs2t6mpsrbuhfeqpirmhghnoi

Linguistic and Statistical Analysis of the CLEF Topics [chapter]

Thomas Mandl, Christa Womser-Hacker
2003 Lecture Notes in Computer Science  
This paper reports on an analysis of the CLEF topics from the year 2001. We investigated especially potential correlations between features of the topics and the performance of retrieval systems.  ...  We found one correlation for the English topics. The more linguistic challenges the topic texts included, the better the performance of the systems.  ...  Topics in Information Retrieval Evaluation The topics in information retrieval evaluation should express an information need. The topics are always formulated in natural language.  ... 
doi:10.1007/978-3-540-45237-9_43 fatcat:jjlyxoopfzdktlmpcoblx7t5la

Toward a unified retrieval outcome analysis framework for cross-language information retrieval

Jiangping Chen
2006 Proceedings of the American Society for Information Science and Technology  
This paper proposes a Retrieval Outcome Analysis Framework, or ROA Framework, to systematically evaluate retrieval performance of Cross-Language Information Retrieval systems.  ...  The author believes the proposed framework would be especially useful for the development of real-world Cross-Language Information Retrieval systems because the evaluation guided by the framework has the  ...  Introduction Cross-Language Information Retrieval (CLIR) is a special case of Information Retrieval (IR).  ... 
doi:10.1002/meet.14504201106 fatcat:5ad4w4xffrdxhmsdgfujrhi75m

Hybrid XML Retrieval: Combining Information Retrieval and a Native XML Database

Jovan Pehcevski, James A. Thom, Anne-Marie Vercoustre
2005 Information retrieval (Boston)  
This paper investigates the impact of three approaches to XML retrieval: using Zettair, a full-text information retrieval system; using eXist, a native XML database; and using a hybrid system that takes  ...  and different choices of evaluation metrics) -- the XML retrieval systems exhibit varying behaviour and the best performance can be reached for different values of the retrieval parameters.  ...  Further, we thank Saied Tahaghoghi and the anonymous reviewers for providing useful comments on earlier drafts of this paper.  ... 
doi:10.1007/s10791-005-0748-1 fatcat:x4rwxiu3rndnrlozun2q6rcptm

INEX 2005 Multimedia Track [chapter]

Roelof van Zwol, Gabriella Kazai, Mounia Lalmas
2006 Lecture Notes in Computer Science  
In this first exploratory year the focus of the evaluation experiment was to test approaches for the retrieval of XML fragments using a combination of content-based text and image retrieval techniques.  ...  The track was successful in realizing its objective to provide a pilot evaluation platform for the evaluation of retrieval strategies for XML-based multimedia documents.  ...  Precision@10 reflects on the ability of a system to retrieve relevant elements in the top 10 positions of the ranking. For this measure, rmit has best performance, followed by qutau and utwente.  ... 
doi:10.1007/978-3-540-34963-1_38 fatcat:ug7jzl5bxbcgzgmdu5rvduyb7i

Do Hard Topics Exist? A Statistical Analysis

J. Shane Culpepper, Guglielmo Faggioli, Nicola Ferro, Oren Kurland
2021 Italian Information Retrieval Workshop  
However, all of these previous studies assume that a topic or information need is represented by a single query. In reality, users routinely reformulate queries to satisfy an information need.  ...  Several recent studies have explored the interaction effects between topics, systems, corpora, and components when measuring retrieval effectiveness.  ...  The distinction between a topic (information need) and a query can have a profound impact on the effectiveness of retrieval, as well as how IR researchers typically categorize and compare system performance  ... 
dblp:conf/iir/CulpepperF0K21 fatcat:gwr3dluvzjbejl3nwvcjrssq5e

An analysis of query difficulty for information retrieval in the medical domain

Lorraine Goeuriot, Liadh Kelly, Johannes Leveling
2014 Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval - SIGIR '14  
We present a post-hoc analysis of a benchmarking activity for information retrieval (IR) in the medical domain to determine if performance for queries with different levels of complexity can be associated  ...  We then show how query complexity affects performance of runs submitted to the lab, and provide suggestions for improving retrieval quality for this complex retrieval task and similar IR evaluation tasks  ...  Overall, and unsurprisingly, retrieval performance is affected by query complexity. Use of rich retrieval approaches lessens this effect.  ... 
doi:10.1145/2600428.2609496 dblp:conf/sigir/GoeuriotKL14 fatcat:mdkrskou2jehtl7sg5or5dhqva
« Previous Showing results 1 — 15 out of 340,394 results