Filters








43,295 Hits in 4.6 sec

Standard Deviation as a Query Hardness Estimator [chapter]

Joaquín Pérez-Iglesias, Lourdes Araujo
2010 Lecture Notes in Computer Science  
In this paper a new Query Performance Prediction method is introduced. This method is based on the hypothesis that different score distributions appear for 'hard' and 'easy' queries.  ...  We have applied some variants of the classic standard deviation and have studied methods to find out the most suitable size of the ranking list for these measures.  ...  best size k for all topics (100 for TREC 4 & 5 and 1000 for GOV2); (σ max ) the maximum standard deviation; and (σ k ) the standard deviation at a specific size k for each query, using the automatic method  ... 
doi:10.1007/978-3-642-16321-0_21 fatcat:ozk64jwb2vfffk4esyr7trllra

Predicting Query Performance by Query-Drift Estimation [chapter]

Anna Shtok, Oren Kurland, David Carmel
2009 Lecture Notes in Computer Science  
We argue that query-drift can potentially be estimated by measuring the diversity (e.g., standard deviation) of the retrieval scores of these documents.  ...  Predicting query performance, that is, the effectiveness of a search performed in response to a query, is a highly important and challenging problem.  ...  Summary We presented a novel approach to predicting query performance that is based on estimating the potential amount of query drift in the list of top-retrieved documents using the standard deviation  ... 
doi:10.1007/978-3-642-04417-5_30 fatcat:7fkrswosrbhizfifpgwzjkmyl4

Predicting Query Performance by Query-Drift Estimation

Anna Shtok, Oren Kurland, David Carmel, Fiana Raiber, Gad Markovits
2012 ACM Transactions on Information Systems  
We argue that query-drift can potentially be estimated by measuring the diversity (e.g., standard deviation) of the retrieval scores of these documents.  ...  Predicting query performance, that is, the effectiveness of a search performed in response to a query, is a highly important and challenging problem.  ...  Summary We presented a novel approach to predicting query performance that is based on estimating the potential amount of query drift in the list of top-retrieved documents using the standard deviation  ... 
doi:10.1145/2180868.2180873 fatcat:sickq2o4ufhyzhhafoiv5ccqni

Wikipedia-based query performance prediction

Gilad Katz, Anna Shtock, Oren Kurland, Bracha Shapira, Lior Rokach
2014 Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval - SIGIR '14  
The query-performance prediction task is to estimate retrieval effectiveness with no relevance judgments. Pre-retrieval prediction methods operate prior to retrieval time.  ...  Hence, these predictors are often based on analyzing the query and the corpus upon which retrieval is performed.  ...  The average and standard deviation of the percentages over all the sets that correspond to the different sub-queries in S1 serve for prediction.  ... 
doi:10.1145/2600428.2609553 dblp:conf/sigir/KatzSKSR14 fatcat:6kxrzznidzhmbiwvmcxzzmooze

Predicting query performance in microblog retrieval

Jesus A. Rodriguez Perez, Joemon M. Jose
2014 Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval - SIGIR '14  
Query Performance Prediction (QPP) is the estimation of the retrieval success for a query, without explicit knowledge about relevant documents.  ...  Theoretically, a good predictor would allow to selectively apply PRF-based AQE when performance of the initial result set is good enough, thus enhancing the overall robustness of the system.  ...  Moreover, they also proposed a variability measure relying on the standard deviations of TFIDF scores for the query terms.  ... 
doi:10.1145/2600428.2609540 dblp:conf/sigir/PerezJ14 fatcat:x762ayb2nbfudku7dvo2w4ka6u

Measuring ranked list robustness for query performance prediction

Yun Zhou, W. Bruce Croft
2007 Knowledge and Information Systems  
Our initial motivation for measuring ranking robustness is to predict topic difficulty for content-based queries in the ad-hoc retrieval task.  ...  Though our focus is on prediction under the ad-hoc retrieval task, we observe an interesting negative correlation with query performance when our technique is applied to named-page finding queries which  ...  He and Ounis [10] proposed a predictor based on the standard deviation of the IDF of the query terms.  ... 
doi:10.1007/s10115-007-0100-8 fatcat:a3wpp4hv7fbkzozkkksq5cnjxy

Ranking robustness

Yun Zhou, W. Bruce Croft
2006 Proceedings of the 15th ACM international conference on Information and knowledge management - CIKM '06  
We compare the robustness score with the clarity score method which is the state-of-the-art technique for query performance prediction.  ...  We find that the clarity score is barely correlated with query performance on the GOV2 collection while the correlation between the robustness score and query performance remains significant.  ...  He and Ounis [6] proposed a predictor based on the standard deviation of the IDF of the query terms.  ... 
doi:10.1145/1183614.1183696 dblp:conf/cikm/ZhouC06 fatcat:feavtrzshjbbxjttxuwbkqld5q

Query performance prediction for IR

David Carmel, Oren Kurland
2012 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '12  
Additional predictors that analyze the retrieval scores distribution Computing the standard deviation of retrieval scores at a querydependent cutoff Suppose that we have a true model of relevance, , for  ...  How difficult is the performance prediction task for human experts?  ...  Results were moderate, probably due to the sparseness of the training data, which over-represents the lower end of the performance values We discussed three frameworks for query-performance prediction  ... 
doi:10.1145/2348283.2348540 dblp:conf/sigir/CarmelK12 fatcat:ppzmf3ihkzbrje4ny33h6elave

Query-Performance Prediction Using Minimal Relevance Feedback

Olga Butman, Anna Shtok, Oren Kurland, David Carmel
2013 Proceedings of the 2013 Conference on the Theory of Information Retrieval - ICTIR '13  
There has been much work on devising query-performance prediction approaches that estimate search effectiveness without relevance judgments (i.e., zero feedback).  ...  This novel form of prediction is based on quantifying properties of relevant documents that can attest to query performance.  ...  ACKNOWLEDGMENTS We thank the reviewers for their comments. Part of the work reported here was done while David Carmel was at IBM and Olga Butman was at the Technion.  ... 
doi:10.1145/2499178.2499201 dblp:conf/ictir/ButmanSKC13 fatcat:g7bbui2ehzau7map53oaexxx7e

Query-performance prediction and cluster ranking

Oren Kurland, Fiana Raiber, Anna Shtok
2012 Proceedings of the 21st ACM international conference on Information and knowledge management - CIKM '12  
The first is query-performance prediction; i.e., estimating the effectiveness of a search performed in response to a query in the absence of relevance judgments.  ...  Finally, we empirically demonstrate that using insights gained in work on query-performance prediction can help, in many cases, to improve the performance of a previously proposed cluster ranking method  ...  The query performance prediction (QPP) task [3] is estimating the effectiveness of D res using some clustering algorithm.  ... 
doi:10.1145/2396761.2398666 dblp:conf/cikm/KurlandRS12 fatcat:mcoc43qfjnaq5p2sqzrbajnmfe

Query performance prediction for microblog search

Maram Hasanain, Rana Malhas, Tamer Elsayed
2014 Proceedings of the first international workshop on Social media retrieval and analysis - SoMeRA '14  
the need for re-visiting the problem in that context.  ...  In this work, we re-examined several state-of-the-art query performance predictors in the domain of microblog ad-hoc search using the two most-commonly used tweets collections with three different retrieval  ...  However, the system can attempt to improve retrieval performance for poorly-performing queries if it can accurately-enough estimate the performance of queries in advance.  ... 
doi:10.1145/2632188.2632210 dblp:conf/sigir/HasanainME14 fatcat:6tysftjp6bhu5ky5pq5reunixq

Robust Cardinality: a novel approach for cardinality prediction in SQL queries

Francisco D. B. S. Praciano, Paulo R. P. Amora, Italo C. Abreu, Francisco L. F. Pereira, Javam C. Machado
2021 Journal of the Brazilian Computer Society  
With Robust Cardinality, a lower estimation error of a batch of queries was obtained and PostgreSQL executed these queries more efficiently than when using the default estimator.  ...  Results We perform experimental tests using PostgreSQL, comparing both estimators and a modern technique proposed in the literature.  ...  PostgreSQL histogram and Robust Cardinality show similar mean and standard deviation metrics, but Robust Cardinality presents lower 90% percentile.  ... 
doi:10.1186/s13173-021-00115-9 fatcat:at3eo3di2jekroncppzzbvxore

Distributionally Robust Multi-Output Regression Ranking [article]

Shahabeddin Sotudian, Ruidi Chen, Ioannis Paschalidis
2021 arXiv   pre-print
We show that DRMRR is not only able to achieve significantly better performance than other baselines, but it can maintain a relatively stable performance as more noise is added to the data.  ...  Our experiments were conducted on two real-world applications, medical document retrieval, and drug response prediction, showing that DRMRR notably outperforms state-of-the-art LTR models.  ...  The values inside the parentheses denote the Standard Deviation (SD) of the corresponding metrics. Bold numbers indicate the best performance among all methods for each metric.  ... 
arXiv:2109.12803v1 fatcat:exotrmtb2vfpjpnpe5f7wdqxne

Using Query Performance Predictors to Reduce Spoken Queries [chapter]

Jaime Arguello, Sandeep Avula, Fernando Diaz
2017 Lecture Notes in Computer Science  
The goal of query performance prediction is to estimate a query's retrieval effectiveness without user feedback.  ...  Past research has investigated the usefulness of query performance predictors for the task of reducing verbose textual queries.  ...  We included three NQC scores: the standard deviation of the top document scores, the standard deviation of the scores above the mean top-document score, and the standard deviation of the scores below the  ... 
doi:10.1007/978-3-319-56608-5_3 fatcat:tiwpjztv3zbubms4dhbzf3gqxy

Selecting service providers from noisy reputations

Sandip Sen, Neelima Sajja
2003 Proceedings of the second international joint conference on Autonomous agents and multiagent systems - AAMAS '03  
For selecting a service provider an user agent queries other user agents for their high/low rating of different service providers.  ...  We evaluate the robustness of this reputation-based trusting mechanism over varying environmental parameters like percentage of liars, performance difference and variances for high and lowperforming agents  ...  With increasing standard deviation performance decreased for reasons stated as above.  ... 
doi:10.1145/860722.860822 fatcat:o3eoiuqlfjc3tdg4mfrd5qwbqa
« Previous Showing results 1 — 15 out of 43,295 results