A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
Filters
Standard Deviation as a Query Hardness Estimator
[chapter]
2010
Lecture Notes in Computer Science
Preserved Fulltext
In this paper a new Query Performance Prediction method is introduced. This method is based on the hypothesis that different score distributions appear for 'hard' and 'easy' queries. ...
We have applied some variants of the classic standard deviation and have studied methods to find out the most suitable size of the ranking list for these measures. ...
best size k for all topics (100 for TREC 4 & 5 and 1000 for GOV2); (σ max ) the maximum standard deviation; and (σ k ) the standard deviation at a specific size k for each query, using the automatic method ...
doi:10.1007/978-3-642-16321-0_21
fatcat:ozk64jwb2vfffk4esyr7trllra
Predicting Query Performance by Query-Drift Estimation
[chapter]
2009
Lecture Notes in Computer Science
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
We argue that query-drift can potentially be estimated by measuring the diversity (e.g., standard deviation) of the retrieval scores of these documents. ...
Predicting query performance, that is, the effectiveness of a search performed in response to a query, is a highly important and challenging problem. ...
Summary We presented a novel approach to predicting query performance that is based on estimating the potential amount of query drift in the list of top-retrieved documents using the standard deviation ...
doi:10.1007/978-3-642-04417-5_30
fatcat:7fkrswosrbhizfifpgwzjkmyl4
Predicting Query Performance by Query-Drift Estimation
2012
ACM Transactions on Information Systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
We argue that query-drift can potentially be estimated by measuring the diversity (e.g., standard deviation) of the retrieval scores of these documents. ...
Predicting query performance, that is, the effectiveness of a search performed in response to a query, is a highly important and challenging problem. ...
Summary We presented a novel approach to predicting query performance that is based on estimating the potential amount of query drift in the list of top-retrieved documents using the standard deviation ...
doi:10.1145/2180868.2180873
fatcat:sickq2o4ufhyzhhafoiv5ccqni
Wikipedia-based query performance prediction
2014
Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval - SIGIR '14
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2016; you can also visit the original URL.
The file type is application/pdf.
The query-performance prediction task is to estimate retrieval effectiveness with no relevance judgments. Pre-retrieval prediction methods operate prior to retrieval time. ...
Hence, these predictors are often based on analyzing the query and the corpus upon which retrieval is performed. ...
The average and standard deviation of the percentages over all the sets that correspond to the different sub-queries in S1 serve for prediction. ...
doi:10.1145/2600428.2609553
dblp:conf/sigir/KatzSKSR14
fatcat:6kxrzznidzhmbiwvmcxzzmooze
Predicting query performance in microblog retrieval
2014
Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval - SIGIR '14
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
Query Performance Prediction (QPP) is the estimation of the retrieval success for a query, without explicit knowledge about relevant documents. ...
Theoretically, a good predictor would allow to selectively apply PRF-based AQE when performance of the initial result set is good enough, thus enhancing the overall robustness of the system. ...
Moreover, they also proposed a variability measure relying on the standard deviations of TFIDF scores for the query terms. ...
doi:10.1145/2600428.2609540
dblp:conf/sigir/PerezJ14
fatcat:x762ayb2nbfudku7dvo2w4ka6u
Measuring ranked list robustness for query performance prediction
2007
Knowledge and Information Systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
Our initial motivation for measuring ranking robustness is to predict topic difficulty for content-based queries in the ad-hoc retrieval task. ...
Though our focus is on prediction under the ad-hoc retrieval task, we observe an interesting negative correlation with query performance when our technique is applied to named-page finding queries which ...
He and Ounis [10] proposed a predictor based on the standard deviation of the IDF of the query terms. ...
doi:10.1007/s10115-007-0100-8
fatcat:a3wpp4hv7fbkzozkkksq5cnjxy
Ranking robustness
2006
Proceedings of the 15th ACM international conference on Information and knowledge management - CIKM '06
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
We compare the robustness score with the clarity score method which is the state-of-the-art technique for query performance prediction. ...
We find that the clarity score is barely correlated with query performance on the GOV2 collection while the correlation between the robustness score and query performance remains significant. ...
He and Ounis [6] proposed a predictor based on the standard deviation of the IDF of the query terms. ...
doi:10.1145/1183614.1183696
dblp:conf/cikm/ZhouC06
fatcat:feavtrzshjbbxjttxuwbkqld5q
Query performance prediction for IR
2012
Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '12
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2016; you can also visit the original URL.
The file type is application/pdf.
Additional predictors that analyze the retrieval scores distribution Computing the standard deviation of retrieval scores at a querydependent cutoff Suppose that we have a true model of relevance, , for ...
How difficult is the performance prediction task
for human experts? ...
Results were moderate, probably due to the sparseness of the training data, which over-represents the lower end of the performance values We discussed three frameworks for query-performance prediction ...
doi:10.1145/2348283.2348540
dblp:conf/sigir/CarmelK12
fatcat:ppzmf3ihkzbrje4ny33h6elave
Query-Performance Prediction Using Minimal Relevance Feedback
2013
Proceedings of the 2013 Conference on the Theory of Information Retrieval - ICTIR '13
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
There has been much work on devising query-performance prediction approaches that estimate search effectiveness without relevance judgments (i.e., zero feedback). ...
This novel form of prediction is based on quantifying properties of relevant documents that can attest to query performance. ...
ACKNOWLEDGMENTS We thank the reviewers for their comments. Part of the work reported here was done while David Carmel was at IBM and Olga Butman was at the Technion. ...
doi:10.1145/2499178.2499201
dblp:conf/ictir/ButmanSKC13
fatcat:g7bbui2ehzau7map53oaexxx7e
Query-performance prediction and cluster ranking
2012
Proceedings of the 21st ACM international conference on Information and knowledge management - CIKM '12
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2016; you can also visit the original URL.
The file type is application/pdf.
The first is query-performance prediction; i.e., estimating the effectiveness of a search performed in response to a query in the absence of relevance judgments. ...
Finally, we empirically demonstrate that using insights gained in work on query-performance prediction can help, in many cases, to improve the performance of a previously proposed cluster ranking method ...
The query performance prediction (QPP) task [3] is estimating the effectiveness of D res using some clustering algorithm. ...
doi:10.1145/2396761.2398666
dblp:conf/cikm/KurlandRS12
fatcat:mcoc43qfjnaq5p2sqzrbajnmfe
Query performance prediction for microblog search
2014
Proceedings of the first international workshop on Social media retrieval and analysis - SoMeRA '14
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
the need for re-visiting the problem in that context. ...
In this work, we re-examined several state-of-the-art query performance predictors in the domain of microblog ad-hoc search using the two most-commonly used tweets collections with three different retrieval ...
However, the system can attempt to improve retrieval performance for poorly-performing queries if it can accurately-enough estimate the performance of queries in advance. ...
doi:10.1145/2632188.2632210
dblp:conf/sigir/HasanainME14
fatcat:6tysftjp6bhu5ky5pq5reunixq
Robust Cardinality: a novel approach for cardinality prediction in SQL queries
2021
Journal of the Brazilian Computer Society
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
With Robust Cardinality, a lower estimation error of a batch of queries was obtained and PostgreSQL executed these queries more efficiently than when using the default estimator. ...
Results We perform experimental tests using PostgreSQL, comparing both estimators and a modern technique proposed in the literature. ...
PostgreSQL histogram and Robust Cardinality show similar mean and standard deviation metrics, but Robust Cardinality presents lower 90% percentile. ...
doi:10.1186/s13173-021-00115-9
fatcat:at3eo3di2jekroncppzzbvxore
Distributionally Robust Multi-Output Regression Ranking
[article]
2021
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
We show that DRMRR is not only able to achieve significantly better performance than other baselines, but it can maintain a relatively stable performance as more noise is added to the data. ...
Our experiments were conducted on two real-world applications, medical document retrieval, and drug response prediction, showing that DRMRR notably outperforms state-of-the-art LTR models. ...
The values inside the parentheses denote the Standard Deviation (SD) of the corresponding metrics. Bold numbers indicate the best performance among all methods for each metric. ...
arXiv:2109.12803v1
fatcat:exotrmtb2vfpjpnpe5f7wdqxne
Using Query Performance Predictors to Reduce Spoken Queries
[chapter]
2017
Lecture Notes in Computer Science
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
The goal of query performance prediction is to estimate a query's retrieval effectiveness without user feedback. ...
Past research has investigated the usefulness of query performance predictors for the task of reducing verbose textual queries. ...
We included three NQC scores: the standard deviation of the top document scores, the standard deviation of the scores above the mean top-document score, and the standard deviation of the scores below the ...
doi:10.1007/978-3-319-56608-5_3
fatcat:tiwpjztv3zbubms4dhbzf3gqxy
Selecting service providers from noisy reputations
2003
Proceedings of the second international joint conference on Autonomous agents and multiagent systems - AAMAS '03
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
For selecting a service provider an user agent queries other user agents for their high/low rating of different service providers. ...
We evaluate the robustness of this reputation-based trusting mechanism over varying environmental parameters like percentage of liars, performance difference and variances for high and lowperforming agents ...
With increasing standard deviation performance decreased for reasons stated as above. ...
doi:10.1145/860722.860822
fatcat:o3eoiuqlfjc3tdg4mfrd5qwbqa
« Previous
Showing results 1 — 15 out of 43,295 results