Filters








87,364 Hits in 4.7 sec

Do batch and user evaluations give the same results?

William Hersh, Andrew Turpin, Susan Price, Benjamin Chan, Dale Kramer, Lynetta Sacherek, Daniel Olson
2000 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '00  
Our results showed the weighting scheme giving beneficial results in batch studies did not do so with real users.  ...  Do improvements in system performance demonstrated by batch evaluations conJbr the same benefit for real users? We carried out experiments designed to investigate this question.  ...  Discussion Our experiments show that batch and user searching experiments do not give the same results.  ... 
doi:10.1145/345508.345539 dblp:conf/sigir/HershTPCKSO00 fatcat:d6ybdwpfmjgbbkap5na7u3dtcy

Why batch and user evaluations do not give the same results

Andrew H. Turpin, William Hersh
2001 Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR '01  
Experiment 2 -Question Answering 0.228 66% 0.270 0.327 60% 0.354 Pre-batch MAP User QA Post-batch MAP Baseline Improved Results Summary Predicted Instance recall 81% 15% (p =  ...  Number top 10 relevant docs ignored Experiment 1 -Instance Recall 0.213 0.330 0.275 0.385 0.390 0.324 Pre-batch MAP User IR Post-batch MAP Baseline Improved 8 Q&A queries 1) What  ...  answers just as well with old technology • User interface effects?  ... 
doi:10.1145/383952.383992 dblp:conf/sigir/TurpinH01 fatcat:lkrxnm272jhirep64llbftaeqy

Refining Recency Search Results with User Click Feedback [article]

Taesup Moon and Wei Chu and Lihong Li and Zhaohui Zheng and Yi Chang
2011 arXiv   pre-print
In this paper, we focus on recency search and study a number of algorithms to improve ranking results by leveraging user click feedback. Our contributions are three-fold.  ...  Second, we propose a re-ranking approach to improve search results for recency queries using user clicks.  ...  Since the initial re-ranking function online(b,ws) is (almost) identical to the fixed one of batch(b), we can see from Figure 9 (a) that when the query appears around the 5th hour, batch(b) orders the  ... 
arXiv:1103.3735v1 fatcat:zt66pcsjxbhxzmhegfhbtbqkiq

Static query result caching revisited

Rifat Ozcan, Ismail Sengor Altingovde, Özgür Ulusoy
2008 Proceeding of the 17th international conference on World Wide Web - WWW '08  
Query result caching is an important mechanism for search engine efficiency. In this study, we first review several query features that are used to determine the contents of a static result cache.  ...  Experimental results show that this new feature achieves hit ratios better than those of the previously proposed features.  ...  It is static in the sense that the cache is populated by the selected queries in batch mode and it is not modified until the next batch update.  ... 
doi:10.1145/1367497.1367710 dblp:conf/www/OzcanAU08 fatcat:4j3fkiqninailmdeib3ozbolqe

Untangling Result List Refinement and Ranking Quality

Jiyin He, Marc Bron, Arjen de Vries, Leif Azzopardi, Maarten de Rijke
2015 Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR '15  
Traditional batch evaluation metrics assume that user interaction with search results is limited to scanning down a ranked list.  ...  We develop an evaluation framework that takes a step beyond the interaction assumption of traditional evaluation metrics and allows for batch evaluation of systems with and without RLR elements.  ...  underlying traditional batch-evaluation metrics do not apply.  ... 
doi:10.1145/2766462.2767740 dblp:conf/sigir/HeBVAR15 fatcat:gk4orwnuibdqvcg4qeucqln6gy

Personalize web search results with user's location

Yumao Lu, Fuchun Peng, Xing Wei, Benoit Dumoulin
2010 Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval - SIGIR '10  
Evaluation on commercial search engine shows significant improvement on search relevance and user experience.  ...  We build a probabilistic model to identify implicit local intent queries, and leverage user's physical location to improve Web search results for these queries.  ...  rate (CTR), two commonly used metrics to evaluate search engine relevance and user experience [1] .  ... 
doi:10.1145/1835449.1835604 dblp:conf/sigir/LuPWD10 fatcat:twvcgjlro5fxnhfdzwzzvk4yom

An Online Learning Framework for Refining Recency Search Results with User Click Feedback

Taesup Moon, Wei Chu, Lihong Li, Zhaohui Zheng, Yi Chang
2012 ACM Transactions on Information Systems  
Second, we propose an online learning approach that reranks and improves the search results for recency queries near real-time based on user clicks.  ...  In this article, we focus on recency search and study a number of algorithms to improve ranking results by leveraging user click feedback. Our contributions are threefold.  ...  To make our evaluation and online learning process closer to reality, we do not reveal user feedback c t,1 to the reranking algorithm immediately.  ... 
doi:10.1145/2382438.2382439 fatcat:plkomep2rfbdfmwuzo7rrxitii

Semantic ranking and result visualization for life sciences publications

Julia Stoyanovich, William Mee, Kenneth A. Ross
2010 2010 IEEE 26th International Conference on Data Engineering (ICDE 2010)  
Finally, we evaluate the effectiveness of our ranking with a user study. t∈T L * (t).  ...  We focus our attention on PubMed, the most significant bibliographic source in life sciences, and explore ways to use high-quality semantic annotations from the MeSH vocabulary to rank search results.  ...  Many queries return thousands of results, and we cannot expect that the users will evaluate the quality of results exhaustively.  ... 
doi:10.1109/icde.2010.5447931 dblp:conf/icde/StoyanovichMR10 fatcat:eemvntu7szfb5kx4b544wzrk24

EQUALIZATION OF RESULTS ACCOUNTING POLICIES

Florentina MOISESCU, Mihaela ONICA IBINCEANU, Paula-Viorica NICULITA, Luminita SUFLETEL
2014 Risk in Contemporary Economy  
Because national and international accounting standards give businesses the flexibility to choose between different policies, managers take advantage of existing loopholes and draw on creative accounting  ...  Deprecation policy, the policy related to inventory, policy provisions and related policy borrowing costs are some of the many other possibilities which affect the content of financial statements.  ...  and use the same fixed assets under the same conditions.  ... 
doaj:9320cde2ef0a42c9a3c7b8925a7c7497 fatcat:nzu4in7grvhi3ka32rqvreouu4

Scalable clustering of news search results

Srinivas Vadrevu, Choon Hui Teo, Suju Rajan, Kunal Punera, Byron Dom, Alexander J. Smola, Yi Chang, Zhaohui Zheng
2011 Proceedings of the fourth ACM international conference on Web search and data mining - WSDM '11  
The experimental results with large collections of news documents reveal that our system is both scalable and also achieves good accuracy in clustering the news search results.  ...  We present a system that clusters the search results of a news search system in a fast and scalable manner.  ...  The form of the measure that gives the bits per object to do this encoding is Q3.  ... 
doi:10.1145/1935826.1935918 dblp:conf/wsdm/VadrevuTRPDSCZ11 fatcat:wz6rd7osxjccdldyakftvw6azy

Partial results for online query processing

Vijayshankar Raman, Joseph M. Hellerstein
2002 Proceedings of the 2002 ACM SIGMOD international conference on Management of data - SIGMOD '02  
The user can watch these partial results accumulate at the user interface, and accordingly refine the query by specifying their interest in different kinds of partial results.  ...  Traditional query processors generate full, accurate query results, either in batch or in pipelined fashion.  ...  But they do not give out query results incrementally, and do not adapt to dynamic volatilities or user preference changes.  ... 
doi:10.1145/564720.564723 fatcat:ve6e4luzzvfn5igmfbux2okak4

Partial results for online query processing

Vijayshankar Raman, Joseph M. Hellerstein
2002 Proceedings of the 2002 ACM SIGMOD international conference on Management of data - SIGMOD '02  
The user can watch these partial results accumulate at the user interface, and accordingly refine the query by specifying their interest in different kinds of partial results.  ...  Traditional query processors generate full, accurate query results, either in batch or in pipelined fashion.  ...  But they do not give out query results incrementally, and do not adapt to dynamic volatilities or user preference changes.  ... 
doi:10.1145/564691.564723 dblp:conf/sigmod/RamanH02 fatcat:gkcfkefdbjaxte3dsbjp7qurlu

Joining the results of heterogeneous search engines

Daniele Braga, Alessandro Campi, Stefano Ceri, Alessandro Raffio
2008 Information Systems  
We present several algorithms for the efficient computation of join results under several cost model assumptions.  ...  The paper includes both the theoretical framework for stating such problem and the description of pragmatic solutions based on web service technology.  ...  Of course, results are presented to users in ''batches'', as with conventional search engines, and most batches will not be computed unless the user interacts with the system asking for ''more'' results  ... 
doi:10.1016/j.is.2008.01.009 fatcat:d4tizdbcvvewvm4cjarqggbgw4

Helping results assessment by adding explainable elements to the deep relevance matching model [article]

Ioannis Chios, Suzan Verberne
2021 arXiv   pre-print
We evaluate the proposed interface in an online user study, asking users to judge the explainability and assessability of the interface.  ...  The idea is that search engines that indicate to the user why results are retrieved are valued higher by users and gain user trust.  ...  (2) How do users judge the explainability and assessability of our explainable search engine result page compared to a regular result page?  ... 
arXiv:2106.05147v1 fatcat:ob2f7tpugjharcrmfyqljx4w24

Exploratory visual analysis of pharmacogenomic results

David M Reif, Scott M Dudek, Christian M Shaffer, Janey Wang, Jason H Moore
2005 Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing  
Here, we describe the motivations for developing EVA, detail the database and custom graphical user interface (GUI), provide an example of its application to a publicly available pharmacogenomic dataset  ...  A thorough exploration of experimental results requires both statistical and annotative information.  ...  Acknowledgments This work was supported by National Institutes of Health grants LM07613, HL68744, and AI59694. This work was also supported by generous funds from the Robert J.  ... 
pmid:15759635 fatcat:zcsmvohbxzfxxh2pewiqp7426e
« Previous Showing results 1 — 15 out of 87,364 results