Filters








42,267 Hits in 5.2 sec

On judgments obtained from a commercial search engine

Emine Yilmaz, Gabriella Kazai, Nick Craswell, Saied Mehrizi Tahaghoghi
2012 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '12  
Numerous papers have been published using judgments obtained from a commercial search engine by researchers in industry.  ...  In this paper, we analyze the reliability of such judgments for evaluating the quality of retrieval systems by comparing them to judgments by NIST judges at TREC.  ...  In recent years, several papers using judgments obtained from a commercial search engine have been published [2] .  ... 
doi:10.1145/2348283.2348496 dblp:conf/sigir/YilmazKCT12 fatcat:ed5dzgcqvndazdp2ugmzirgbhq

Relevance dimensions in preference-based IR evaluation

Jinyoung Kim, Gabriella Kazai, Imed Zitouni
2013 Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '13  
We run a series of experiments and collect preference judgments over different relevance dimensions in sideby-side comparisons of two search result lists, as well as relevance judgments for the individual  ...  For example, one result list may be preferred over another if it has a more diverse set of relevant results, covering a wider range of user intents.  ...  We employ professional judges and obtain preference judgments for 523 queries extracted from a commercial search engine's query logs.  ... 
doi:10.1145/2484028.2484168 dblp:conf/sigir/KimKZ13 fatcat:5pxtfbvpire5nh7vxz2zu6g5e4

Ophthalmology on the Internet

Alon Kahana
2004 Archives of Ophthalmology  
A common way to access Internet information is through commercial portals with proprietary search engines. Often these search engines prioritize their rank list based on commercial interests.  ...  We evaluated whether Internet searches of ophthalmic issues are slanted toward commercial sites and whether any differences exist among the various search engines.  ...  How-ever, commercial sites did occupy the top spots on the google list. The high position of commercial sites in the search results obtained by some search engines is not coincidental.  ... 
doi:10.1001/archopht.122.3.380 pmid:15006856 fatcat:fl6i3uz6lrbwnhuj2u4x4344zm

Measuring search-engine quality and query difficulty: Ranking with target and freestyle

Robert M. Losee, Lee Anne H. Paris
1999 Journal of the American Society for Information Science  
difficulty associated with retrieving documents with a given query or on a given topic.  ...  The performance of the Target and Freestyle search engines is examined and is very good.  ...  While this statement may be a bit strong, there is little difference between the two commercial search engines in terms of performance, despite commercial pressures to develop a better search engine, and  ... 
doi:10.1002/(sici)1097-4571(1999)50:10<882::aid-asi5>3.0.co;2-6 fatcat:ujy7du24uzg6hnhledpyuqmika

Prediction of relevant biomedical documents: a human microbiome case study

Paul Thompson, Juliette C. Madan, Jason H. Moore
2015 BioData Mining  
This study explores the use of the searcher's relevance feedback judgments to support relevance ranking based on features more general than recency.  ...  A query to a biomedical retrieval system often retrieves hundreds of results. Since the searcher will not likely consider all of these documents, ranking the documents is important.  ...  We also acknowledge funding support for this research from NIH grants LM009012 and LM010098.  ... 
doi:10.1186/s13040-015-0061-5 pmid:26361503 pmcid:PMC4564977 fatcat:rlm5amsgqvcx5jwjdwxwp7olz4

Using Context to Improve the Evaluation of Information Retrieval Systems [article]

Abdelkrim Bouramoul, Mohamed-Khireddine Kholladi, Bich-Lien Doan
2011 arXiv   pre-print
The relevance evaluation of results provided by these engines, using the user's judgments, then using an automatic manner to take into account the query context has also shown a general decline in the  ...  Therefore, we believe that the exploitation of contextual elements could be a very good way to evaluate the search tools.  ...  We have implemented a parser for each search engine because the html tags are different from one engine to another. The extracted content is sent for analysis.  ... 
arXiv:1105.6213v1 fatcat:nqbqrkjb2bfbxgksuwac5mtvfa

Quality-biased ranking for queries with commercial intent

Alexander Shishkin, Polina Zhinalieva, Kirill Nikolaev
2013 Proceedings of the 22nd International Conference on World Wide Web - WWW '13 Companion  
Modern search engines are good enough to answer popular commercial queries with mainly highly relevant documents.  ...  Thus search engines face the challenge of ranking results that are equally relevant from the perspective of the traditional relevance grading approach.  ...  for search engine results.  ... 
doi:10.1145/2487788.2488137 dblp:conf/www/ShishkinZN13 fatcat:kya7hxe3wncq3i577kit2yyhya

Assessment of the Quality of Internet-Based Health Information in the Indonesian Language about Polycystic Ovarian Syndrome

Andon Hestiantoro, Danang T. Pamungkas
2020 Indonesian Journal of Obstetrics and Gynecology  
The non-commercial website had better information quality (p=0.01).Conclusion: Criteria affecting health information quality on the internet were as follows: found at the top two pages on a search engine  ...  Objectives: To investigate health information quality about PCOS on the internet in Indonesian language.Methods: Top website from two separate search engines (Google and Bing) was collected using the keyword  ...  In addition, patient information from offi cial organizations, such as WHO, usually does not appear on the fi rst page of a search engine. 17 Indonesia is one of the countries with the most internet  ... 
doi:10.32771/inajog.v8i4.1338 fatcat:oylecrsc7fbl3jeblqgaud4ilm

Personalize web search results with user's location

Yumao Lu, Fuchun Peng, Xing Wei, Benoit Dumoulin
2010 Proceeding of the 33rd international ACM SIGIR conference on Research and development in information retrieval - SIGIR '10  
Evaluation on commercial search engine shows significant improvement on search relevance and user experience.  ...  We build a probabilistic model to identify implicit local intent queries, and leverage user's physical location to improve Web search results for these queries.  ...  The baseline is one of the top commercial search engines. We can see from Table 1 personalized Web search results dramatically improved search relevance.  ... 
doi:10.1145/1835449.1835604 dblp:conf/sigir/LuPWD10 fatcat:twvcgjlro5fxnhfdzwzzvk4yom

Analyzing the content emphasis of web search engines

Mohammed A. Alam, Doug Downey
2014 Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval - SIGIR '14  
Millions of people search the Web each day. As a consequence, the ranking algorithms employed by Web search engines have a profound influence on which pages users visit.  ...  We present PAWS, a platform for analyzing differences among Web search engines.  ...  INTRODUCTION Web search engines are invaluable tools. Many Web sessions begin with a query to a search engine [10] .  ... 
doi:10.1145/2600428.2609515 dblp:conf/sigir/AlamD14 fatcat:4utnru2hivd2vahi5letp5umz4

Results and challenges in Web search evaluation

David Hawking, Nick Craswell, Paul Thistlewaite, Donna Harman
1999 Computer Networks  
These suggest that the standard of document rankings produced by public Web search engines is by no means state-of-the-art.  ...  A frozen 18.5 million page snapshot of part of the Web has been created to enable and encourage meaningful and reproducible evaluation of Web search systems and techniques.  ...  donating a considerable amount of his time and expertise in converting tape formats.  ... 
doi:10.1016/s1389-1286(99)00024-9 fatcat:2efk3tthozhhhb35ejvhki5t5i

Diversifying search results

Rakesh Agrawal, Sreenivas Gollapudi, Alan Halverson, Samuel Ieong
2009 Proceedings of the Second ACM International Conference on Web Search and Data Mining - WSDM '09  
We demonstrate empirically that our algorithm scores higher in these generalized metrics compared to results produced by commercial search engines.  ...  We study the problem of answering ambiguous web queries in a setting where there exists a taxonomy of information, and that both queries and documents may belong to more than one category according to  ...  This is very rare for results from the commercial search engines (< 10%), but present a problem for IA-Select.  ... 
doi:10.1145/1498759.1498766 dblp:conf/wsdm/AgrawalGHI09 fatcat:j62yaufvcjgulpe6dspupn7m7y

Questions vs. Queries in Informational Search Tasks

Ryen W. White, Matthew Richardson, Wen-tau Yih
2015 Proceedings of the 24th International Conference on World Wide Web - WWW '15 Companion  
As part of building better search engines, it is important to understand the nature and prevalence of these intentions, and the impact of this increase on search engine performance.  ...  In this work, we show that while 10.3% of queries issued to a search engine have direct question intent, only 3.2% of them are formulated as natural language questions.  ...  QUESTION PREVALENCE To better understand the importance of answering questions submitted to search engines, we computed their prevalence in the logs of a commercial search engine.  ... 
doi:10.1145/2740908.2742769 dblp:conf/www/WhiteRY15 fatcat:h4oahjdzpfg7xn6unkjyofl4mq

Social annotations

Patrick Pantel, Michael Gamon, Omar Alonso, Kevin Haas
2012 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '12  
Social features are increasingly integrated within the search results page of the main commercial search engines.  ...  Through the user study we gain insights on conditions under which social annotations are most useful to a user.  ...  months of real-world queries issued to a commercial search engine.  ... 
doi:10.1145/2348283.2348324 dblp:conf/sigir/PantelGAH12 fatcat:jwfj5tfskvc2pbedxmxoiq5owi

Exploring Cost-Effective Approaches to Human Evaluation of Search Engine Relevance [chapter]

Kamal Ali, Chi-Chao Chang, Yunfang Juan
2005 Lecture Notes in Computer Science  
Correlation analysis of the data obtained from actual tests using a subset of the methods in the framework suggest that these methods measure different aspects of the search engine.  ...  In this paper, we examine novel and less expensive methods for search engine evaluation that do not rely on document relevance judgments.  ...  and the editorial team for hundreds of hours of work on judging search results.  ... 
doi:10.1007/978-3-540-31865-1_26 fatcat:ndvl2jjehvabpj2lqfte7xfv7y
« Previous Showing results 1 — 15 out of 42,267 results