78 Hits in 8.1 sec

York University at TREC 2012: CrowdSourcing Track

Qinmin Hu, Zhi Xu, Xanghi Huang, Zheng Ye
2012 Text Retrieval Conference  
(3) How to make use the crowdsourcing information in the IR systems?  ...  The objective of this work is to address the challenges in managing and analyzing crowdsourcing in the information retrieval field.  ...  Introduction This is the first year that our York University group participates in the TREC 2012 CrowdSourcing Track. We focus on the text relevance assessing task (TRAT).  ... 
dblp:conf/trec/HuXHY12 fatcat:hndxl6ou7zbqfd2trjjemzh4wu

Overview of the TREC 2012 Crowdsourcing Track

Mark D. Smucker, Gabriella Kazai, Matthew Lease
2012 Text Retrieval Conference  
In 2012, the Crowdsourcing track had two separate tasks: a text relevance assessing task (TRAT) and an image relevance assessing task (IRAT).  ...  This track overview describes the track and provides analysis of the track's results.  ...  Special thanks to Bart Thomee at Yahoo! Research who is one of the organizers of ImageCLEF 2012 and who has been instrumental in preparing the Flickr topics and image sets for use in the IRAT.  ... 
dblp:conf/trec/SmuckerKL12 fatcat:dla4gzpemjfarogxo3herjt7sm

News vertical search using user-generated content

Richard McCreadie
2012 SIGIR Forum  
Figure 5 .2 illustrates this process for the New York Times homepage on the 10th of January 2012.  ...  The Microblog track at TREC was proposed in 2011 to investigate real-time ad hoc search, however, research in the field is still in its infancy.  ...  Appendix B Worker Instructions for Crowdsourcing In this appendix, we provide screenshots of the instructions provided to each worker for the crowd- Appendix C Features for News Query Classification  ... 
doi:10.1145/2492189.2492202 fatcat:wuha3gotmnffnbqhrdltooys5m

Reports on the 2012 AAAI Fall Symposium Series

Rezarta Islamaj Dogan, Yolanda Gil, Haym Hirsh, Narayanan C. Krishnan, Michael Lewis, Cetin Mericli, Parisa Rashidi, Victor Raskin, Samarth Swarup, Wei Sun, Julia M. Taylor, Lana Yeganova
2012 The AI Magazine  
The Association for the Advancement of Artificial Intelligence was pleased to present the 2012 Fall Symposium Series, held Friday through Sunday, November 2–4, at the Westin Arlington Gateway in Arlington  ...  The speakers discussed BioCreative, the TREC medical records track, and the BioASQ challenges.  ...  Susan Epstein of City University of New York presented a novel clustering algorithm and its application to protein discovery.  ... 
doi:10.1609/aimag.v34i1.2457 fatcat:enmcwpyeiravdnzmc7gj7g77kq

Personalization of search results using interaction behaviors in search sessions

Chang Liu, Nicholas J. Belkin, Michael J. Cole
2012 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '12  
Thanks to Si Sun for assistance in TREC 2011 Session Track. Thanks to Jingjing Liu for validating task classification as the third coder.  ...  We thank all of the members of the Personalization of the Digital Library Experience (PoODLE) research team at Rutgers University, without whose efforts this work could not have been accomplished.  ...  reduced enrollment of international students at universities in the US".  ... 
doi:10.1145/2348283.2348314 dblp:conf/sigir/LiuBC12 fatcat:jfo7wtrg5vg3lp7iv5exee67je

Towards optimum query segmentation

Matthias Hagen, Martin Potthast, Anna Beyer, Benno Stein
2012 Proceedings of the 21st ACM international conference on Information and knowledge management - CIKM '12  
To draw a complete picture, we also evaluate the impact of segmentation strategies on retrieval performance in a TREC setting.  ...  Query segmentation is the problem of identifying those keywords in a query, which together form compound concepts or phrases like new york times.  ...  From the TREC topics in the Web tracks 2009-2011 and the Million Query track 2009 with at least one document being judged as relevant, we use the 355 titles of length at least 3 keywords as our query set  ... 
doi:10.1145/2396761.2398398 dblp:conf/cikm/HagenPBS12 fatcat:xqsa7ujs35gpxmgcraxclzzooy

Comparing Crowd-Based, Game-Based, and Machine-Based Approaches in Initial Query and Query Refinement Tasks [chapter]

Christopher G. Harris, Padmini Srinivasan
2013 Lecture Notes in Computer Science  
We ask each group to manually construct queries to respond to TREC information needs and calculate their resulting recall and precision.  ...  We anticipate additional work to examine what aspects of games can improve initial query and query refinement performance and look at how this can be integrated to make the user experience in search more  ...  Undergraduate student volunteers (N=47) were recruited from several sections of an undergraduate business course from a small Midwestern university in September 2012.  ... 
doi:10.1007/978-3-642-36973-5_42 fatcat:btnuqmcw35c67fopt2wns6k3qi

Toward a Comprehension Challenge, Using Crowdsourcing as a Tool

Praveen Paritosh, Gary Marcus
2016 The AI Magazine  
As a step toward these goals we propose a novel test, the Crowdsourced Comprehension Challenge (C3), which is constructed by repeated runs of a three-person game, the Iterative Crowdsourced Comprehension  ...  ICCG uses structured crowdsourcing to comprehensively generate relevant questions and supported answers for arbitrary stories, whether fiction or nonfiction, presented across a variety of media such as  ...  Forbus, Doug Lenat, Nancy Chang, Eric Altendorf, David Huynh, David Martin, Nick Hay, Matt Klenk, Jutta Degener, Kurt Bollacker, and participants and reviewers of the Beyond the Turing Test Workshop at  ... 
doi:10.1609/aimag.v37i1.2649 fatcat:bt4qe2tojvhj5ao4fdaylp2cme

Review article: Detection of actionable tweets in crisis events

Anna Kruspe, Jens Kersten, Friederike Klan
2021 Natural Hazards and Earth System Sciences  
Researchers have started to look into this problem in recent years, beginning with crowdsourced methods. Lately, approaches have shifted towards an automatic analysis of messages.  ...  We then compare approaches for solving the detection problem based (1) on filtering by characteristics like keywords and location, (2) on crowdsourcing, and (3) on machine learning technique.  ...  Almost all of them contain information type annotations, but there is no universal agreement on an ontology here.  ... 
doi:10.5194/nhess-21-1825-2021 fatcat:3npxsdoo2zf5hko4o6mwbesfzu

The impact of result diversification on search behaviour and performance

David Maxwell, Leif Azzopardi, Yashar Moshfeghi
2019 Information retrieval (Boston)  
To this end, we performed a within-subjects user study using the TREC AQUAINT collection with 51 participants, examining the differences in search performance and behaviour when using (i) a non-diversified  ...  Aspectual retrieval found significant traction in the TREC Interactive Tracks from 1997-2002.  ...  As an example, take the topic Wildlife Extinction, one of the topics in the TREC 2005 Robust Track (Voorhees 2006) .  ... 
doi:10.1007/s10791-019-09353-0 fatcat:lvlpoicexbdbhg72olwjgaet5u

Building a large-scale corpus for evaluating event detection on twitter

Andrew J. McMinn, Yashar Moshfeghi, Joemon M. Jose
2013 Proceedings of the 22nd ACM international conference on Conference on information & knowledge management - CIKM '13  
We then use crowdsourcing to gather relevance judgements, and discuss the quality of results, including how we ensured integrity and prevented spam.  ...  This is partially due to a number of issues associated with the creation of Twitter corpora, including restrictions on the distribution of the tweets and the difficultly of creating relevance judgements at  ...  TREC ran a Microblog Track in 2011 with an ad-hoc retrieval task, and again in 2012 with the addition of a filtering tasks.  ... 
doi:10.1145/2505515.2505695 dblp:conf/cikm/McMinnMJ13 fatcat:biw36szlzncdjllbjerwffbsiq

Term-Based Models for Entity Ranking [chapter]

Krisztian Balog
2018 Advanced Topics in Information Retrieval  
Relevance assessments for both tracks were gathered via crowdsourcing.  ...  TREC Entity The TREC Entity track was launched in 2009 [9] with the aim to perform entityoriented search tasks on the Web.  ... 
doi:10.1007/978-3-319-93935-3_3 fatcat:dtyxpoiqsbfhtm6m5q24oxp5ii

Overview of INEX 2013 [chapter]

Patrice Bellot, Antoine Doucet, Shlomo Geva, Sairam Gurajada, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Arunav Mishra, Véronique Moriceau, Josiane Mothe, Michael Preminger, Eric SanJuan (+5 others)
2013 Lecture Notes in Computer Science  
structured or semantic data (Linked Data track); and focused retrieval (Snippet Retrieval and Tweet Contextualization tracks).  ...  This paper gives an overview of all the INEX 2013 tracks, their aims and task, the built test-collections, and gives an initial analysis of the results.  ...  In 2012, topics were made of 53 tweets from New York Times (NYT). In 2013, the task was enriched and evaluated topics were made of 120 tweets manually collected by organizers.  ... 
doi:10.1007/978-3-642-40802-1_27 fatcat:poxx52dr3vgfpcndlticjsl3da

GEOProcessing 2012 Forward GEOProcessing 2012 Committee GEOProcessing 2012 Advisory Chairs GEOProcessing 2012 Technical Program Committee

Monica De Martino, Consiglio Nazionale Delle Ricerche -Genova, Claus-Peter Rückemann, Monica De Martino, Consiglio Nazionale Delle Ricerche -Genova, Claus-Peter Rückemann, Riccardo Albertoni, Consiglio Nazionale Delle Ricerche -Genova, Italy Thierry Badard, Université Laval -Québec, Canada Bakalov, Fabian Barbato (+47 others)
2012 unpublished
GEOProcessing 2012 Chairs  ...  We also kindly thank all the authors who dedicated much of their time and efforts to contribute to the GEOProcessing 2012.  ...  The research team thanks Charlotte Pierson, student at the University of Liège, and Véronique Wallemacq, researcher, for their contributions to this paper. This is a multidisciplinar project.  ... 

Processing Social Media Messages in Mass Emergency: A Survey [article]

Muhammad Imran, Carlos Castillo, Fernando Diaz, Sarah Vieweg
2015 arXiv   pre-print
Sarah Vieweg. 2012. Situational Awareness in Mass Emergency: A Behavioral and Linguistic Analysis of Microblogged Communications. Ph.D. Dissertation. University of Colorado at Boulder.  ...  Hughes. 2012. Supporting the Social Media Needs of Emergency Public Information Officers with Human-Centered Design and Development. Ph.D. Dissertation. University of Colorado at Boulder.  ... 
arXiv:1407.7071v3 fatcat:e7mcvae5freddaus7ndolygeti
« Previous Showing results 1 — 15 out of 78 results