36 Hits in 5.1 sec

Experiment-Driven Development of a GWAP for Marking Segments in Text

Chris Madge, Jon Chamberlain, Udo Kruschwitz, Massimo Poesio
2017 Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play - CHI PLAY '17 Extended Abstracts  
This paper describes TileAttack, an innovative highly configurable game-with-a-purpose (GWAP) designed to gather annotations for text segmentation tasks whilst exploring the effects of different game mechanics  ...  We present the results of this experiment using a set of metrics derived from those used for evaluating Free-To-Play (F2P) games.  ...  Acknowledgements This research was supported in part by the EPSRC CDT in Intelligent Games and Game Intelligence (IGGI), EP/L015846/1; in part by the DALI project, ERC Grant 695662.  ... 
doi:10.1145/3130859.3131332 dblp:conf/chiplay/MadgeCKP17 fatcat:fd6ti7rm7nawhm4bgh6cgqhwfm

Crowdsourcing and Aggregating Nested Markable Annotations

Chris Madge, Juntao Yu, Jon Chamberlain, Udo Kruschwitz, Silviu Paun, Massimo Poesio
2019 Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics  
One of the key steps in language resource creation is the identification of the text segments to be annotated, or markablesin our case, the (potentially nested) noun phrases in coreference resolution (  ...  In this paper, we present a method for identifying markables for coreference annotation that combines high-performance automatic markable detectors with checking with a Game-With-A-Purpose (GWAP) and aggregation  ...  Acknowledgements This research was supported in part by the EP-SRC CDT in Intelligent Games and Game Intelligence (IGGI), EP/L015846/1; in part by the DALI project, ERC Grant 695662.  ... 
doi:10.18653/v1/p19-1077 dblp:conf/acl/MadgeYCKPP19 fatcat:ajoawftnzfgk3i2hljmnvsgawm

Phrase detectives

Massimo Poesio, Jon Chamberlain, Udo Kruschwitz, Livio Robaldo, Luca Ducceschi
2013 ACM transactions on interactive intelligent systems (TiiS)  
An illustration of this new approach is Phrase Detectives, an interactive online game with a purpose for creating anaphorically annotated resources that makes use of a highly distributed population of  ...  It furthermore summarizes the lessons that we have learned in developing this game which should help other researchers to design and implement similar games.  ...  ACKNOWLEDGMENTS A great number of people in the community have helped us to develop the game and promote it.  ... 
doi:10.1145/2448116.2448119 fatcat:jqyu4ua7jvcoldn4jo23kncumu

Topical Video Search: Analysing Video Concept Annotation through Crowdsourcing Games

Riste Gligorov, Michiel Hildebrand, Jacco van Ossenbruggen, Lora Aroyo, Guus Schreiber
2017 Human Computation  
Games with a purpose (GWAPs) are increasingly used in audio-visual collections as a mechanism for annotating videos through tagging. One such GWAP is Waisda?  ...  To this end, we setup a Cranfield-style experiment for which we use an evaluation dataset that consists of: (i) a collection of videos tagged in Waisda?  ...  ACKNOWLEDGEMENTS We thank Q42 and Johan Oomen, Maarten Brinkerink, Lotte Belice Baltussen and Erwin Verbruggen from the Netherlands Institute for Sound and Vision for running the Waisda?  ... 
doi:10.15346/hc.v4i1.3 dblp:journals/hc/GligorovHOAS17 fatcat:yuwqwgpfyras7dniqo6d2aip2i

AI's 10 to Watch

James Hendler, Philipp Cimiano, Dmitri Dolgov, Anat Levin, Peter Mika, Brian Milch, Louis-Philippe Morency, Boris Motik, Jennifer Neville, Erik B. Sudderth, Luis von Ahn
2008 IEEE Intelligent Systems  
In addition, I've developed a framework for experimental analysis of relational models that decomposes error due to both the relational-learning process and the collectiveinference process, which is a  ...  Although OCR achieves extremely high accuracy on newer texts, many books scan poorly due to age, quality, or damage (for example, pencil markings). In such cases, OCR achieves a low recognition rate.  ... 
doi:10.1109/mis.2008.40 fatcat:nz7bdn2torfthilyflnwmmbmc4

Crowdsourcing Human-Robot Interaction: New Methods and System Evaluation in a Public Environment

Cynthia Breazeal, Nick DePalma, Jeff Orkin, Sonia Chernova, Malte Jung
2013 Journal of Human-Robot Interaction  
Leveraging the interaction data recorded in the online game, we present a novel technique for data-driven behavior generation using case-based planning for a real robot.  ...  In this work, we explore a data-driven approach that relies on crowdsourcing as a rich source of interactions that cover a wide repertoire of human behavior.  ...  Acknowledgements This work was supported by Microsoft Research and the Office of Naval Research Award Numbers N000140910112 and N000140710749.  ... 
doi:10.5898/jhri.2.1.breazeal fatcat:wiqe5ofucjhsdgts42lr6nugha

Music Information Retrieval: Recent Developments and Applications

Markus Schedl, Emilia Gómez, Julián Urbano
2014 Foundations and Trends in Information Retrieval  
We provide a survey of the field of Music Information Retrieval (MIR), in particular paying attention to latest developments, such as semantic auto-tagging and user-centric retrieval and recommendation  ...  These in turn enable a wide variety of music retrieval tasks, such as semantic music search or music identification ("query by example").  ...  The authors would further like to thank Masataka Goto, Mohamed Sordo, and Edith Law for granting permission to include their visual material in this survey, and Juan J.  ... 
doi:10.1561/1500000042 fatcat:c5tjdcy3xrfqvp6isnktbr6lpy

Human-Machine Cooperation in Large-Scale Multimedia Retrieval: A Survey

Kimiaki Shirahama, Marcin Grzegorzek, Bipin Indurkhya
2015 Journal of Problem Solving  
Although LSMR has been investigated for more than two decades in the fields of multimedia processing and computer vision, a more interdisciplinary approach is necessary to develop an LSMR system that is  ...  We hope that this paper will create a bridge to enable researchers in different fields to communicate about the LSMR problem and lead to a ground-breaking next generation of LSMR systems.  ...  In accordance with these issues, Oomoto and Tanaka (1993) developed Object-Oriented Video Information Database (OVID) where a segment and text descriptions are regarded as a video object and attribute  ... 
doi:10.7771/1932-6246.1173 fatcat:hrjbuq4s4bbo7p5pmfrd6f3bva

Revisiting Citizen Science Through the Lens of Hybrid Intelligence [article]

Janet Rafner, Miroslav Gajdacz, Gitte Kragh, Arthur Hjorth, Anna Gander, Blanka Palfi, Aleks Berditchevskaia, François Grey, Kobi Gal, Avi Segal, Mike Walmsley, Josh Aaron Miller (+4 others)
2021 arXiv   pre-print
Finally, we propose a framework for types of human-AI interaction in CS based on established criteria of HI.  ...  testbed for the development of HI and human-centered AI of the 21st century, while benefiting CS as well.  ...  A potential means of rapid experimentation could be through an online research platform to enable rapid development and testing of various candidate HI architectures for any CS project.  ... 
arXiv:2104.14961v1 fatcat:apf43v7pf5gsnfddksfgtjv7gy

A crowdsourcing framework for the production and use of film and television data

Gary Geisler, Geoff Willard, Carlos Ovalle
2011 New Review of Hypermedia and Multimedia  
Our development of a test collection included detailed indexing of 12 feature films and 8 television programs.  ...  By making it easier to generate detailed data about these media on a large scale, fans and scholars can more efficiently produce a wide range of artifacts that reflect their interests in this content.  ...  Acknowledgements This work was funded in part by a John P. Commons Teaching Fellowship from the University of Texas at Austin School of Information.  ... 
doi:10.1080/13614568.2011.552645 fatcat:qtsa4jzo2ngype5ro2fl77qrsi

Community interpreting, translation, and technology

Christopher D. Mellinger, Nike K. Pokorn
2018 Translation and Interpreting Studies  
Asaro, P. (2007).Robots and Responsibility from a Legal Perspective. In Proceedings of the IEEE Conference on Bibliographical References  ...  The authors would also like to show their gratitude to all the participants of the experiment.  ...  In this paper, we argue that this development, together with the diffuse understanding of "experiments" in cyberspace calls for a global declaration of ethical principles for experimentation with personal  ... 
doi:10.1075/ fatcat:3gdc2iojrze4dhyvvs52fo7cuu

Web Wisdom: An essay on how Web 2.0 and Semantic Web can foster a global knowledge society

Christopher Thomas, Amit Sheth
2011 Computers in Human Behavior  
In this case, though, we are reporting on recent developments on the web that lead us to believe that the web is on the way to providing a platform for not only information acquisition and business transactions  ...  but also for large scale knowledge development and decision support.  ...  Image segmentation in Squigl and Peekaboom: Whereas the ESP-Game was meant to provide high-quality tags for images, Squigl 5 is a game in which objects inside an image are demarcated by drawing a line  ... 
doi:10.1016/j.chb.2010.07.023 fatcat:vd6neu2kyrdlreu3wvv5hdh4um

Automatic image semantic interpretation using social action and tagging data

Neela Sawant, Jia Li, James Z. Wang
2010 Multimedia tools and applications  
The survey concludes with a summary of principle research directions for the present and the future.  ...  The plethora of social actions and annotations (tags, comments, ratings) from online media sharing Websites and collaborative games have induced a paradigm shift in the research on image semantic interpretation  ...  segmentation.  ... 
doi:10.1007/s11042-010-0650-8 fatcat:kqu6kyess5f3re554jsueuuzem

Uncertainty Handling in Surrogate Assisted Optimisation of Games

Vanessa Volz
2019 Künstliche Intelligenz  
The second function suite is based on a significantly extended version of a procedural content generation technique for Super Mario Bros. levels proposed in [Vol+18] developed with SAPEO Algorithm SAPEO  ...  The theoretical performance assessment was supported by Michael Emmerich in context of a short term scientific mission 7 .  ...  However, in practice, these segments would need to be played in direct sequence in order to allow for a reasonably long playing experience.  ... 
doi:10.1007/s13218-019-00613-1 fatcat:kmaa4m35xfcbbhmyvy4zgcfoae

Large-scale medical image annotation with quality-controlled crowdsourcing

Eric Heim
Especially in the domain of medical image analysis, the availability of domain experts for reference data generation is becoming a major bottleneck for machine learning applications.  ...  A pilot study performed on the case of liver segmentation in abdominal CT scans showed that the proposed approach is able to create organ segmentations matching the quality of those create by medical experts  ...  10 Example of a CAPTCHA text for user validation on websites. Two distorted words are displayed to the user.  ... 
doi:10.11588/heidok.00024641 fatcat:fq4fontrnbfaposdwmh3fdupsq
« Previous Showing results 1 — 15 out of 36 results