Filters








935 Hits in 3.6 sec

Crowdsourcing Samples in Cognitive Science

Neil Stewart, Jesse Chandler, Gabriele Paolacci
2017 Trends in Cognitive Sciences  
Academic interest in MTurk began in computer science, which used crowdsourcing to perform human intelligence tasks (HITs) such as transcription, developing training data sets, validating machine learning  ...  Crowdsourcing data collection from research participants recruited from online labor markets is now common in cognitive science.  ...  Crowdsourcing tasks tend to be of short duration (but there are exceptions [56] ).  ... 
doi:10.1016/j.tics.2017.06.007 pmid:28803699 fatcat:3egcfmvvafebdkuilinmzonioy

A web based subjective evaluation platform

Benjamin Rainer, Markus Waltl, Christian Timmerer
2013 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX)  
The presented framework can be used for both crowdsourced and laboratory experiments. It should ease the task of designing a subjective quality assessment by providing a flexible framework.  ...  Preparing and conducting subjective quality assessments is a time consuming and expensive task.  ...  It can be integrated into any crowdsourcing platform as long as there is the possibility to embed external Web sites into a crowdsourced task.  ... 
doi:10.1109/qomex.2013.6603196 dblp:conf/qomex/RainerWT13 fatcat:ppjd5tdhjvbwxfjyzph7wc5dzi

Crowdsourced Web Engineering and Design [chapter]

Michael Nebeling, Stefania Leone, Moira C. Norrie
2012 Lecture Notes in Computer Science  
The potential of the approach is illustrated based on two initial experiments.  ...  To enable this, we introduce the notion of crowdsourced web site components whose design can gradually evolve as they get associated with more data and functionality contributed by the crowd.  ...  JavaScript.  ... 
doi:10.1007/978-3-642-31753-8_3 fatcat:f3thwlpqlna37l52s4uvv7wbq4

Preliminary results from a crowdsourcing experiment in immunohistochemistry

Vincenzo Della Mea, Eddy Maddalena, Stefano Mizzaro, Piernicola Machin, Carlo A Beltrami
2014 Diagnostic Pathology  
Results: Contributors were in total 28, and evaluated 4.64 images each on average. Spearman correlation between gold and crowdsourced positivity percentages is 0.946 (p < 0.001).  ...  Conclusions: Aim of the experiment was to understand how to use crowdsourcing for an image analysis task that is currently time-consuming when done by human experts.  ...  Publication of this supplement has been funded by 12th European Congress on Digital Pathology.  ... 
doi:10.1186/1746-1596-9-s1-s6 pmid:25565010 pmcid:PMC4305976 fatcat:7cbypxumbjdrfalfkrrbmsq4iu

Lessons Learned from Developing a Microservice Based Mobile Location-Based Crowdsourcing Platform [article]

Irwyn Sadien, Konstantinos Papangelis, Charles Fleming, Hai-Ning Liang
2019 arXiv   pre-print
Research in Mobile Location-Based Crowdsourcing is hindered by a marked lack of real-world data.  ...  Tasking Tasking is central to the concept of crowdsourcing.  ...  To facilitate development and maintenance, we focused on using JavaScript technologies throughout the whole software stack.  ... 
arXiv:1909.03596v1 fatcat:3nykljrkbvdankpxf2ikukg4zi

A Spinning Wheel for YARN: User Interface for a Crowdsourced Thesaurus

Pavel Braslavski, Dmitry Ustalov, Mikhail Mukhin
2014 Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics  
YARN (Yet Another RussNet) project started in 2013 aims at creating a large open thesaurus for Russian using crowdsourcing.  ...  Figure 3 : 3 Linear trend of time spent on sequential edits of nontrivial synsets by top-5 contributors.  ...  Figure 3 shows a linear trend of time spent by five top contributors on constructing consecutive non-trivial synsets.  ... 
doi:10.3115/v1/e14-2026 dblp:conf/eacl/BraslavskiUM14 fatcat:nzszgdpnurfebeflaykgld423m

Assessing internet video quality using crowdsourcing

Óscar Figuerola Salas, Velibor Adzic, Akash Shah, Hari Kalva
2013 Proceedings of the 2nd ACM international workshop on Crowdsourcing for multimedia - CrowdMM '13  
CrowdFlower and Amazon's Mechanical Turk were used as the crowdsourcing platforms to collect data.  ...  In this paper, we present a subjective video quality evaluation system that has been integrated with different crowdsourcing platforms.  ...  Conceptual challenges arise from the differences between the basic concepts of crowdsourcing and the structure of subjective tests, for example, in crowdsourcing the tasks are supposed to be small so that  ... 
doi:10.1145/2506364.2506366 dblp:conf/mm/SalasASK13 fatcat:y7mnnc2isjbane2c74dow4gsna

Characterizing the hyperspecialists in the context of crowdsourcing software development

Anderson Bergamini de Neira, Igor Steinmacher, Igor Scaliante Wiese
2018 Journal of the Brazilian Computer Society  
Recently, crowdsourcing has also been used for software development to run tests, fix small defects, or perform small coding tasks.  ...  Companies around the world use crowdsourcing platforms to complete simple tasks, collect product ideas, and launch advertising campaigns.  ...  [14] , the success of crowdsourcing rests on four pillars: the company, the platform, the tasks, and the workers.  ... 
doi:10.1186/s13173-018-0082-2 fatcat:4vbcmg5ryfhmlkpiw5illpwca4

Crowdsourcing in biomedicine: challenges and opportunities

Ritu Khare, Benjamin M. Good, Robert Leaman, Andrew I. Su, Zhiyong Lu
2015 Briefings in Bioinformatics  
mining crowd data and active crowdsourcing. • The studies are summarized based on the crowdsourcing platforms, such as labor markets, scientific games, wikis and community challenges. • Emerging themes  ...  Finally, we identify important emerging trends, opportunities and remaining challenges for future crowdsourcing research in biomedicine. • Recent crowdsourcing studies for biomedicine are categorized into  ...  Crowdflower allows building sophisticated crowdsourcing user interfaces using HTML and JavaScript).  ... 
doi:10.1093/bib/bbv021 pmid:25888696 pmcid:PMC4719068 fatcat:e6avuxul5rhfzgdaywgvb3wte4

CrowdAdapt

Michael Nebeling, Maximilian Speicher, Moira C. Norrie
2013 Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems - EICS '13  
a) Original design of the CNN web site (b) Crowdsourced adaptation Figure 1 : Juxtaposing the original CNN web site viewed on a medium-size screen at 1680x1050 pixels and the best-matching, highest-ranked  ...  We focus on one experiment we conducted for an existing news web site using CrowdAdapt (i) to explore the design space in terms of layout alternatives created by the crowd, (ii) to identify adaptation  ...  Acknowledgements We would like to thank Rob Miller and Fabio Paternò for their helpful comments on earlier versions of this paper. This work was supported by the Swiss NSF (grant nr. 200020 134983).  ... 
doi:10.1145/2494603.2480304 fatcat:xiirpibiwzaahbdz7ticv2ge7u

The Use of Microtasks in Crowdsourcing Software Development

William Simão De Deus, Jo´se Augusto Fabri, Alexandre L'Erario
2017 Journal on Advances in Theoretical and Applied Informatics  
Crowdsourcing (CS) is a distributed software development model in which small activities (or microtasks) of design, development, and tests are developed by employees by an online platform.  ...  In this form, it was conducted an analysis of 14485 microtasks recorded on a CS platform to investigate microtasks in the development of CS software.  ...  INTRODUCTION Crowdsourcing (CS) is a model of task development and problem-solving based on the contribution of a large group of people [1] .  ... 
doi:10.26729/jadi.v3i1.2450 fatcat:5fvqssfovnflhaahzzfzupm6se

Use of Mechanical Turk as a MapReduce Framework for Macular OCT Segmentation

Aaron Y. Lee, Cecilia S. Lee, Pearse A. Keane, Adnan Tufail
2016 Journal of Ophthalmology  
The interface was created using custom HTML5 and JavaScript code, and data analysis was performed using R.  ...  Each Human Intelligence Task was set to$0.01 and required the user to draw five lines to outline the sublayers of the retinal OCT image after being shown example images.  ...  In this system, simple Human Intelligence Tasks (HITs) are submitted to online untrained users for a small compensation.  ... 
doi:10.1155/2016/6571547 pmid:27293877 pmcid:PMC4879255 fatcat:al3a7jybsjezxcmnmtw27aq2ae

Evaluating Crowdworkers as a Proxy for Online Learners in Video-Based Learning Contexts

Dan Davis, Claudia Hauff, Geert-Jan Houben
2018 Proceedings of the ACM on Human-Computer Interaction  
Crowdsourcing has emerged as an effective method of scaling-up tasks previously reserved for a small set of experts.  ...  We here report results from a crowdsourcing study (N = 135) to evaluate the extent to which crowdworkers and MOOC learners behave comparably on lecture viewing and quiz tasks-the most utilized learning  ...  Crowdsourcing can here take some of the uncertainty out of this process and identify any undesirable behaviors or trends to be ameliorated in the iterative design process.  ... 
doi:10.1145/3274311 fatcat:yilhfooonjfknehpvqsj53hqde

A Blockchain-based privacy preserving mechanism for mobile crowdsensing

Khan Hilmand, Khan Hajra, Shauqat Ayesha, Tahir Sibgha, Hanif Sarmad, Hamza Hafiz
2022 Trends in Computer Science and Information Technology  
by adversaries on the blockchain.  ...  Consequently, some blockchain-based models must be proposed to attain privacy on the blockchain ledger.  ...  Task allocation A client crowdsources a crowdsensing task to the service supplier, along with the claimed rewards for attracting mobile users and alternative data used to evaluate the task fulfi llment  ... 
doi:10.17352/tcsit.000044 fatcat:gtblvsycrvavxmky5rnlllulsm

Best Practices for Crowdsourcing Dialectal Arabic Speech Transcription

Samantha Wray, Hamdy Mubarak, Ahmed Ali
2015 Proceedings of the Second Workshop on Arabic Natural Language Processing  
In this paper, we investigate different approaches in crowdsourcing transcriptions of Dialectal Arabic speech with automatic quality control to ensure good transcription at the source.  ...  Section 3 outlines the utilization of professional transcription for DA and compares it in general terms to the usage of crowdsourcing for the same task.  ...  on EGY audio and Egyptian annotators allowed us to complete multiple iterations of transcription tasks with a quick turnover.  ... 
doi:10.18653/v1/w15-3211 dblp:conf/wanlp/WrayMA15 fatcat:6cxggqnaqneibm7pxo6dr22vjm
« Previous Showing results 1 — 15 out of 935 results