3,022 Hits in 6.4 sec

Using Amazon Mechanical Turk and other compensated crowdsourcing sites

Gordon B. Schmidt, William M. Jettinghoff
2016 Business Horizons  
The quality of MTurk sample data has been found to be equivalent to in-person participants for tasks/uses such as psychological surveys (Goodman, Cryder, & Cheema, 2013) , behavioral tests (Casler, Bickel  ...  Such companies provide summaries of many websites for internal or customer use, and rely on crowdsourcing workers to create these.  ... 
doi:10.1016/j.bushor.2016.02.004 fatcat:pbqmlwpq5vcffpquciy6zrbgqy

A Conceptual Model to Understand the Factors that Drive Individual Participation in Crowdsourcing for Medical Diagnosis

Kaushik Ghosh, Kabir Sen
2015 2015 48th Hawaii International Conference on System Sciences  
This article is a 'Research-in Progress' that examines the role of Web-based platforms in driving participation of individuals in crowdsourcing services for medical diagnosis.  ...  In healthcare, assisted by collective knowledge of a large group of individuals, crowdsourcing is enabling prediction of disease outbreaks and diagnosis of rare medical conditions.  ...  Next, we discuss methods for data collection and suggest techniques to test the proposed model.  ... 
doi:10.1109/hicss.2015.341 dblp:conf/hicss/GhoshS15 fatcat:sqemyntdcbdgrcpxjzp7kaaoga

How to Manage Crowdsourcing Platforms Effectively?

Ivo Blohm, Shkodran Zogaj, Ulrich Bretschneider, Jan Marco Leimeister
2017 California Management Review  
for crowdsourcing.  ...  We investigate the effectiveness of these governance mechanisms in 19 case studies and recommend specific configurations of these mechanisms for each of the four crowdsourcing approaches.  ...  However, for this aggregation, the crowdsourced information needs to correspond to the internal IT system's structure that is used to manage service personnel.  ... 
doi:10.1177/0008125617738255 fatcat:ujt42qhrb5dy3h7pwsosek3pfe

Crowdsourcing graphical perception

Jeffrey Heer, Michael Bostock
2010 Proceedings of the 28th international conference on Human factors in computing systems - CHI '10  
Lastly, we report cost and performance data from our experiments and distill recommendations for the design of crowdsourced studies.  ...  With its low cost and scalability, crowdsourcing presents an attractive option for evaluating the large design space of visualizations; however, it first requires validation.  ...  Our results help characterize the use of Mechanical Turk for conducting web-based experiments.  ... 
doi:10.1145/1753326.1753357 dblp:conf/chi/HeerB10 fatcat:yxmuixtcpfcpjiezgu7xv6edey

The Nature of Crowd Work and its Effects on Individuals' Work Perception

David Durward, Ivo Blohm, Jan Marco Leimeister
2020 Journal of Management Information Systems  
We study how the nature of the tasks being performed and financial compensation jointly shape work perceptions of crowd workers in order to better understand the changing modes and patterns of digital  ...  We show that crowd workers need rather high levels of financial compensation before task characteristics become relevant for shaping favorable perceptions of working conditions.  ...  Funding We thank the Hans Böckler Foundation for funding parts of this research. Also, parts of this research project were funded by the Swiss National Science Foundation (10DL16_183198).  ... 
doi:10.1080/07421222.2019.1705506 fatcat:kbh5eaf6ozaebkv4flpnla6gm4

An Empirical Analysis of an Internal Crowdsourcing Platform: IT Implications for Improving Employee Participation [chapter]

Neslihan Iskender, Tim Polzehl
2020 Business Rule-Oriented Conceptual Modeling  
Therefore, this chapter aims to provide a guideline for organizations and employers from the perspective of the technical design of internal crowdsourcing, specifically regarding issues of data protection  ...  AbstractCrowdsourcing has become one of the main resources for working on so-called microtasks that require human intelligence to solve tasks that computers cannot yet solve and to connect to external  ...  Apparently, task typology is the determining factor for the success of an internal crowdsourcing campaign and should be selected very carefully.  ... 
doi:10.1007/978-3-030-52881-2_6 fatcat:4zpogzjmpjekrgua356vlevdra

Crowdsourcing for usability testing

Di Liu, Randolph G. Bias, Matthew Lease, Rebecca Kuipers
2012 Proceedings of the American Society for Information Science and Technology  
To investigate the potential of such crowdsourced usability testing, we conducted a usability study which evaluated a graduate school's website using a crowdsourcing platform.  ...  We discuss both methodological differences for crowdsourced usability testing, as well as empirical contrasts to results from more traditional, face-to-face usability testing.  ...  ACKNOWLEDGMENTS We thank the reviewers for their valuable feedback. A $25 educational credit from CrowdFlower paid for use of their services.  ... 
doi:10.1002/meet.14504901100 fatcat:p6jp53wvcffijberm7zodczvze

Crowdsourcing for Usability Testing [article]

Di Liu, Matthew Lease, Rebecca Kuipers, Randolph Bias
2012 arXiv   pre-print
We discuss both methodological differences for crowdsourced usability testing, as well as empirical contrasts to results from more traditional, face-to-face usability testing.  ...  usability lab setting, and the other using crowdsourcing.  ...  Any opinions, findings, conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of their institution or funding agencies.  ... 
arXiv:1203.1468v2 fatcat:wroxtmrkwjb7vm6gs3cxh2xfhy

Exploring the use of crowdsourcing to support empirical studies in software engineering

Kathryn T. Stolee, Sebastian Elbaum
2010 Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement - ESEM '10  
In this work we explore the use of crowdsourcing as a mechanism to address that challenge by assisting in subject recruitment.  ...  In this section, we describe our study and how it was adapted to fit an infrastructure that supports crowdsourcing.  ...  The basic idea behind crowdsourcing is to allow a client to leverage a global community of users with different talents and backgrounds to help perform a task (e.g., solve a problem, classify data, refine  ... 
doi:10.1145/1852786.1852832 dblp:conf/esem/StoleeE10 fatcat:q6u4wh72x5cxhcyq4y4y4plify

Crowdsourcing Versus the Laboratory: Towards Human-Centered Experiments Using the Crowd [chapter]

Ujwal Gadiraju, Sebastian Möller, Martin Nöllenburg, Dietmar Saupe, Sebastian Egger-Lampl, Daniel Archambault, Brian Fisher
2017 Lecture Notes in Computer Science  
We would like to thank Dagstuhl for facilitating the seminar (titled, 'Evaluation in the Crowd: Crowdsourcing and Human-Centred Experiments') that brought about this collaboration.  ...  Part of this work (Sect. 4) was supported by the German Research Foundation (DFG) within project A05 of SFB/Transregio 161.  ...  Any combination of such techniques can be used to help ensure investments of the participants and the collection of high quality experimental data.  ... 
doi:10.1007/978-3-319-66435-4_2 fatcat:wqthlc7ohjc6td3wgfdmkyca7q

On the state of reporting in crowdsourcing experiments and a checklist to aid current practices [article]

Jorge Ramírez, Burcu Sayin, Marcos Baez, Fabio Casati, Luca Cernuzzi, Boualem Benatallah, Gianluca Demartini
2021 arXiv   pre-print
mapping experimental conditions to micro-tasks, or ensure quality contributions.  ...  Informed by this process, we propose a checklist for reporting crowdsourcing experiments.  ...  ACKNOWLEDGMENTS The authors thank our interview participants and anonymous reviewers for their helpful comments and feedback.  ... 
arXiv:2107.13519v2 fatcat:wxwom43pv5dnbh6zho2knr7tgm

The Literature of Crowdsourcing in China: Evidence from

Bei Wu, Tingting Wu, Qing Shan Ng
2015 International Journal of Knowledge Engineering  
If the task passes the test, users can gain corresponding cash or integral compensation, and they can withdraw in Alipay.  ...  Services Commercial Check: Mobile users through all kinds of "monitoring" and "the inspector" enterprise or mall activities reflect the data information in time, using the data to help enterprise to see  ... 
doi:10.18178/ijke.2015.1.3.030 fatcat:epdbs7uwx5hxbgqkpn7xmpdmpq

Creation of Reliable Relevance Judgments in Information Retrieval Systems Evaluation Experimentation through Crowdsourcing: A Review

Parnia Samimi, Sri Devi Ravana
2014 The Scientific World Journal  
Crowdsourcing as a novel method of data acquisition is broadly used in many research fields.  ...  Test collection is used to evaluate the information retrieval systems in laboratory-based evaluation experimentation.  ...  Conflict of Interests The authors declare that there is no conflict of interests regarding the publication of this paper. Acknowledgment  ... 
doi:10.1155/2014/135641 pmid:24977172 pmcid:PMC4055211 fatcat:qfbavfc45jfmzp4yisqyedx2o4

Crowdsourced Data Management: Industry and Academic Perspectives

Adam Marcus, Aditya Parameswaran
2015 Foundations and Trends in Databases  
Crowdsourcing Background 9 in subsequent sections, many large companies leverage crowdsourcing via internal crowdsourcing marketplaces, where the scenario is similar, i.e., workers get monetarily compensated  ...  Crowdsourcing is used in video analysis [53] , for image labeling [160, 185] , and as a visual aid [39] .  ...  We are thankful to our institutions for giving us the freedom to pursue this book.  ... 
doi:10.1561/1900000044 fatcat:rva7dinutnbnlj2hvm4j2hmhge

Monetary and Social Rewards for Crowdsourcing

Cappa, Rosso, Hayes
2019 Sustainability  
Crowdsourcing of inventive activities is a particular form of crowdsourcing that helps firms to innovate by involving dispersed individuals to exploit "crowd wisdom".  ...  of the compensation.  ...  The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.  ... 
doi:10.3390/su11102834 fatcat:px2q4vtfezfofdyrhbo7bbrfta
« Previous Showing results 1 — 15 out of 3,022 results