Filters








4,620 Hits in 5.6 sec

Human factors in crowdsourcing

Sihem Amer-Yahia, Senjuti Basu Roy
2016 Proceedings of the VLDB Endowment  
This uber-ization of human labor requires the understanding of workers motivation in completing a task, their ability to work together in collaborative tasks, as well as, helping workers find relevant  ...  In that context, workers' motivation is modeled as a combination of intrinsic and extrinsic factors.  ...  This uber-ization of human labor requires the understanding of workers motivation in completing a task, their ability to work together in collaborative tasks, as well as, helping workers find relevant  ... 
doi:10.14778/3007263.3007323 fatcat:dnushrg4ujgxfo4kx24lk6ea2e

Toward Worker-Centric Crowdsourcing

Sihem Amer-Yahia, Senjuti Basu Roy
2016 IEEE Data Engineering Bulletin  
In this paper, we advocate that accounting for workers' characteristics, i.e., human factors in task assignment and task completion benefits both workers and requesters, and discuss new opportunities raised  ...  by worker-centric crowdsourcing.  ...  In a recent effort [29] , we proposed observing workers as they completed tasks and learning their motivation as a combination between task diversity (intrinsic motivation) and payment (extrinsic motivation  ... 
dblp:journals/debu/Amer-YahiaR16 fatcat:whpsqjdx35gx3nyekhve5mdkai

On Benchmarking for Crowdsourcing and Future of Work Platforms

Ria Mae Borromeo, Lei Chen, Abhishek Dubey, Sudeepa Roy, Saravanan Thirumuruganathan
2019 Zenodo  
This has played a key role in the development of research domains as diverse as databases and deep learning.  ...  Online crowdsourcing platforms have proliferated over the last few years and cover a number of important domains, these platforms include from worker-task platforms such Amazon Mechanical Turk, worker-for  ...  In fact, there are as many as 13 factors that are highly relevant for worker motivation [10] . These could be categorized as intrinsic and extrinsic motivation.  ... 
doi:10.5281/zenodo.6793148 fatcat:72mhfxfobfb2hobqm54hjq3ztq

On Benchmarking for Crowdsourcing and Future of Work Platforms

Ria Mae Borromeo, Lei Chen, Abhishek Dubey, Sudeepa Roy, Saravanan Thirumuruganathan
2019 IEEE Data Engineering Bulletin  
This has played a key role in the development of research domains as diverse as databases and deep learning.  ...  The crowdsourcing community has done yeoman's work in designing effective algorithms for various key components, such as incentive design, task assignment and quality control.  ...  In fact, there are as many as 13 factors that are highly relevant for worker motivation [10] . These could be categorized as intrinsic and extrinsic motivation.  ... 
dblp:journals/debu/Borromeo0DRT19 fatcat:umznjewa2zhjnpcm5rbgsdtbhy

Selection of Crowd in Crowdsourcing for Smart Intelligent Applications: A Systematic Mapping Study

Rui Shang, YongMei Ma, Farhad Ali, ChuanShuang Hu, Shah Nazir, Huafei Wei, Abdullah Khan, Mian Ahmad Jan
2021 Scientific Programming  
Crowdsourcing is a task-solving model in which human crowd is hired to solve a particular task.  ...  During the crowdsourcing process, the crowd selection is performed in order to select appropriate crowd workers for a specific task; without appropriate selection of crowd workers, the process of crowdsourcing  ...  It depends on task relevance and diverse expertise, and the level of participant selected [46] .  ... 
doi:10.1155/2021/9368128 fatcat:bllrubuid5hg3aweuycdhab55a

Creation of Reliable Relevance Judgments in Information Retrieval Systems Evaluation Experimentation through Crowdsourcing: A Review

Parnia Samimi, Sri Devi Ravana
2014 The Scientific World Journal  
In a classic setting, generating relevance judgments involves human assessors and is a costly and time consuming task.  ...  It has been proven that crowdsourcing is an inexpensive and quick solution as well as a reliable alternative for creating relevance judgments.  ...  [37] to find the motivation of the workers in crowdsourcing showed that money is the main incentive of 13% of Indian and 5% of US workers.  ... 
doi:10.1155/2014/135641 pmid:24977172 pmcid:PMC4055211 fatcat:qfbavfc45jfmzp4yisqyedx2o4

Quality through flow and immersion

Carsten Eickhoff, Christopher G. Harris, Arjen P. de Vries, Padmini Srinivasan
2012 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '12  
Based on previous experience as well as psychological insights, we propose the use of a game in order to attract and retain a larger share of reliable workers to frequentlyrequested crowdsourcing tasks  ...  such as relevance assessments and clustering.  ...  Acknowledgements We would like to thank Jiyin He and the Fish4Knowledge project for providing us with the fish images and expert judgements.  ... 
doi:10.1145/2348283.2348400 dblp:conf/sigir/EickhoffHVS12 fatcat:t26baigetzboplrulu6cj76zci

On the state of reporting in crowdsourcing experiments and a checklist to aid current practices [article]

Jorge Ramírez, Burcu Sayin, Marcos Baez, Fabio Casati, Luca Cernuzzi, Boualem Benatallah, Gianluca Demartini
2021 arXiv   pre-print
Crowdsourcing is being increasingly adopted as a platform to run studies with human subjects.  ...  In this paper, we examine the current state of reporting of crowdsourcing experiments and offer guidance to address associated reporting issues.  ...  ACKNOWLEDGMENTS The authors thank our interview participants and anonymous reviewers for their helpful comments and feedback.  ... 
arXiv:2107.13519v2 fatcat:wxwom43pv5dnbh6zho2knr7tgm

Crowdsourcing, collaboration and creativity

Aniket Kittur
2010 XRDS Crossroads The ACM Magazine for Students  
Crowdsourcing, Collaboration and Creativity One of the most interesting developments is the creation of generalpurpose markets for crowdsourcing diverse tasks.  ...  pool of highly expert workers and highly motivated companies.  ... 
doi:10.1145/1869086.1869096 fatcat:xpwt6oals5beniaidgqjho3ccy

Situated crowdsourcing using a market model

Simo Hosio, Jorge Goncalves, Vili Lehdonvirta, Denzil Ferreira, Vassilis Kostakos
2014 Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14  
Our work is the first to systematically investigate workers' behaviour and response to economic incentives in a situated crowdsourcing market.  ...  However, it remains unclear whether a situated crowdsourcing market can be sustained, and whether worker supply responds to pricesetting in such a market.  ...  Also the financial support of the Finnish Funding Agency for Technology and Innovation and Academy of Finland is gratefully acknowledged.  ... 
doi:10.1145/2642918.2647362 dblp:conf/uist/HosioGLFK14 fatcat:3trg76gukrcepmd45hnh37s23e

Worker Performance in a Situated Crowdsourcing Market

Jorge Goncalves, Simo Hosio, Yong Liu, Vassilis Kostakos
2015 Interacting with computers  
Unlike online markets, situated crowdsourcing markets consist of workers who become serendipitously available for work in a particular location and context.  ...  We also show that increasing task rewards in situated crowdsourcing leads to increased task uptake but not accuracy, while decreasing task rewards leads to decreases in both task uptake and accuracy.  ...  This work is partially funded by the Academy of Finland (Grants 276786-AWARE, 285062-iCYCLE, 286386-CPDSS, 285459-iSCIENCE), and the European Commission (Grants PCIG11-GA-2012-322138 and 645706-GRAGE).  ... 
doi:10.1093/iwc/iwv035 fatcat:fu3dpvo47bakbcmlm5f43nnrta

Increasing cheat robustness of crowdsourcing tasks

Carsten Eickhoff, Arjen P. de Vries
2012 Information retrieval (Boston)  
and, in turn, earn more money.  ...  In this work, we take a different approach by investigating means of a priori making crowdsourced tasks more resistant against cheaters.  ...  Open Access This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s)  ... 
doi:10.1007/s10791-011-9181-9 fatcat:gzcsi7e6oranvov7j6qzudx5fy

Curiosity Killed the Cat, but Makes Crowdwork Better

Edith Law, Ming Yin, Joslin Goh, Kevin Chen, Michael A. Terry, Krzysztof Z. Gajos
2016 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16  
How to motivate workers to stay longer and/or perform better in crowdsourcing systems is a critical question for designers.  ...  In this work, we examine the potential for curiosity as a new type of intrinsic motivational driver to incentivize crowd workers.  ...  Incentive Mechanisms in Crowdsourcing The design of incentive mechanisms for engaging workers and motivating them to produce high-quality work has been an extensively studied topic in crowdsourcing.  ... 
doi:10.1145/2858036.2858144 dblp:conf/chi/LawYGCTG16 fatcat:374lc6246jhudlqaqfkvopj724

CrowdHub: Extending crowdsourcing platforms for the controlled evaluation of tasks designs [article]

Jorge Ramírez, Simone Degiacomi, Davide Zanella, Marcos Baez, Fabio Casati, Boualem Benatallah
2019 arXiv   pre-print
Using CrowdHub, researchers can map their experimental design and automate the complex process of managing task execution over time while controlling for returning workers and crowd demographics, thus  ...  We present CrowdHub, a tool for running systematic evaluations of task designs on top of crowdsourcing platforms.  ...  Crowdsourcing platforms such as Figure Eight (F8) offer the building blocks to design and run crowdsourcing tasks.  ... 
arXiv:1909.02800v2 fatcat:6p7tejxsxvguxm3i3jdaaf3sle

Study on Patterns and Effect of Task Diversity in Software Crowdsourcing [article]

Denisse Martinez Mejorado, Razieh Saremi, Ye Yang, Jose E. Ramirez-Marquez
2020 arXiv   pre-print
competition level and identifying the dominant attributes that distinguish among these levels, and then studying the impact of task diversity on task success and worker performance in crowdsourcing platform  ...  Goal: The objective of this study is to empirically investigate patterns and effect of task diversity in software crowdsourcing platform in order to improve the success and efficiency of software crowdsourcing  ...  A MOTIVATIONAL EXAMPLE We suppose that task diversity in the platform is a relevant factor in workers decision making process registrations and submissions for a task.  ... 
arXiv:2006.00871v2 fatcat:pxravadgkjdwbmp63gemjqls5a
« Previous Showing results 1 — 15 out of 4,620 results