137 Hits in 6.5 sec

Comparing Generic and Community-Situated Crowdsourcing for Data Validation in the Context of Recovery from Substance Use Disorders [article]

Sabirat Rubya, Joseph Numainville, Svetlana Yarosh
2020 arXiv   pre-print
We discuss the benefits and trade-offs of recruiting paid vs. unpaid community-situated workers and provide implications for future research in the recovery context and relevant domains of HCI, and for  ...  Targeting the right group of workers for crowdsourcing often achieves better quality results.  ...  In addition, the motivation and the incentive (i.e., pay for the MTurk community-situated workers, altruism and sense of belonging to the community for ITR workers, etc.) may have impacted the outcome  ... 
arXiv:2012.06965v1 fatcat:xliecareubappeuruxwjci3pe4

Perspectives on crowdsourcing annotations for natural language processing

Aobo Wang, Cong Duy Vu Hoang, Min-Yen Kan
2012 Language Resources and Evaluation  
Crowdsourcing has emerged as a new method for obtaining annotations for training models for machine learning.  ...  We then use our analysis to discuss our recommendations on how practitioners can take advantage of crowdsourcing and discuss our view on potential opportunities in this area.  ...  Ng, Jin Zhao and Ziheng Lin.  ... 
doi:10.1007/s10579-012-9176-1 fatcat:dl6tvexzn5edlpdjhsn3uczfv4

Measuring Crowdsourcing Effort with Error-Time Curves

Justin Cheng, Jaime Teevan, Michael S. Bernstein
2015 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15  
In order to capture how well people do a task, ETA requires ground truth. We extend the metric to also work for subjective tasks.  ...  However, these reviews are limited in number, lag the marketplace by hours, and not available for all tasks.  ...  ACKNOWLEDGMENTS This work was supported in part by NSF award IIS-1351131.  ... 
doi:10.1145/2702123.2702145 dblp:conf/chi/ChengTB15 fatcat:xrr3etp7qrha7o2fx2rf2wf6pi

Crowdsourcing Accessibility: Human-Powered Access Technologies

Erin Brady, Jeffrey P. Bigham
2015 Foundations and Trends® in Human–Computer Interaction  
Acknowledgements This work has been supported by National Science Foundation Award #IIS-1149709, an Alfred P.  ...  Sloan Foundation Fellowship, and by a grant from the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) (#90DP0061-01-00).  ...  on pay-for-work sites.  ... 
doi:10.1561/1100000050 fatcat:m5nv2m55rnctndrgietkexypje

Architecting Real-Time Crowd-Powered Systems

Walter S Lasecki, Christopher Homan, Jeffrey P. Bigham
2014 Human Computation  
In this paper, we present techniques for building real-time crowdsourcing systems, and then discuss how and when to use them.  ...  While it has primarily been used for tasks that are not time-sensitive, recent systems use crowdsourcing to get on-demand, real-time, and even interactive results.  ...  ACKNOWLEDGEMENTS This work has been supported by the National Science Foundation (under awards #IIS-1149709, #IIS-1218209, and #SES-1111016)  ... 
doi:10.15346/hc.v1i1.5 dblp:journals/hc/LaseckiHB14 fatcat:mdzsgjs2cja47flzmv3wexxirq

Crowdsourced Data Management: Industry and Academic Perspectives

Adam Marcus, Aditya Parameswaran
2015 Foundations and Trends in Databases  
., Google, Facebook, Microsoft) and 4 marketplace providers of crowd work (e.g., CrowdFlower, Upwork) to identify how hundreds of engineers and tens of million dollars are invested in various crowdsourcing  ...  Over the next decade, we believe that most technical organizations will in some way benefit from crowd work, and hope that this book can help guide the effective adoption of crowdsourcing across these  ...  This study showed that workers for whom crowd work is their primary source of income, pay becomes a larger incentive for performing tasks.  ... 
doi:10.1561/1900000044 fatcat:rva7dinutnbnlj2hvm4j2hmhge

The motivations and experiences of the on-demand mobile workforce

Rannie Teodoro, Pinar Ozturk, Mor Naaman, Winter Mason, Janne Lindqvist
2014 Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW '14  
Finally, we discuss the key characteristics of the most worthwhile tasks and offer implications for novel crowdsourcing systems for physical world tasks.  ...  The analysis revealed the main drivers for participating in an on-demand mobile workforce, including desires for monetary compensation and control over schedules and task selection.  ...  ACKNOWLEDGMENTS This material is based upon work supported by the National Science Foundation under Grant Numbers 1211079 and 1211084.  ... 
doi:10.1145/2531602.2531680 dblp:conf/cscw/TeodoroONML14 fatcat:pkvwfjeptneirm2ekimuawokpu

A Review of Mobile Crowdsourcing Architectures and Challenges: Toward Crowd-Empowered Internet-of-Things

Jurairat Phuttharak, Seng W. Loke
2019 IEEE Access  
We also provide a critical analysis of some challenges and suggest directions for future work.  ...  , architectures, and key considerations for their development.  ...  They also define the recruitment strategies in five major aspects including using authority, paying users, asking for volunteers, making contributions a requirement to use a different service, and piggybacking  ... 
doi:10.1109/access.2018.2885353 fatcat:vtfbb7ydjre2rfkulrjm6ypyma

Human Computation

Edith Law, Luis von Ahn
2011 Synthesis Lectures on Artificial Intelligence and Machine Learning  
Crowdsourcing marketplaces (e.g., Amazon Mechanical Turk) are human computation systems that coordinate workers to perform tasks in exchange for monetary rewards.  ...  , including AI, Machine Learning, HCI, Mechanism/Market Design and Psychology, and capturing their unique perspectives on the core research questions in human computation; and (4) suggesting promising  ...  Acknowledgments As a relatively young field, the idea of human computation is not yet well defined.This book is in part an accumulation of ideas from people in the field with whom we had discussions and  ... 
doi:10.2200/s00371ed1v01y201107aim013 fatcat:fxuui3q2yrgddf5ewih562zgza


Daniel W. Barowy, Emery D. Berger, Daniel G. Goldstein, Siddharth Suri
2017 Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17  
Quality control for such estimated values is challenging because prior, consensus-based approaches for quality control in labeling tasks are not applicable in estimation tasks.  ...  We present VOXPL, a high-level programming framework that automatically obtains high-quality crowdsourced estimates of values.  ...  Price and his graduate students at Brigham Young University who gathered the photos and menus for the calorie dataset, and the NPR Planet Money team who gathered crowd guesses about Penelope the cow's  ... 
doi:10.1145/3025453.3026025 dblp:conf/chi/BarowyBGS17 fatcat:rhrhnn5mlvai3aeupo2ssz3bsq

Recruiting large online samples in the United States and India: Facebook, Mechanical Turk, and Qualtrics

Taylor C. Boas, Dino P. Christenson, David M. Glick
2018 Political Science Research and Methods  
AbstractThis article examines online recruitment via Facebook, Mechanical Turk (MTurk), and Qualtrics panels in India and the United States.  ...  In the United States, MTurk offers the cheapest and fastest recruitment, Qualtrics is most demographically and politically representative, and Facebook facilitates targeted sampling.  ...  For helpful comments and suggestions, the authors are grateful to Azer Bestavros, Jennifer Bussell, John Byers, Simon Chauchard, Doug Kriner, Michele Margolis, Ryan Moore, Irfan Nooruddin, and Cesar Zucco  ... 
doi:10.1017/psrm.2018.28 fatcat:md2zhhbe4fffdcutxm3xowjr5m

A location-based incentive mechanism for participatory sensing systems with budget constraints

Luis G. Jaimes, Idalides Vergara-Laurens, Miguel A. Labrador
2012 2012 IEEE International Conference on Pervasive Computing and Communications  
Sarkar and Dr. Moreno, for being in my committee and for their valuable comments and suggestions.  ...  I am also grateful to him for his extended support and guidance throughout the course of this work, and for making my study at USF a pleasant and exciting educational experience.  ...  In the former, the amount to pay to each participant is estimated in advance and the amount may differ for each participant.  ... 
doi:10.1109/percom.2012.6199855 dblp:conf/percom/JaimesVL12 fatcat:ftwpsstftrf2dgg4flqkmdvxzu

BudgetMap: Engaging Taxpayers in the Issue-Driven Classification of a Government Budget

Nam Wook Kim, Jonghyuk Jung, Eun-Young Ko, Songyi Han, Chang Won Lee, Juho Kim, Jihee Kim
2016 Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing - CSCW '16  
In this paper, we present BudgetMap, an issue-driven classification and navigation interface for the budgets of government programs.  ...  Despite recent efforts in opening up government data, developing tools for taxpayers to make sense of extensive and multi-faceted budget data remains an open challenge.  ...  ACKNOWLEDGMENTS This research is supported by the Undergraduate Research Program and High-Risk High-Return Program at KAIST. Nam Wook Kim is partly supported by the Kwanjeong Educational Foundation.  ... 
doi:10.1145/2818048.2820004 dblp:conf/cscw/KimJKHLKK16 fatcat:o4vbwghcpjfcnn26zla7ke7xa4

A Survey of Experimental Research on Contests, All-Pay Auctions and Tournaments A Survey of Experimental Research on Contests, All-Pay Auctions and Tournaments Comments Working Paper 12-22 A Survey of Experimental Research on Contests, All-Pay Auctions and Tournaments

Emmanuel Dechenaux, Dan Kovenock, Roman Sheremeta, Emmanuel Dechenaux, Dan Kovenock, Roman Sheremeta, Mike Caldara, Tim Cason, Gary Charness, Subhasish Chowdhury, Cary Deck, John Duffy (+25 others)
2012 unpublished
Finally, we discuss applications of contests to the study of legal systems, political competition, war, conflict avoidance, sales, and charities, and suggest directions for future research.  ...  Many economic, political and social environments can be described as contests in which agents exert costly efforts while competing over the distribution of a scarce resource.  ...  Therefore, there is a tradeoff between paying a high cost to win the conflict in the current stage and enjoying higher payoff in the consecutive stages.  ... 

A Survey on Mobile Crowdsensing Systems: Challenges, Solutions and Opportunities

Andrea Capponi, Claudio Fiandrino, Burak Kantarci, Luca Foschini, Dzmitry Kliazovich, Pascal Bouvry
2019 IEEE Communications Surveys and Tutorials  
For this reason, MCS frameworks are specifically designed to include incentive mechanisms and address privacy concerns.  ...  In this paper, we take the research on MCS a step further by presenting a survey on existing works in the domain and propose a detailed taxonomy to shed light on the current landscape and classify applications  ...  Finally, one among the first works proposing incentives for crowdsourcing considers two incentive methods, a platform-centric model and a user-centric model [227] .  ... 
doi:10.1109/comst.2019.2914030 fatcat:psvt24nrjbcldpixw6b7stzm3a
« Previous Showing results 1 — 15 out of 137 results