6 Hits in 2.0 sec

Crowd Guilds: Worker-led Reputation and Feedback on Crowdsourcing Platforms [article]

Mark E. Whiting, Dilrukshi Gamage, Snehalkumar S. Gaikwad, Aaron Gilbee, Shirish Goyal, Alipta Ballav, Dinesh Majeti, Nalin Chhibber, Angela Richmond-Fuller, Freddie Vargus, Tejas Seshadri Sarma, Varshine Chandrakanthan (+14 others)
2016 arXiv   pre-print
A two-week field experiment compared crowd guilds to a traditional decentralized crowd work model.  ...  Reputation is one central example: crowdsourcing systems depend on reputation scores from decentralized workers and requesters, but these scores are notoriously inflated and uninformative.  ...  In the future, we hope to analyze variation in guild governance policies to better understand the forms of self-governance that predict long-term engagement and satisfaction.  ... 
arXiv:1611.01572v2 fatcat:zn2vdnlforahpcsziytvlmlyyy

Worker-Owned Cooperative Models for Training Artificial Intelligence

Anand Sriraman, Jonathan Bragg, Anand Kulkarni
2017 Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17 Companion  
Workers on virtual labor marketplaces accelerate this process by generating training data for AI systems.  ...  We propose a new model where workers earn ownership of trained AI systems, allowing them to draw a long-term royalty from a tool that replaces their labor.  ...  Acknowledgements We thank the CrowdCamp workshop at the Fourth AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2016) for supporting this work and the participants for useful discussions.  ... 
doi:10.1145/3022198.3026356 fatcat:46axt7px5vbq7p5yrle2v63sfi

VizNet: Towards A Large-Scale Visualization Learning and Benchmarking Repository [article]

Kevin Hu and Neil Gaikwad and Michiel Bakker and Madelon Hulsebos and Emanuel Zgraggen and César Hidalgo and Tim Kraska and Guoliang Li and Arvind Satyanarayan and Çağatay Demiralp
2019 arXiv   pre-print
To demonstrate VizNet's utility as a platform for conducting online crowdsourced experiments at scale, we replicate a prior study assessing the influence of user task and data distribution on visual encoding  ...  In this paper, we present VizNet: a large-scale corpus of over 31 million datasets compiled from open data repositories and online visualization galleries.  ...  Daemo [21] , a self-governed crowdsourcing marketplace, was instrumental in the creation of the Stanford Question Answering Dataset (SQuAD) [55] , whereas MTurk was used to curate the ImageNet dataset  ... 
arXiv:1905.04616v1 fatcat:d46eqdu55fbv7ely5u7h3jhmnu

Trusts, co-ops, and crowd workers: Could we include crowd data workers as stakeholders in data trust design?

Richard C. Gomer, Elena Simperl
2020 Data & Policy  
In this paper, we report on a preliminary qualitative investigation into how crowd data workers themselves feel datasets should be used and governed.  ...  Data trusts have been proposed as a mechanism through which data can be more readily exploited for a variety of aims, including economic development and social-benefit goals such as medical research or  ...  s "Daemo" marketplace (Gaikwad et al., 2017) demonstrated two design interventions-"Boomerang" and "Prototype tasks"-that improve worker-requester trust by addressing two common source of trust breakdown-flawed  ... 
doi:10.1017/dap.2020.21 fatcat:3h2aypunjvhixjyxo7wzyfid5y

A Software platform design approach for knowledge sharing and self-organization among crowd workers

Julia Filler, Stefan Biffl, Angelika Musil
Crowd work is a popular form of digital work. Anyone can work on crowd work platforms and it is a great way for companies to outsource tasks externally.  ...  The proposed approach follows an architectural design of a collective intelligence system (CIS). A CIS allows indirect communication among the users.  ...  The platforms abused software license agreements as employment contracts and in their terms of use it is governed that a worker is a self-employed person or "independent contractor".  ... 
doi:10.34726/hss.2018.45850 fatcat:e2ajrfdosbf45gbcj2bfcqjr6y

Do You See What I See? Perception and Navigation in Online Deliberation

W. Ben Towne
themselves, but a lot of people each know a piece of the problem or solution.  ...  Some of the most pressing challenges facing humanity today, such as how to respond to climate change or govern the internet, are too complex for any individual or small group to completely understand by  ...  prizes, crowdsourcing, and citizen science (Sinai & Smith, 2013; The Open Government Partnership, 2013).  ... 
doi:10.1184/r1/6716099.v1 fatcat:g7zrlemgdnhmbold6mtjdy7y3a