293 Hits in 3.5 sec

Toward a Contextual Theory of Turnover Intention in Online Crowdworking

Xiao Ma, Lara Khansa, Jinghui Hou
2016 International Conference on Information Systems  
in online Crowdworking (COMTIC).  ...  We discuss the theoretical implications of the proposed COMTIC framework and offer practical insights for existent and future crowdworking marketplaces.  ...  We expect the importance of fairness of rewards in the IS field to carry through to the crowdworking context.  ... 
dblp:conf/icis/MaKH16 fatcat:o4px6zeno5gf3iliiwicky5rmm

Antecedents of Perceived Fairness in Pay for Microtask Crowdwork

Paul Alpar, Lars Osterbrink
2018 European Conference on Information Systems  
Crowdwork has become a powerful tool for businesses and researchers to get work done in a fast, convenient, and cheap way.  ...  On the other hand, recent research and ethical considerations suggest that poor payments and especially a low perceived fairness in pay may come at a price.  ...  Distributive fairness concerns the perceived fairness of outcome distribution among actors while procedural fairness concerns the perceived fairness in the process of distributing that value.  ... 
dblp:conf/ecis/AlparO18 fatcat:6luacs7vanbmvmf7h4cujcq75m

Is There PAPA in Crowd Work?: A Literature Review on Ethical Dimensions in Crowdsourcing

David Durward, Ivo Blohm, Jan Marco Leimeister
2016 2016 Intl IEEE Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld)  
The review focuses on the individual perspective of crowdworkers, which addresses their working conditions and benefits.  ...  Although, the literature review exhibits that there are PAPA dimensions in crowdsourcing, only few focus on the crowdworkers as individuals.  ...  The Accuracy of the Crowdworkers In context of technology, Ågerfalk and Fitzgerald [38] include quality and transparency of information and processes within crowdsourcing as issues of accuracy.  ... 
doi:10.1109/uic-atc-scalcom-cbdcom-iop-smartworld.2016.0131 dblp:conf/uic/DurwardBL16 fatcat:dzzghaxrr5es5ousdmqppayl7a

Beyond Fair Pay: Ethical Implications of NLP Crowdsourcing [article]

Boaz Shmueli, Jan Fell, Soumya Ray, Lun-Wei Ku
2021 arXiv   pre-print
The use of crowdworkers in NLP research is growing rapidly, in tandem with the exponential increase in research production in machine learning and AI.  ...  Ethical discussion regarding the use of crowdworkers within the NLP research community is typically confined in scope to issues related to labor conditions such as fair pay.  ...  This research was partially supported by the Ministry of Science and Technology in Taiwan under grants MOST 108-2221-E-001-012-MY3 and MOST 109-2221-E-001-015- [sic].  ... 
arXiv:2104.10097v1 fatcat:qjlcivrkrfhmffyauvnxipmcfy

Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation [article]

Emily Denton, Mark Díaz, Ian Kivlichan, Vinodkumar Prabhakaran, Rachel Rosen
2021 arXiv   pre-print
However, the ethical considerations around the processes and decisions that go into building ML datasets has not received nearly enough attention.  ...  Human annotations play a crucial role in machine learning (ML) research and development.  ...  Re-Imagining Algorithmic Fairness in India and Beyond. In Pro- ceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’21).  ... 
arXiv:2112.04554v1 fatcat:h4op2dorcnd55hehbidy44c7am

Context-Aware Asset Search for Graphic Design

Balazs Kovacs, Peter 'Donovan, Kavita Bala, Aaron Hertzmann
2018 IEEE Transactions on Visualization and Computer Graphics  
This paper proposes Context-Aware Asset Search tools that take the current state of the user's design into account, thereby providing search and selections that are compatible with the current design and  ...  In particular, we focus on image search and color selection, two tasks that are central to design. We learn a model for compatibility of images and colors within a design, using crowdsourced data.  ...  This work was supported by the National Science Foundation (grant IIS-1617861), and Adobe.  ... 
doi:10.1109/tvcg.2018.2842734 pmid:29993550 fatcat:2jl76uqw4rhtfpjjmb6nf3ypdy

Justice for the Crowd: Organizational Justice and Turnover in Crowd-Based Labor

Xiaochuan Song, Graham H. Lowman, Peter Harms
2020 Administrative Sciences  
In doing so, we provide a novel conceptual model for advancing nascent research on crowd-based worker perceptions and turnover.  ...  crowd-based work context.  ...  Acknowledgments: This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.  ... 
doi:10.3390/admsci10040093 fatcat:ktbcifmhpbfitbdqis4x45etli

What Makes an Image Tagger Fair? Proprietary Auto-tagging and Interpretations on People Images

Barlas Pinar, Kleanthous Styliani, Kyriakou Kyriakos, Otterbacher Jahna
2019 Zenodo  
They are then asked to indicate which is "more fair" in the context of a dating site, and explain their reasoning.  ...  We relate our work to the ongoing conversation about fairness in opaque tools like image tagging APIs, and their potential to result in harm.  ...  ACKNOWLEDGMENTS This project is partially funded by the European Union's Horizon 2020 research and innovation programme under grant agreements No. 739578 (RISE), 810105 (CyCAT) and the Government of the  ... 
doi:10.5281/zenodo.3522923 fatcat:56j6nqealfdnflbohyzo2angqa

LaMDA: Language Models for Dialog Applications [article]

Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee (+48 others)
2022 arXiv   pre-print
Finally, we explore the use of LaMDA in the domains of education and content recommendations, and analyze their helpfulness and role consistency.  ...  We quantify safety using a metric based on an illustrative set of human values, and we find that filtering candidate responses using a LaMDA classifier fine-tuned with a small amount of crowdworker-annotated  ...  Hao Zhou for their help with the paper and the project.  ... 
arXiv:2201.08239v3 fatcat:mijuot4z3bdzxa6qplbjrucrem

CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation [article]

Mark Diaz, Ian D. Kivlichan, Rachel Rosen, Dylan K. Baker, Razvan Amironesei, Vinodkumar Prabhakaran, Emily Denton
2022 arXiv   pre-print
However, the ethical considerations around the processes and decisions that go into dataset annotation have not received nearly enough attention.  ...  Human annotated data plays a crucial role in machine learning (ML) research and development.  ...  For instance, in the U.S., there are currently no regulations around worker pay for crowdwork [7] , and the Fair Labor Standards Act that established the minimum wage, 3 is not applicable for crowdworkers  ... 
arXiv:2206.08931v1 fatcat:u6kfltt2bregffu6yn6wh3b7xi

Monotasking or Multitasking

Laura Lascau, Sandy J. J. Gould, Anna L. Cox, Elizaveta Karmannaya, Duncan P. Brumby
2019 Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19  
Likewise, we also would like to thank Manish Bhatia and Marie Mento for their input. We thank the workers who took the time to participate in our study.  ...  Finally, we thank Jake Rigby and Judith Borghouts for helping us visualize the data. This work was supported by the UK Engineering and Physical Sciences Research Council grant EP/L504889/1.  ...  DISCUSSION In this section we present our recommendations for supporting crowdworkers.  ... 
doi:10.1145/3290605.3300649 dblp:conf/chi/LascauGCKB19 fatcat:mkarum4dc5hn3odoe3xom6neta

Crowdsourcing Perceptions of Fair Predictors for Machine Learning

Niels van Berkel, Jorge Goncalves, Danula Hettiachchi, Senuri Wijenayake, Ryan M. Kelly, Vassilis Kostakos
2019 Proceedings of the ACM on Human-Computer Interaction  
The increased reliance on algorithmic decision-making in socially impactful processes has intensified the calls for algorithms that are unbiased and procedurally fair.  ...  The presented workflow, which provides a scalable and practical approach to reach a diverse audience, allows researchers to capture participants' perceptions of fairness in private while simultaneously  ...  Furthermore, we ensured that the script did not recommend parameters for removal, so as to avoid biasing participants. We provide a visual summary of the interaction process in Figure 2 .  ... 
doi:10.1145/3359130 fatcat:roltgi55prdwxd6kdy5jbtjxqi

TourExplain: A Crowdsourcing Pipeline for Generating Explanations for Groups of Tourists

Öykü Kapcak, Simone Spagnoli, Vincent Robbemond, Soumitri Vadali, Shabnam Najafian, Nava Tintarev
2018 ACM Conference on Recommender Systems  
In this paper, we introduce TourExplain, an automated crowdsourcing pipeline to generate and evaluate explanations for groups with the aim of improving our initial proposed explanations by relying on the  ...  When a group is traveling together it is challenging to recommend an itinerary consisting of several points of interest (POIs).  ...  In order to personalized the preference aggregation algorithms and their corresponding explanations as well as make our recommendations group-aware, we plan to use the Thomas-Kilmann Conflict Style Model  ... 
dblp:conf/recsys/KapcakSRVNT18 fatcat:sds52prkrrezvozbmegv5gwshq

CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models [article]

Nikita Nangia, Clara Vania, Rasika Bhalerao, Samuel R. Bowman
2020 arXiv   pre-print
In CrowS-Pairs a model is presented with two sentences: one that is more stereotyping and another that is less stereotyping.  ...  CrowS-Pairs has 1508 examples that cover stereotypes dealing with nine types of bias, like race, religion, and age.  ...  Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.  ... 
arXiv:2010.00133v1 fatcat:dbptz2ucmnftfkemhkpthluafa

Labeling instructions matter in biomedical image analysis [article]

Tim Rädsch, Annika Reinke, Vivienn Weru, Minu D. Tizabi, Nicholas Schreck, A. Emre Kavur, Bünyamin Pekdemir, Tobias Roß, Annette Kopp-Schneider, Lena Maier-Hein
2022 arXiv   pre-print
Finally, professional annotators constantly outperform MTurk crowdworkers. Our study raises awareness for the need of quality standards in biomedical image analysis labeling instructions.  ...  Here, we present the first systematic study of labeling instructions and their impact on annotation quality in the field.  ...  ACKNOWLEDGEMENTS, Karlsruhe provided the annotations for this work and funded a part of this work, namely Marc Mengler and Dr. Simon Funke.  ... 
arXiv:2207.09899v1 fatcat:7c2e3ynvajhyxe2dka3xnirtdi
« Previous Showing results 1 — 15 out of 293 results