A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
Filters
Toward a Contextual Theory of Turnover Intention in Online Crowdworking
2016
International Conference on Information Systems
Preserved Fulltext
in online Crowdworking (COMTIC). ...
We discuss the theoretical implications of the proposed COMTIC framework and offer practical insights for existent and future crowdworking marketplaces. ...
We expect the importance of fairness of rewards in the IS field to carry through to the crowdworking context. ...
dblp:conf/icis/MaKH16
fatcat:o4px6zeno5gf3iliiwicky5rmm
Antecedents of Perceived Fairness in Pay for Microtask Crowdwork
2018
European Conference on Information Systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
Crowdwork has become a powerful tool for businesses and researchers to get work done in a fast, convenient, and cheap way. ...
On the other hand, recent research and ethical considerations suggest that poor payments and especially a low perceived fairness in pay may come at a price. ...
Distributive fairness concerns the perceived fairness of outcome distribution among actors while procedural fairness concerns the perceived fairness in the process of distributing that value. ...
dblp:conf/ecis/AlparO18
fatcat:6luacs7vanbmvmf7h4cujcq75m
Is There PAPA in Crowd Work?: A Literature Review on Ethical Dimensions in Crowdsourcing
2016
2016 Intl IEEE Conferences on Ubiquitous Intelligence & Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People, and Smart World Congress (UIC/ATC/ScalCom/CBDCom/IoP/SmartWorld)
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
The review focuses on the individual perspective of crowdworkers, which addresses their working conditions and benefits. ...
Although, the literature review exhibits that there are PAPA dimensions in crowdsourcing, only few focus on the crowdworkers as individuals. ...
The Accuracy of the Crowdworkers In context of technology, Ågerfalk and Fitzgerald [38] include quality and transparency of information and processes within crowdsourcing as issues of accuracy. ...
doi:10.1109/uic-atc-scalcom-cbdcom-iop-smartworld.2016.0131
dblp:conf/uic/DurwardBL16
fatcat:dzzghaxrr5es5ousdmqppayl7a
Beyond Fair Pay: Ethical Implications of NLP Crowdsourcing
[article]
2021
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
The use of crowdworkers in NLP research is growing rapidly, in tandem with the exponential increase in research production in machine learning and AI. ...
Ethical discussion regarding the use of crowdworkers within the NLP research community is typically confined in scope to issues related to labor conditions such as fair pay. ...
This research was partially supported by the Ministry of Science and Technology in Taiwan under grants MOST 108-2221-E-001-012-MY3 and MOST 109-2221-E-001-015- [sic]. ...
arXiv:2104.10097v1
fatcat:qjlcivrkrfhmffyauvnxipmcfy
Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation
[article]
2021
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2021; you can also visit the original URL.
The file type is application/pdf.
However, the ethical considerations around the processes and decisions that go into building ML datasets has not received nearly enough attention. ...
Human annotations play a crucial role in machine learning (ML) research and development. ...
Re-Imagining Algorithmic Fairness in India and Beyond. In Pro-
ceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
(FAccT ’21). ...
arXiv:2112.04554v1
fatcat:h4op2dorcnd55hehbidy44c7am
Context-Aware Asset Search for Graphic Design
2018
IEEE Transactions on Visualization and Computer Graphics
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2019; you can also visit the original URL.
The file type is application/pdf.
This paper proposes Context-Aware Asset Search tools that take the current state of the user's design into account, thereby providing search and selections that are compatible with the current design and ...
In particular, we focus on image search and color selection, two tasks that are central to design. We learn a model for compatibility of images and colors within a design, using crowdsourced data. ...
This work was supported by the National Science Foundation (grant IIS-1617861), and Adobe. ...
doi:10.1109/tvcg.2018.2842734
pmid:29993550
fatcat:2jl76uqw4rhtfpjjmb6nf3ypdy
Justice for the Crowd: Organizational Justice and Turnover in Crowd-Based Labor
2020
Administrative Sciences
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
In doing so, we provide a novel conceptual model for advancing nascent research on crowd-based worker perceptions and turnover. ...
crowd-based work context. ...
Acknowledgments: This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. ...
doi:10.3390/admsci10040093
fatcat:ktbcifmhpbfitbdqis4x45etli
What Makes an Image Tagger Fair? Proprietary Auto-tagging and Interpretations on People Images
2019
Zenodo
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
They are then asked to indicate which is "more fair" in the context of a dating site, and explain their reasoning. ...
We relate our work to the ongoing conversation about fairness in opaque tools like image tagging APIs, and their potential to result in harm. ...
ACKNOWLEDGMENTS This project is partially funded by the European Union's Horizon 2020 research and innovation programme under grant agreements No. 739578 (RISE), 810105 (CyCAT) and the Government of the ...
doi:10.5281/zenodo.3522923
fatcat:56j6nqealfdnflbohyzo2angqa
LaMDA: Language Models for Dialog Applications
[article]
2022
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
Other Versions
Finally, we explore the use of LaMDA in the domains of education and content recommendations, and analyze their helpfulness and role consistency. ...
We quantify safety using a metric based on an illustrative set of human values, and we find that filtering candidate responses using a LaMDA classifier fine-tuned with a small amount of crowdworker-annotated ...
Hao Zhou for their help with the paper and the project. ...
arXiv:2201.08239v3
fatcat:mijuot4z3bdzxa6qplbjrucrem
CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation
[article]
2022
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
Other Versions
2022
2022 ACM Conference on Fairness, Accountability, and Transparency
unpublished
doi:10.1145/3531146.3534647 fatcat:2rvfrmvie5bmnac56lbfvemjuu
doi:10.1145/3531146.3534647 fatcat:2rvfrmvie5bmnac56lbfvemjuu
However, the ethical considerations around the processes and decisions that go into dataset annotation have not received nearly enough attention. ...
Human annotated data plays a crucial role in machine learning (ML) research and development. ...
For instance, in the U.S., there are currently no regulations around worker pay for crowdwork [7] , and the Fair Labor Standards Act that established the minimum wage, 3 is not applicable for crowdworkers ...
arXiv:2206.08931v1
fatcat:u6kfltt2bregffu6yn6wh3b7xi
Monotasking or Multitasking
2019
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
Likewise, we also would like to thank Manish Bhatia and Marie Mento for their input. We thank the workers who took the time to participate in our study. ...
Finally, we thank Jake Rigby and Judith Borghouts for helping us visualize the data. This work was supported by the UK Engineering and Physical Sciences Research Council grant EP/L504889/1. ...
DISCUSSION In this section we present our recommendations for supporting crowdworkers. ...
doi:10.1145/3290605.3300649
dblp:conf/chi/LascauGCKB19
fatcat:mkarum4dc5hn3odoe3xom6neta
Crowdsourcing Perceptions of Fair Predictors for Machine Learning
2019
Proceedings of the ACM on Human-Computer Interaction
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
The increased reliance on algorithmic decision-making in socially impactful processes has intensified the calls for algorithms that are unbiased and procedurally fair. ...
The presented workflow, which provides a scalable and practical approach to reach a diverse audience, allows researchers to capture participants' perceptions of fairness in private while simultaneously ...
Furthermore, we ensured that the script did not recommend parameters for removal, so as to avoid biasing participants. We provide a visual summary of the interaction process in Figure 2 . ...
doi:10.1145/3359130
fatcat:roltgi55prdwxd6kdy5jbtjxqi
TourExplain: A Crowdsourcing Pipeline for Generating Explanations for Groups of Tourists
2018
ACM Conference on Recommender Systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
In this paper, we introduce TourExplain, an automated crowdsourcing pipeline to generate and evaluate explanations for groups with the aim of improving our initial proposed explanations by relying on the ...
When a group is traveling together it is challenging to recommend an itinerary consisting of several points of interest (POIs). ...
In order to personalized the preference aggregation algorithms and their corresponding explanations as well as make our recommendations group-aware, we plan to use the Thomas-Kilmann Conflict Style Model ...
dblp:conf/recsys/KapcakSRVNT18
fatcat:sds52prkrrezvozbmegv5gwshq
CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
[article]
2020
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
In CrowS-Pairs a model is presented with two sentences: one that is more stereotyping and another that is less stereotyping. ...
CrowS-Pairs has 1508 examples that cover stereotypes dealing with nine types of bias, like race, religion, and age. ...
Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation. ...
arXiv:2010.00133v1
fatcat:dbptz2ucmnftfkemhkpthluafa
Labeling instructions matter in biomedical image analysis
[article]
2022
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is application/pdf.
Finally, professional annotators constantly outperform MTurk crowdworkers. Our study raises awareness for the need of quality standards in biomedical image analysis labeling instructions. ...
Here, we present the first systematic study of labeling instructions and their impact on annotation quality in the field. ...
ACKNOWLEDGEMENTS understand.ai, Karlsruhe provided the annotations for this work and funded a part of this work, namely Marc Mengler and Dr. Simon Funke. ...
arXiv:2207.09899v1
fatcat:7c2e3ynvajhyxe2dka3xnirtdi
« Previous
Showing results 1 — 15 out of 293 results