Filters








552 Hits in 6.9 sec

All Those Wasted Hours

Lei Han, Kevin Roitero, Ujwal Gadiraju, Cristina Sarasua, Alessandro Checco, Eddy Maddalena, Gianluca Demartini
2019 Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining - WSDM '19  
On crowdsourcing platforms like Amazon MTurk or FigureEight, crowd workers select tasks to work on based on diferent dimensions such as task reward and requester reputation.  ...  In this paper, we conduct the irst investigation into the phenomenon of task abandonment, the act of workers previewing or beginning a task and deciding not to complete it.  ...  The total efort invested by abandoning workers accounts for 616 hours of work which are equivalent to about 3.5 months FTE. • Task abandonment is relatively more frequent for workers on F8 than on AMT.  ... 
doi:10.1145/3289600.3291035 dblp:conf/wsdm/HanRGSCMD19 fatcat:qpgkncqpyrbzlm4hystk6vndgm

Understanding the Impact of Text Highlighting in Crowdsourcing Tasks [article]

Jorge Ramírez, Marcos Baez, Fabio Casati, Boualem Benatallah
2019 arXiv   pre-print
Text classification is one of the most common goals of machine learning (ML) projects, and also one of the most frequent human intelligence tasks in crowdsourcing platforms.  ...  ML has mixed success in such tasks depending on the nature of the problem, while crowd-based classification has proven to be surprisingly effective, but can be expensive.  ...  Introduction Text classification is one of the most fundamental problems of machine learning (ML) projects (Aggarwal and Zhai 2012) , and also one of the most frequent human intelligence tasks in crowdsourcing  ... 
arXiv:1909.02780v1 fatcat:xved7wpk3bejxhs6wfo4s5222e

Final Guidelines for Task Design

Neal Reeves
2021 Zenodo  
This deliverable presents final guidelines on task design, building on earlier deliverable 5.1. We present high level recommendations from citizen science and scientific crowdsourcing administrators.  ...  We also present research conducted by the ACTION consortium on the topic of task design.  ...  Projects are launched during an initial one-hour live show, with updates 24 hours later live on air and 'final results' (as available) are revealed in a final broadcast 48 hours after the first launch.  ... 
doi:10.5281/zenodo.4544280 fatcat:jhwpgj5x4zhsfc4c4omzn7oooa

AutoMan

Daniel W. Barowy, Charlie Curtsinger, Emery D. Berger, Andrew McGregor
2012 Proceedings of the ACM international conference on Object oriented programming systems languages and applications - OOPSLA '12  
Crowdsourcing platforms like Amazon's Mechanical Turk make it possible to harness human-based computational power on an unprecedented scale.  ...  The AUTOMAN runtime system then transparently manages all details necessary for scheduling, pricing, and quality control.  ...  AUTOMAN handles scheduling of all real tasks in the target crowdsourcing system.  ... 
doi:10.1145/2384616.2384663 dblp:conf/oopsla/BarowyCBM12 fatcat:k26bg7rrvbb6hcgzy5kyazaoki

Crowdsourcing GUI Tests

Eelco Dolstra, Raynor Vliegendhart, Johan Pouwelse
2013 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation  
In this paper, we show that it is possible to crowdsource GUI tests, that is, to outsource them to individuals drawn from a very large pool of workers on the Internet.  ...  Several large experiments on the Amazon Mechanical Turk demonstrate that our approach is technically feasible and sufficiently reliable.  ...  all workers who participated in our HITs.  ... 
doi:10.1109/icst.2013.44 dblp:conf/icst/DolstraVP13 fatcat:yvqiwlxppvhdjaoortg25wqspa

Crowds in two seconds

Michael S. Bernstein, Joel Brandt, Robert C. Miller, David R. Karger
2011 Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11  
In this paper, we introduce the use of synchronous crowds for ondemand, realtime crowdsourcing.  ...  We develop techniques that recruit synchronous crowds in two seconds and use them to execute complex search tasks in ten seconds.  ...  Paying a half-cent per minute on retainer and with no wasted tasks, one worker on retainer costs 30¢ per hour.  ... 
doi:10.1145/2047196.2047201 dblp:conf/uist/BernsteinBMK11 fatcat:hq6bpfe5enaxxp7a62pm5ygonu

CLAMShell: Speeding up Crowds for Low-latency Data Labeling [article]

Daniel Haas, Jiannan Wang, Eugene Wu, Michael J. Franklin
2015 arXiv   pre-print
We evaluate CLAMShell in simulation and on live workers on Amazon's Mechanical Turk, demonstrating that our techniques can provide an order of magnitude speedup and variance reduction over existing crowdsourced  ...  In this paper, we introduce CLAMShell, a system that speeds up crowds in order to achieve consistently low-latency data labeling.  ...  However, most research has focused only on the trade-off between quality and cost, with work on crowdsourcing routinely reporting task latencies on the order of minutes to hours to complete an average  ... 
arXiv:1509.05969v1 fatcat:hgoojt23tvf5fpmffomu44x74y

CLAMShell

Daniel Haas, Jiannan Wang, Eugene Wu, Michael J. Franklin
2015 Proceedings of the VLDB Endowment  
We evaluate CLAMShell in simulation and on live workers on Amazon's Mechanical Turk, demonstrating that our techniques can provide an order of magnitude speedup and variance reduction over existing crowdsourced  ...  In this paper, we introduce CLAMShell, a system that speeds up crowds in order to achieve consistently low-latency data labeling.  ...  In addition, even workers who are very fast on average (∼ 1 minute) can take as long as an hour or more to complete some tasks.  ... 
doi:10.14778/2856318.2856331 fatcat:rv5kbjdzijesjb5mkzpwjmsts4

Once Upon A Time In Visualization: Understanding the Use of Textual Narratives for Causality [article]

Arjun Choudhry, Mandar Sharma, Pramod Chundury, Thomas Kapler, Derek W.S. Gray, Naren Ramakrishnan, Niklas Elmqvist
2020 arXiv   pre-print
Causality visualization can help people understand temporal chains of events, such as messages sent in a distributed system, cause and effect in a historical conflict, or the interplay between political  ...  The system incorporates an automatic textual narrative mechanism based on our design space. We validate CAUSEWORKS through interviews with experts who used the system for understanding complex events.  ...  The authors wish to thank all DARPA Causal Exploration collaborators for their support and encouragement.  ... 
arXiv:2009.02649v1 fatcat:5j725mocnffx7kc7cngpu73kuy

Bird detection in audio: A survey and a challenge

Dan Stowell, Mike Wood, Yannis Stylianou, Herve Glotin
2016 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP)  
We review the state of the art in automatic bird sound detection, and identify a widespread need for tuning-free and species-agnostic approaches.  ...  Many biological monitoring projects rely on acoustic detection of birds. Despite increasingly large datasets, this detection is often manual or semi-automatic, requiring manual tuning/postprocessing.  ...  all have to be of the same type)  ... 
doi:10.1109/mlsp.2016.7738875 dblp:conf/mlsp/StowellWSG16 fatcat:rhvxdlxmc5c2jdzfh42ivsz6wm

Bird detection in audio: a survey and a challenge [article]

Dan Stowell, Mike Wood, Yannis Stylianou, Hervé Glotin
2016 arXiv   pre-print
We review the state of the art in automatic bird sound detection, and identify a widespread need for tuning-free and species-agnostic approaches.  ...  Many biological monitoring projects rely on acoustic detection of birds. Despite increasingly large datasets, this detection is often manual or semi-automatic, requiring manual tuning/postprocessing.  ...  all have to be of the same type)  ... 
arXiv:1608.03417v1 fatcat:ahdjswz7izcq3efgzh2nx7pbte

Crowdsourcing Accessibility: Human-Powered Access Technologies

Erin Brady, Jeffrey P. Bigham
2015 Foundations and Trends® in Human–Computer Interaction  
Sloan Foundation Fellowship, and by a grant from the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) (#90DP0061-01-00).  ...  The ESP Game and Phetch both turn image labeling into a game, and many workers on Mechanical Turk report participating in tasks for fun, or working longer on tasks that are enjoyable than those that are  ...  Tasks The type of tasks performed in Social Accessibility may vary in type and length, though they are all related to metadata authoring.  ... 
doi:10.1561/1100000050 fatcat:m5nv2m55rnctndrgietkexypje

Transcription maximized; expense minimized? Crowdsourcing and editing The Collected Works of Jeremy Bentham*

T. Causer, J. Tonra, V. Wallace
2012 Literary and Linguistic Computing  
Thanks also to our two referees, whose comments and suggestions have also been extremely helpful in finalising the paper.  ...  Acknowledgements The authors would like to thank our Transcribe Bentham colleagues: Philip Schofield, Richard Davis and his team, Martin Moyle, Tony Slade, and Melissa Terras; and all of the volunteer  ...  progress, and not waste their time.  ... 
doi:10.1093/llc/fqs004 fatcat:jmkkkocb4nezvinrbebsrpbtoa

RaceMob

Baris Kasikci, Cristian Zamfir, George Candea
2013 Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles - SOSP '13  
It achieves low runtime overhead and a high degree of realism by combining real-user crowdsourcing with a new on-demand dynamic data race validation technique.  ...  To the best of our knowledge, Race-Mob is the first data race detector that can both be used always-on in production and provides good accuracy.  ...  This work was supported in part by ERC Starting Grant No. 278656 and by gifts from Google and Intel.  ... 
doi:10.1145/2517349.2522736 dblp:conf/sosp/KasikciZC13 fatcat:spegfcyupnhmrdmxctt57ztade

The Impact of Emerging Information Technologies on the Employment Relationship: New Gigs for Labor and Employment Law

Kenneth Glenn Dau-Schmidt
2017 Social Science Research Network  
On AMT, a subscribing party who wants to crowdsource work lists a "request" for a specified job or "human intelligence task" (HIT), along with the rate of pay and performance deadline.  ...  "Work on Demand" and "Crowdsourcing" Two recent special cases of outsourcing made possible by information technology, and that merit separate discussion, are "work on demand" and "crowdsourcing."  ... 
doi:10.2139/ssrn.2951967 fatcat:c273lsilwzezrebi3xp5yrg4bi
« Previous Showing results 1 — 15 out of 552 results