64 Hits in 4.1 sec

A Brief Perspective on Microtask Crowdsourcing Workflows for Interface Design

Mengyao Zhao, Andre van der Hoek
2015 2015 IEEE/ACM 2nd International Workshop on CrowdSourcing in Software Engineering  
In order to make microtask crowdsourcing more supportive for interface design, we need a workflow that can help task owners to break down interface design tasks more easily.  ...  User interface design, as a crucial part of software design, is complex. Current microtask crowdsourcing workflows do not support its complexity well.  ...  These characteristics make microtask crowdsourcing a less effective workflow for interface design in two ways. First, interface design requires iterations.  ... 
doi:10.1109/csi-se.2015.16 dblp:conf/icse/ZhaoH15 fatcat:5k6knhauprfhdmq5sfk5zfagze

Crowdsourcing for bioinformatics

B. M. Good, A. I. Su
2013 Bioinformatics  
Results: Here, we provide a framework for understanding and applying several different types of crowdsourcing.  ...  The framework considers two broad classes: systems for solving large-volume 'microtasks' and systems for solving high-difficulty 'megatasks'.  ...  ACKNOWLEDGEMENTS Thanks to Hassan Masum, Se´bastien Boisvert, Jacques Corbeil, Mark Wilkinson, Attila Csordas and Twitter correspondents for helpful comments on an early draft of this manuscript.  ... 
doi:10.1093/bioinformatics/btt333 pmid:23782614 pmcid:PMC3722523 fatcat:ri3amjraxbg55ky7oh5yjqjfwa

Improving Worker Engagement Through Conversational Microtask Crowdsourcing

Sihang Qiu, Ujwal Gadiraju, Alessandro Bozzon
2020 Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems  
Our findings have important implications on workflows and task design with regard to better engaging workers in microtask crowdsourcing marketplaces.  ...  In this paper, we investigate the effectiveness of using conversational interfaces to improve worker engagement in microtask crowdsourcing.  ...  The reader can directly experience interaction with the conversational interface on the companion page. 1 Workflow of Conversational Microtasking The conversational interface is designed to help workers  ... 
doi:10.1145/3313831.3376403 dblp:conf/chi/QiuGB20 fatcat:fyqkvbocrjcfjfourxk45mhxkq

Collaboratively crowdsourcing workflows with turkomatic

Anand Kulkarni, Matthew Can, Björn Hartmann
2012 Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work - CSCW '12  
Preparing complex jobs for crowdsourcing marketplaces requires careful attention to workflow design, the process of decomposing jobs into multiple tasks, which are solved by multiple workers.  ...  Can the crowd help design such workflows? This paper presents Turkomatic, a tool that recruits crowd workers to aid requesters in planning and solving complex jobs.  ...  Many problems on markets like Amazon Mechanical Turk are solved as a series of microtasks: narrowly focused, brief tasks designed to be completed in a few minutes, such as labeling an image or checking  ... 
doi:10.1145/2145204.2145354 dblp:conf/cscw/KulkarniCH12 fatcat:ktd5nwqg3fduvcdigpvnvi44vu


Anand P. Kulkarni, Matthew Can, Bjoern Hartmann
2011 Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems - CHI EA '11  
On today's human computation systems, designing tasks and workflows is a difficult and labor-intensive process. Can workers from the crowd be used to help plan workflows?  ...  We explore this question with Turkomatic, a new interface to microwork platforms that uses crowd workers to help plan workflows for complex tasks.  ...  Turkomatic is a crowdsourcing interface that consults the crowd to design and execute workflows based on user requests.  ... 
doi:10.1145/1979742.1979865 dblp:conf/chi/KulkarniCH11 fatcat:b3orncdtnjckjkmwa6yy6ohomq

Estimating Conversational Styles in Conversational Microtask Crowdsourcing

Sihang Qiu, Ujwal Gadiraju, Alessandro Bozzon
2020 Proceedings of the ACM on Human-Computer Interaction  
Our findings have important implications on task design with respect to improving worker performance and their engagement in microtask crowdsourcing.  ...  Crowdsourcing marketplaces have provided a large number of opportunities for online workers to earn a living.  ...  Section 3 depicts the workflow and structure of the conversational agent for microtask crowdsourcing, and our design of the conversational user interface.  ... 
doi:10.1145/3392837 fatcat:44wg3mja4bcxdotmt4akn7kxdi

Crowdsourced Data Management: Industry and Academic Perspectives

Adam Marcus, Aditya Parameswaran
2015 Foundations and Trends in Databases  
their designs.  ...  On the academic side, we summarize the state of the art in crowd-powered algorithms and system design tailored to large-scale data processing.  ...  We now present a brief overview of how different academic communities approach crowdsourcing research.  ... 
doi:10.1561/1900000044 fatcat:rva7dinutnbnlj2hvm4j2hmhge

Modus Operandi of Crowd Workers

Ujwal Gadiraju, Alessandro Checco, Neha Gupta, Gianluca Demartini
2017 Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies  
Based on our overall findings resulting from all the three studies, we introduce ModOp, a tool that helps to design crowdsourcing microtasks that are suitable for diverse crowd work environments.  ...  complete microtasks on crowdsourcing platforms.  ...  We believe that our findings will have broad implications on the design and workflow of crowdsourcing microtasks.  ... 
doi:10.1145/3130914 fatcat:ep3biik5ifgp5glxh5rcnk5duu

Geography of Solidarity: Spatial and Temporal Patterns

Noora Al Emadi, Heather Leson, Ji Lucas, Patrick Meier, Javier Borge-Holthoefer
2016 Procedia Engineering  
that augment the information about the disaster for those who work on the ground.  ...  Crowdsourcing technologies represent a paradigm shift in the way certain tasks are performed.  ...  MicroMappers provides an interface to microtask data items allowing participants to make quick decisions about some content's relevance.  ... 
doi:10.1016/j.proeng.2016.08.060 fatcat:hy4ugq5ad5hqldaat7bjnwq3hq

A survey of task-oriented crowdsourcing

Nuno Luz, Nuno Silva, Paulo Novais
2014 Artificial Intelligence Review  
After almost a decade of active research into human computation and crowdsourcing, this paper presents a survey of crowdsourcing human computation systems, with the focus being on solving micro-tasks and  ...  Back in the 1960s however, Licklider (1960) believed that machines and computers were just part of a scale in which computers were on one side and humans on the other (human computation).  ...  It works over Mechanical Turk and is defined as "a crowdsourcing interface that consults the crowd to design and execute workflows based on user requests" (Kulkarni et al. 2011) .  ... 
doi:10.1007/s10462-014-9423-5 fatcat:mpy3ao66prbwpmbu3pniimsg7m

A Glimpse Far into the Future: Understanding Long-term Crowd Worker Quality [article]

Kenji Hata, Ranjay Krishna, Li Fei-Fei, Michael S. Bernstein
2016 arXiv   pre-print
To understand whether workers set their quality based on the task's requirements for acceptance, we then perform an experiment where we vary the required quality for a large crowdsourcing task.  ...  Microtask crowdsourcing is increasingly critical to the creation of extremely large datasets.  ...  From our experiments, we conclude that crowdsourcing workflows should design methods to identify good workers and provide them with the ability to complete tasks with a low threshold for acceptance as  ... 
arXiv:1609.04855v1 fatcat:a7ti5uvzdbdsviydw5fbsejivq

"Why would anybody do this?"

Robin Brewer, Meredith Ringel Morris, Anne Marie Piper
2016 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16  
This paper contributes insights into how crowdsourcing sites could better engage seniors and other users.  ...  Through an online survey with 505 seniors, we found that most have never heard of crowd work but would be motivated to complete tasks by earning money or working on interesting or stimulating tasks.  ...  On average, participants attempted 4 tasks and completed only 1 task, a much lower completion rate than reported in previous studies using crowdsourcing interfaces customized for older adults [25] .  ... 
doi:10.1145/2858036.2858198 dblp:conf/chi/BrewerMP16 fatcat:ibhqyw7mhzdq5crvicl6doy6di

Crowd intelligence in AI 2.0 era

Wei Li, Wen-jun Wu, Huai-min Wang, Xue-qi Cheng, Hua-jun Chen, Zhi-hua Zhou, Rong Ding
2017 Frontiers of Information Technology & Electronic Engineering  
The Internet based cyber-physical world has profoundly changed the information environment for the development of artificial intelligence (AI), bringing a new wave of AI research and promoting it into  ...  As one of the most prominent characteristics of research in AI 2.0 era, crowd intelligence has attracted much attention from both industry and research communities.  ...  However, with the different focuses on crowdsourcing, human computation places more emphasis on the computational microtasks that can be assigned to a group of individuals in a crowdsourcing way.  ... 
doi:10.1631/fitee.1601859 fatcat:x6aijr7ud5eojjuelaq3sv4v7a

Understanding the Crowd: Ethical and Practical Matters in the Academic Use of Crowdsourcing [chapter]

David Martin, Sheelagh Carpendale, Neha Gupta, Tobias Hoßfeld, Babak Naderi, Judith Redi, Ernestasia Siahaan, Ina Wechsung
2017 Lecture Notes in Computer Science  
Microtasks can also be designed specifically for mobile devices or with workflows that would mean that the HIT would not be failed if there was a loss in Internet connection or similar problem.  ...  The people completing microtasks on crowdsourcing platforms are overwhelmingly workers providing labour, rather than people volunteering for a good cause or doings microtasks for leisure.  ... 
doi:10.1007/978-3-319-66435-4_3 fatcat:deerqoe5srei3etcssinky2fvy

Curating Social Media Data [article]

Kushal Vaghani
2020 arXiv   pre-print
However, due to the dynamic and noisy nature of social media data, performing accurate analysis on raw data is a challenging task.  ...  Due to its immense popularity and high usage, data published on social media sites (e.g., Twitter, Facebook and Tumblr) is a rich ocean of information.  ...  Micro-task Design Our research is closely tied to creating microtasks for social media curation; therefore it is important to discuss studies pertaining to microtask design.  ... 
arXiv:2002.09202v1 fatcat:5w2coglezfc4jlnu4h6oh23oqm
« Previous Showing results 1 — 15 out of 64 results