Filters








799 Hits in 2.1 sec

Semi-Automatic Crowdsourcing Tool for Online Food Image Collection and Annotation [article]

Zeman Shao, Runyu Mao, Fengqing Zhu
2019 arXiv   pre-print
We designed a web-based crowdsourcing tool to assist the crowd or human annotators to locate and label all the foods in the images.  ...  The proposed semi-automatic online food image collection system can be used to build large food image datasets with groundtruth labels efficiently from scratch.  ...  The groundtruth labels, derived from observable data, is the objective verification of particular properties of an image, used to test the accuracy of computer vision tasks.  ... 
arXiv:1910.05242v2 fatcat:uxyhkrsyzzdxpnudmrq34ntwre

Multi-Label Active Learning from Crowds [article]

Shao-Yuan Li, Yuan Jiang, Zhi-Hua Zhou
2015 arXiv   pre-print
Then we propose the instance selection and annotator selection criteria that consider the uncertainty/diversity of instances and the reliability of annotators, such that the most reliable annotator will  ...  In this paper, we consider the poolbased multi-label active learning under the crowdsourcing setting, where during the active query process, instead of resorting to a high cost oracle for the ground-truth  ...  training data and the test data.  ... 
arXiv:1508.00722v1 fatcat:rlqvdd25ebbmjby7d3p6a5qvhi

Human Computation for Image and Video Analysis

Kurt Luther
2018 The AI Magazine  
The aim of this workshop was to promote greater interaction between researchers and practitioners who examine how to mix human and computer efforts to convert visual data into discoveries and innovations  ...  The second Workshop on Human Computation for Image and Video Analysis (GroupSight) took place in Quebec City, Canada on October 24, 2017, as part of the fifth AAAI Conference on Human Computation and Crowdsourcing  ...  Walter Lasecki (University of Michigan) discussed projects using real-time crowdsourcing to rapidly and scalably generate training data for computer vision systems.  ... 
doi:10.1609/aimag.v39i4.2825 fatcat:2dqhq57rkzc5toax3f524w6wwe

Using Crowd-Sourced Data to Study Public Services: Lessons from Urban India

Alison E. Post, Anustubh Agnihotri, Christopher Hyun
2018 Studies in comparative international development  
public opinion, and law and order.  ...  In this paper, we draw on our own research on the politics of urban water delivery in India to highlight new types of analysis that are possible using crowd-sourced data, and propose solutions to common  ...  Scholars using remote sensing data such as satellite and radio imagery have long assessed data accuracy through groundtruthing.  ... 
doi:10.1007/s12116-018-9271-4 fatcat:xr3qqboyrrf25icwlp3ijf6izq

A Novel Label Aggregation with Attenuated Scores for Ground-Truth Identification of Dataset Annotation with Crowdsourcing

Ratchainant THAMMASUDJARIT, Anon PLANGPRASOPCHOK, Charnyote PLUEMPITIWIRIYAWEJ
2017 IEICE transactions on information and systems  
labels, for a certain dataset, from crowdsourcing annotations -is a crucial task to make the dataset usable, e.g., for a supervised learning problem.  ...  It also achieves higher F1 scores than those of the strong baselines in all multi-class data.  ...  In this example, the crowdsourcing data are annotated by three annotators (A0, A1, and A2) on three unique instances (classic01, pop01, and rock01).  ... 
doi:10.1587/transinf.2016dap0024 fatcat:ay5pocxhrrbgbcb3i3zqfkwzsm

Learning classifiers from dual annotation ambiguity via a min–max framework

Jinbo Bi, Xin Wang
2015 Neurocomputing  
The proposed algorithms outperform existing methods on benchmark data sets collected for document classification, real-life crowd-sourced data sets, and a medical problem of heart wall motion analysis  ...  Existing methods for multi-labeler learning and multi-instance learning only address one source of the labeling ambiguity. They are not trivially feasible to tackle the dual ambiguity problem.  ...  Facial expression data sets with real crowdsourced labels We also tested our methods on the Facial Expression data set previously used in a crowdsourcing study [65] .  ... 
doi:10.1016/j.neucom.2014.10.005 fatcat:wkgv54ckdnejlgp3xqv4fay4qy

Dancing the mosh pit style with fresh ideas

Javier Carranza Torres
2017 Figshare  
Trained Groundtruth actors in LATAM with UNOCHA , local OSM communities and UNFPA in Panamá Data Revolution Needs Us Stats Up project The program prepares young social entrepreneurs and provides  ...  The strategy proposes both to produce open data for NSOs and to use currently available data from public organizations and statistical offices. How we measure?  ... 
doi:10.6084/m9.figshare.5649772.v1 fatcat:y6mjei7gnnf4les5np4p3m2jiq

A Collaborative Framework for High-Definition Mapping [article]

Alexis Stoven-Dubois, Kuntima Kiala Miguel, Aziz Dziri, Bertrand Leroy, Roland Chapuis
2019 arXiv   pre-print
Our system is composed of two processing blocks: the first one is embedded in each vehicle, and aims at geo-localizing the vehicle and the detected feature marks.  ...  As the map's landmarks are detected and positioned by more and more vehicles, the accuracy of the map increases, eventually converging in probability towards a null error.  ...  This crowdsourcing approach, while being scalable and cost-effective, allows for continuous updates of the map.  ... 
arXiv:1910.06014v1 fatcat:3foqoltokfg57mn5sf6gsejtdy

False Discovery Rate Control and Statistical Quality Assessment of Annotators in Crowdsourced Ranking [article]

Qianqian Xu, Jiechao Xiong, Xiaochun Cao, Yuan Yao
2016 arXiv   pre-print
scale crowdsourcing data analysis.  ...  Our studies are supported by experiments with both simulated examples and real-world data.  ...  well as grants from Baidu and Microsoft Research-Asia.  ... 
arXiv:1605.05860v3 fatcat:u3msq6vl45c7bkbfcqffoyld4m

Performance Comparison of Crowdworkers and NLP Tools on Named-Entity Recognition and Sentiment Analysis of Political Tweets [article]

Mona Jalal, Kate K. Mays, Lei Guo, Margrit Betke
2020 arXiv   pre-print
We tested several commercial and open-source tools.  ...  The groundtruth, established by experts in political communication, has entity-level sentiment information for each candidate mentioned in the tweet.  ...  Acknowledgments Partial support of this work by the Hariri Institute for Computing and Computational Science & Engineering at Boston University (to L.G.) and a Google Faculty Research Award (to M.B. and  ... 
arXiv:2002.04181v2 fatcat:xvqihdsncndttljysdzxrgmwgm

Active Sampling for Subjective Image Quality Assessment

Peng Ye, David Doermann
2014 2014 IEEE Conference on Computer Vision and Pattern Recognition  
It is often used to construct image quality datasets and provide the groundtruth for building and evaluating objective quality measures.  ...  Our method can be used in conventional laboratory studies as well as crowdsourcing experiments.  ...  Acknowledgment The partial support of this research by DARPA through BBN/DARPA Award HR0011-08-C-0004 under subcontract 9500009235, the US Government through NSF Awards IIS-0812111 and IIS-1262122 is gratefully  ... 
doi:10.1109/cvpr.2014.541 dblp:conf/cvpr/YeD14 fatcat:gctpcehuybhgjjthzkuowmipfy

Massive, Free and Reproducible Grountruthed Document Image Databases Generation with DocCreator

Nicholas Journet, Boris Mansencal, Muriel Visani
2017 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR)  
DocCreator comes as an online (easy to test version) and a desktop solution (fast calculation process, and no need to upload copyrighted data).  ...  It has already been used favorably and could help other DIAR researchers to produce and share groundtruthed databases.  ...  Data augmentation or groundtruth generation Many researchers choose to create their own groundtruth.  ... 
doi:10.1109/icdar.2017.188 dblp:conf/icdar/JournetMV17 fatcat:hhwhfkbq4fgcloj74dzwqe2gly

A Collaborative Framework for High-Definition Mapping

Alexis Stoven-Dubois, Kuntima Kiala Miguel, Aziz Dziri, Bertrand Leroy, Roland Chapuis
2019 2019 IEEE Intelligent Transportation Systems Conference (ITSC)  
Our system is composed of two processing blocks: the first one is embedded in each vehicle, and aims at geolocalizing the vehicle and the detected feature marks.  ...  As the map's landmarks are detected and positioned by more and more vehicles, the accuracy of the map increases, eventually converging in probability towards a null error.  ...  This crowdsourcing approach, while being scalable and cost-effective, allows for continuous updates of the map.  ... 
doi:10.1109/itsc.2019.8917292 dblp:conf/itsc/Stoven-DuboisMD19 fatcat:ljrb6lg5drbxbklm7zju4u77dm

Crowdsourcing Analysis of Twitter Data on Climate Change: Paid Workers vs. Volunteers

Andrei Kirilenko, Travis Desell, Hany Kim, Svetlana Stepchenkova
2017 Sustainability  
Web based crowdsourcing has become an important method of environmental data processing.  ...  This study compares volunteer and paid processing of social media data originating from climate change discussions on Twitter.  ...  The data used in this study were collected by the University of North Dakota Center for Regional Climate Studies supported by the NSF ND EPSCoR grant.  ... 
doi:10.3390/su9112019 fatcat:mwdlckspebh63px2y4ruyitbza

SAVOIAS: A Diverse, Multi-Category Visual Complexity Dataset [article]

Elham Saraee, Mona Jalal, Margrit Betke
2018 arXiv   pre-print
Yet, efforts to create large, downloadable image datasets with diverse content and unbiased groundtruthing are lacking.  ...  The ground truth for Savoias is obtained by crowdsourcing more than 37,000 pairwise comparisons of images using the forced-choice methodology and with more than 1,600 contributors.  ...  This paper is based on work that was supported in part by the National Science Foundation (grants 1421943 and 1838193).  ... 
arXiv:1810.01771v1 fatcat:2dhvmpx5frffdiez3doy26v6dy
« Previous Showing results 1 — 15 out of 799 results