2 Hits in 4.1 sec

A Shared Task of a New, Collaborative Type to Foster Reproducibility: A First Exercise in the Area of Language Science and Technology with REPROLANG2020

António Branco, Nicoletta Calzolari, Piek Vossen, Gertjan van Noord, Dieter Van Uytvanck, João Silva, Luís Gomes, André Moreira, Willem Elbers
2020 International Conference on Language Resources and Evaluation  
In this paper, we introduce a new type of shared task -which is collaborative rather than competitive -designed to support and foster the reproduction of research results.  ...  We also describe the first event running such a novel challenge, present the results obtained, discuss the lessons learned and ponder on future undertakings.  ...  II Task selection committee  ... 
dblp:conf/lrec/BrancoCVNUSGME20 fatcat:7v3xd2r2wbf47engnuahjig55a

Towards transparency in NLP shared tasks [article]

Carla Parra Escartín and Teresa Lynn and Joss Moorkens and Jane Dunne
2021 arXiv   pre-print
The proposed Checklist is flexible enough to accommodate the wide diversity of shared tasks in our field and its goal is not to be prescriptive, but rather to serve as a tool that encourages shared task  ...  The survey aimed to capture the opinions of the research community on issues surrounding shared tasks, with respect to both participation and organisation.  ...  goal of the survey was to receive input and feedback on the topic of shared tasks from as broad a range of disciplines as possible in the area of language technology.  ... 
arXiv:2105.05020v1 fatcat:gawl5wl5yzbmbilixqxdfv6vsa