Internet Archive Scholar

PerPaDa: A Persian Paraphrase Dataset based on Implicit Crowdsourcing Data Collection [article]

Salar Mohtaj, Fatemeh Tavakkoli, Habibollah Asghari
2022 arXiv   pre-print

Preserved Fulltext

fulltext thumbnail
Web Archive Capture PDF (401.8 kB)
https://web.archive.org/web/20220121202922/https://arxiv.org/pdf/2201.06573v1.pdf

A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL. The file type is application/pdf.

In this paper we introduce PerPaDa, a Persian paraphrase dataset that is collected from users' input in a plagiarism detection system. As an implicit crowdsourcing experience, we have gathered a large collection of original and paraphrased sentences from Hamtajoo; a Persian plagiarism detection system, in which users try to conceal cases of text re-use in their documents by paraphrasing and re-submitting manuscripts for analysis. The compiled dataset contains 2446 instances of paraphrasing. In
more » ... rder to improve the overall quality of the collected data, some heuristics have been used to exclude sentences that don't meet the proposed criteria. The introduced corpus is much larger than the available datasets for the task of paraphrase identification in Persian. Moreover, there is less bias in the data compared to the similar datasets, since the users did not try some fixed predefined rules in order to generate similar texts to their original inputs.
arXiv:2201.06573v1 fatcat:kzj64olplvcmxomec4jho63sf4
Open Access
Citation

Salar Mohtaj, Fatemeh Tavakkoli, Habibollah Asghari. "PerPaDa: A Persian Paraphrase Dataset based on Implicit Crowdsourcing Data Collection." arXiv (2022)