ISCAS at SemEval-2020 Task 5: Pre-trained Transformers for Counterfactual Statement Modeling

Yaojie Lu, Annan Li, Hongyu Lin, Xianpei Han, Le Sun
2020 Proceedings of the Fourteenth Workshop on Semantic Evaluation   unpublished
ISCAS participated in two subtasks of SemEval 2020 Task 5: detecting counterfactual statements and detecting antecedent and consequence. This paper describes our system which is based on pretrained transformers. For the first subtask, we train several transformer-based classifiers for detecting counterfactual statements. For the second subtask, we formulate antecedent and consequence extraction as a query-based question answering problem. The two subsystems both achieved third place in the
more » ... ation. Our system is openly released at This work is licensed under a Creative Commons Attribution 4.0 International Licence. Licence details: http://
doi:10.18653/v1/2020.semeval-1.85 fatcat:jhu5qumeqrhoxhah6syryxrmy4