AlexU-AUX-BERT at SemEval-2020 Task 3: Improving BERT Contextual Similarity Using Multiple Auxiliary Contexts

Somaia Mahmoud, Marwan Torki
2020 Proceedings of the Fourteenth Workshop on Semantic Evaluation   unpublished
This paper describes the system we built for SemEval-2020 task 3. That is predicting the scores of similarity for a pair of words within two different contexts. Our system is based on both BERT embeddings and WordNet. We simply use cosine similarity to find the closest synset of the target words. Our results show that using this simple approach greatly improves the system behavior. Our model is ranked 3rd in subtask-2 for SemEval-2020 task 3.
doi:10.18653/v1/2020.semeval-1.33 fatcat:sapkgg4rlzbs5l3ba44fsafpuu