Filters








2 Hits in 8.0 sec

Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you? [article]

Rochelle Choenni, Ekaterina Shutova, Robert van Rooij
2021 arXiv   pre-print
In this paper, we investigate what types of stereotypical information are captured by pretrained language models.  ...  We present the first dataset comprising stereotypical attributes of a range of social groups and propose a method to elicit stereotypes encoded by pretrained language models in an unsupervised fashion.  ...  This shows how complex the process is in which associations are established and provides strong evidence that other modelling decisions, apart from training data, contribute to what models learn about  ... 
arXiv:2109.10052v1 fatcat:nnklvkpxwrh43i4lpqupykokne

Stepmothers are mean and academics are pretentious: What do pretrained language models learn about you?

Rochelle Choenni, Ekaterina Shutova, Robert van Rooij
2021 Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing   unpublished
In this paper, we investigate what types of stereotypical information are captured by pretrained language models.  ...  We present the first dataset comprising stereotypical attributes of a range of social groups and propose a method to elicit stereotypes encoded by pretrained language models in an unsupervised fashion.  ...  This shows how complex the process is in which associations are established and provides strong evidence that other modelling decisions, apart from training data, contribute to what models learn about  ... 
doi:10.18653/v1/2021.emnlp-main.111 fatcat:e2m4xdevrzafpdaif6wbqzm62a