Filters








2 Hits in 1.8 sec

Which *BERT? A Survey Organizing Contextualized Encoders [article]

Patrick Xia, Shijie Wu, Benjamin Van Durme
2020 arXiv   pre-print
Pretrained contextualized text encoders are now a staple of the NLP community.  ...  We present a survey on language representation learning with the aim of consolidating a series of shared lessons learned across a variety of recent efforts.  ...  This work was supported in part by DARPA AIDA (FA8750-18-2-0015) and IARPA BETTER (#2019-19051600005).  ... 
arXiv:2010.00854v1 fatcat:h4yxicrct5ccxb5zajtneuofrm

Which *BERT? A Survey Organizing Contextualized Encoders

Patrick Xia, Shijie Wu, Benjamin Van Durme
2020 Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)   unpublished
Pretrained contextualized text encoders are now a staple of the NLP community.  ...  We present a survey on language representation learning with the aim of consolidating a series of shared lessons learned across a variety of recent efforts.  ...  Feyisetan, Sepideh Ghanavati, and Patricia Thaine. 2020. Workshop on privacy in nlp (privatenlp 2020).  ... 
doi:10.18653/v1/2020.emnlp-main.608 fatcat:4bplbrtd2jd6tkvxkdwxowc2bq