1 Hit in 1.2 sec

Pretrained Language Models for Text Generation: A Survey [article]

Junyi Li, Tianyi Tang, Wayne Xin Zhao, Jian-Yun Nie, Ji-Rong Wen
2022 arXiv   pre-print
The resurgence of deep learning has greatly advanced this field, in particular, with the help of neural generation models based on pre-trained language models (PLMs).  ...  Text generation based on PLMs is viewed as a promising approach in both academia and industry. In this paper, we provide a survey on the utilization of PLMs in text generation.  ...  [70] took a deep look into the history of pre-training, especially its special relation with transfer learning and self-supervised learning. Besides, El-Kassas et al.  ... 
arXiv:2201.05273v4 fatcat:pnffabspsnbhvo44gbaorhxc3a