A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2022; you can also visit the original URL.
The file type is
The resurgence of deep learning has greatly advanced this field, in particular, with the help of neural generation models based on pre-trained language models (PLMs). ... Text generation based on PLMs is viewed as a promising approach in both academia and industry. In this paper, we provide a survey on the utilization of PLMs in text generation. ...  took a deep look into the history of pre-training, especially its special relation with transfer learning and self-supervised learning. Besides, El-Kassas et al. ...arXiv:2201.05273v4 fatcat:pnffabspsnbhvo44gbaorhxc3a