New SOTA results for abstractive summarization just posted to
arxiv.org/abs/1912.08777! We have a new way to pre-train for summarization, and evaluated our PEGASUS model on 12 diverse downstream summarization tasks, achieving SOTA on all, in some cases by a significant margin.