Update README.md

README.md

@@ -23,9 +23,8 @@ Paraphrase Chinese sentences based on Transformer-XL.
 
 ## 模型信息 Model Information
 
-我们先使用Transformer-XL的模型结构在悟道语料库(180G版本)上进行预训练，然后在我们自主构建的语法错误数据集上进行微调。其中，去噪任务是从包括 **随机插入/交换/删除/替换/句子重排** 的具有噪声的输入中重建一个流畅和干净的文本。
-
-We first pre-trained Transformer-XL on the Wudo corpus (180G version), and then fine-tuned it on a denoised dataset (developed by us). The denoise task is to reconstruct a fluent and clean text from a noisy input which includes **random insertion/swap/deletion/replacement/sentence reordering**.
+在悟道语料库(280G版本)和标注的相似句子对数据集上进行预训练。
+The Transformer-XL model was pre-trained on the Wudao Corpus (with 280G samples) and annotated similar-sentence pair dataset.
 
 ## 使用 Usage