uer
/

albert-large-chinese-cluecorpussmall

Inference Endpoints

Model card Files Files and versions Community

uer commited on Oct 25, 2023

Commit

3843846

•

1 Parent(s): bfdf3f9

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -91,7 +91,7 @@ Taking the case of ALBERT-Base
 Stage1:
 ```
-python3 preprocess.py --corpus_path corpora/cluecorpussmall.txt \
                       --vocab_path models/google_zh_vocab.txt \
                       --dataset_path cluecorpussmall_albert_seq128_dataset.pt \
                       --seq_length 128 --processes_num 32 --data_processor albert
@@ -110,7 +110,7 @@ python3 pretrain.py --dataset_path cluecorpussmall_albert_seq128_dataset.pt \
 Stage2:
 ```
-python3 preprocess.py --corpus_path corpora/cluecorpussmall.txt \
                       --vocab_path models/google_zh_vocab.txt \
                       --dataset_path cluecorpussmall_albert_seq512_dataset.pt \
                       --seq_length 512 --processes_num 32 --data_processor albert

 Stage1:
 ```
+python3 preprocess.py --corpus_path corpora/cluecorpussmall_bert.txt \
                       --vocab_path models/google_zh_vocab.txt \
                       --dataset_path cluecorpussmall_albert_seq128_dataset.pt \
                       --seq_length 128 --processes_num 32 --data_processor albert
 Stage2:
 ```
+python3 preprocess.py --corpus_path corpora/cluecorpussmall_bert.txt \
                       --vocab_path models/google_zh_vocab.txt \
                       --dataset_path cluecorpussmall_albert_seq512_dataset.pt \
                       --seq_length 512 --processes_num 32 --data_processor albert