msarmi9's picture
[add]: de-de autoencoder pre-training logs
79ad873
raw
history blame
80 Bytes
label_smoothing: 0.2
lr: 0.001
pad_idx: 3
warmup_steps: 500
weight_decay: 0.001