distil_mse_2 / README.md
alishudi's picture
Create README.md
bc50fda

--alpha_ce 0.0 --alpha_mlm 2.0 --alpha_cos 1.0 --alpha_act 1.0 --alpha_clm 0.0 --alpha_mse 0.0002 --mlm
2 layers