sinhala-gpt2 / config.py
keshan's picture
Saving weights and logs of step 10
5339b17
raw
history blame
194 Bytes
from transformers import GPT2Config
model_dir = "./sihala-gpt2"
config = GPT2Config.from_pretrained("gpt2", resid_pdrop=0.0, embd_pdrop=0.0, attn_pdrop=0.0)
config.save_pretrained(model_dir)