mpt-7b-storywriter-fast / generation_config.json
emozilla's picture
add fast loading/inference
2e25a9a
raw
history blame contribute delete
132 Bytes
{
"_from_model_config": true,
"transformers_version": "4.28.1",
"eos_token_id": 0,
"pad_token_id": 0,
"use_cache": true
}