Hugging Face's logo

casperhansen
/
llama-3-70b-instruct-awq

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
10

Update generation_config.json

#2
by hmellor HF staff - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+1
-1
Update generation_config.json7cd06cb1
hmellor

Add missing EOS token as is now present in the un-quantised config https://huggingface.co/meta-llama/Meta-Llama-3-70B-Instruct/blob/main/generation_config.json

casperhansen changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment