Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

turboderp
/
Llama-3-70B-Instruct-exl2

Model card Files Files and versions Community
2
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

Can I use the model with pipeline? I encounter some problem when trying to do so.

#2 opened 12 months ago by
labman000

tokenizer_config.json and config.json specify wrong EOS token, causing the model to not function correctly in backends which do not read EOS tokens from generation_config.json

🔥 1
6
#1 opened about 1 year ago by
Lissanro
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs