Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
01-ai
/
Yi-34B-Chat-8bits
like
28
Follow
01-ai
678
Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
8-bit precision
gptq
arxiv:
2403.04652
arxiv:
2311.16502
arxiv:
2401.11944
License:
apache-2.0
Model card
Files
Files and versions
Community
3
Train
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (2)
Sort: Recently created
the int8 speed are very slow
1
#1 opened over 1 year ago by
lucasjin
lucasjin