Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
dranger003
/
bagel-34b-v0.4-iMat.GGUF
like
1
Text Generation
GGUF
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Deploy
Use this model
41ababc
bagel-34b-v0.4-iMat.GGUF
2 contributors
History:
20 commits
dranger003
Upload ggml-bagel-34b-v0.4-iq1_s.gguf
41ababc
verified
10 months ago
.gitattributes
2 kB
Upload ggml-bagel-34b-v0.4-iq1_s.gguf
10 months ago
README.md
983 Bytes
Update README.md
10 months ago
ggml-bagel-34b-v0.4-iq1_s.gguf
7.5 GB
LFS
Upload ggml-bagel-34b-v0.4-iq1_s.gguf
10 months ago
ggml-bagel-34b-v0.4-iq2_xs.gguf
10.3 GB
LFS
Upload ggml-bagel-34b-v0.4-iq2_xs.gguf
10 months ago
ggml-bagel-34b-v0.4-iq2_xxs.gguf
9.31 GB
LFS
Upload ggml-bagel-34b-v0.4-iq2_xxs.gguf
10 months ago
ggml-bagel-34b-v0.4-iq3_xxs.gguf
13.7 GB
LFS
Upload ggml-bagel-34b-v0.4-iq3_xxs.gguf
10 months ago
ggml-bagel-34b-v0.4-q4_k_m.gguf
20.7 GB
LFS
Upload ggml-bagel-34b-v0.4-q4_k_m.gguf
10 months ago
ggml-bagel-34b-v0.4-q8_0-imatrix.dat
15.3 MB
LFS
Upload ggml-bagel-34b-v0.4-q8_0-imatrix.dat
10 months ago
ggml-bagel-34b-v0.4-q8_0.gguf
36.5 GB
LFS
Upload ggml-bagel-34b-v0.4-q8_0.gguf
10 months ago
