Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
34b-beta-GGUF
like
4
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
conversational
Inference Endpoints
text-generation-inference
License:
gpl-3.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
34b-beta-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
65660b0bafae66d7bc85d00890d06ad20bf31aadc38a216a6f69ce8dce2c9736
70810f6
verified
11 months ago
.gitattributes
Safe
2.08 kB
e13c979135ffbc8b9608d84d657055508302ba8934cae6496860519613c3573c
11 months ago
34b-beta.Q2_K.gguf
Safe
12.8 GB
LFS
5bd91a1a878849603d037123a5ce65d520d96b4b17070d366de2c44589930a30
11 months ago
34b-beta.Q3_K_L.gguf
Safe
18.1 GB
LFS
25092468acda758c1fe36dc5d86ab522a9f0f828156d7819e24e1e6b91744566
11 months ago
34b-beta.Q3_K_M.gguf
Safe
16.7 GB
LFS
c36042c5762b6115df03b492c3862924fcc49df7bf67ba856bb89089c1211bd6
11 months ago
34b-beta.Q3_K_S.gguf
Safe
15 GB
LFS
10e82f0bcf55f54bdd1e7b008a2219fe01c415696598e8582728fc7ce05f87c4
11 months ago
34b-beta.Q4_K_M.gguf
Safe
20.7 GB
LFS
f68d117d8de274472fb560d5a5b0ecf3bf141b45d0750d5555d130f987f83e4c
11 months ago
34b-beta.Q4_K_S.gguf
Safe
19.6 GB
LFS
a23dde2e7bd0e48ea12f07b8f7fdd17bf87004b0d00c1cc45146850ea5205eb4
11 months ago
34b-beta.Q5_K_M.gguf
Safe
24.3 GB
LFS
62732b100c4cb1b550076ac0591e013cce5d537acd944efc73c42ca5edb8bf6a
11 months ago
34b-beta.Q5_K_S.gguf
Safe
23.7 GB
LFS
3f1c3844636631cf8c6604a1b3d1b220fc604eb4e57b737eaf395a5d8fde0420
11 months ago
34b-beta.Q6_K.gguf
Safe
28.2 GB
LFS
f433d1372dead3054924af8b0bc0a2b23d4590834c29eef12e0514763ad0f5b7
11 months ago
34b-beta.Q8_0.gguf
Safe
36.5 GB
LFS
e13c979135ffbc8b9608d84d657055508302ba8934cae6496860519613c3573c
11 months ago
README.md
Safe
10.7 kB
65660b0bafae66d7bc85d00890d06ad20bf31aadc38a216a6f69ce8dce2c9736
11 months ago
