GGUF model commit (made with llama.cpp commit 64e64aa)

9593c7e 12 months ago

.gitattributes

2.29 kB

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
config.json

31 Bytes

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q2_K.gguf

3.08 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q3_K_L.gguf

3.82 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q3_K_M.gguf

3.52 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q3_K_S.gguf

3.16 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q4_0.gguf

4.11 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q4_K_M.gguf

4.37 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q4_K_S.gguf

4.14 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q5_0.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q5_K_M.gguf

5.13 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q5_K_S.gguf

5 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q6_K.gguf

5.94 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago
saiga_mistral_7b.Q8_0.gguf

7.7 GB
LFS

GGUF model commit (made with llama.cpp commit 64e64aa) 12 months ago