Hugging Face's logo

NightFox
/
saiga_gemma_9b_GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
1
NightFox commited on
Commit
667dbf5
•
1 Parent(s): 6a1d617

Upload 3 files

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. saiga_gemma_9b-Q5_K_M.gguf +3 -0
  3. saiga_gemma_9b-Q6_K.gguf +3 -0
  4. saiga_gemma_9b-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ saiga_gemma_9b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ saiga_gemma_9b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ saiga_gemma_9b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
saiga_gemma_9b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5711ed197051a7aef55a461f1c77bcc5f5ef6d7d3af82861bff351ac6b2a5b21
3
+ size 6144502944
saiga_gemma_9b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98058a8d9aef5ce0259977819332a00e4d4d1b43950a4242485b8c3fad8179df
3
+ size 7010167968
saiga_gemma_9b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44c84a26f06d8aeba1ccba2dfabe610524d68bbd50756c21bae7fd37c8e4dbfe
3
+ size 9077845152