Hugging Face's logo

KIST-robot-intelligence
/
ko-gemma-2-9b-it-GGUF-quantization

Text Generation
Transformers
GGUF
Korean
conversational
Inference Endpoints
Model card Files Community
8

Upload 2 files

#3
by kingkangkr - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+8
-0
Files changed (3) hide show
  1. .gitattributes +2 -0
  2. ko-gemma-2-9B-it_Q5_K_S.gguf +3 -0
  3. ko-gemma-2-9B-it_Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ ko-gemma-2-9B-it_Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
37
+ ko-gemma-2-9B-it_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
ko-gemma-2-9B-it_Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3857115dc989244ad343f8e8cf5a1a1d32bea81d165b1a4cb19ba4b81690559e
3
+ size 6483592288
ko-gemma-2-9B-it_Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a8ad61191f0ae99128d59eabf393ea219f7daa58b8f0f0343672ad4e91db29d
3
+ size 7589069920