Hugging Face's logo

KIST-robot-intelligence
/
ko-gemma-2-9b-it-GGUF-quantization

Text Generation
Transformers
GGUF
Korean
conversational
Inference Endpoints
Model card Files Community
8

Upload 4 files

#1
by kingkangkr - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+16
-0
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. ko-gemma-2-9B-it_Q2_K.gguf +3 -0
  3. ko-gemma-2-9B-it_Q3_K_L.gguf +3 -0
  4. ko-gemma-2-9B-it_Q3_K_M.gguf +3 -0
  5. ko-gemma-2-9B-it_Q3_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ ko-gemma-2-9B-it_Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ ko-gemma-2-9B-it_Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ ko-gemma-2-9B-it_Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ ko-gemma-2-9B-it_Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ko-gemma-2-9B-it_Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e252b2afe0f6582c5f655492715f04e2e7b6ca68162cb8d2e43600d0f16f3030
3
+ size 3805398112
ko-gemma-2-9B-it_Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa0481a365bc09587d8bd4725214f5fed6a5ae795ebcd4e9a46f5f924b89642f
3
+ size 5132452960
ko-gemma-2-9B-it_Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa70659595b46a1804e3b5b152e4442fbe545d1bcc9e81308898ed32810c01dd
3
+ size 4761781344
ko-gemma-2-9B-it_Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6835ea2c4156bfe40f17ba5f12a9bdb197f833593be1712135a0302cf48a4bff
3
+ size 4337665120