Hugging Face's logo

KIST-robot-intelligence
/
ko-gemma-2-9b-it-GGUF-quantization

Text Generation
Transformers
GGUF
Korean
conversational
Inference Endpoints
Model card Files Community
8

Upload 4 files

#2
by kingkangkr - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+16
-0
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. ko-gemma-2-9B-it_Q4_1.gguf +3 -0
  3. ko-gemma-2-9B-it_Q4_K_M.gguf +3 -0
  4. ko-gemma-2-9B-it_Q4_K_S.gguf +3 -0
  5. ko-gemma-2-9B-it_Q5_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ ko-gemma-2-9B-it_Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
37
+ ko-gemma-2-9B-it_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ ko-gemma-2-9B-it_Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ ko-gemma-2-9B-it_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ko-gemma-2-9B-it_Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1be8a09677c90b3c296a37e2f5746dc39c6655ee8459a22947789d7080d40fa1
3
+ size 5963367520
ko-gemma-2-9B-it_Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4022a6e3c0706be4d9f5155c0e5064470f1f3ddb6ba6d60227675fff32b5438
3
+ size 5761057888
ko-gemma-2-9B-it_Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fba000ae98ca983b4c5f7b52e7b68bfb7c8a5bf26567998eb34402dfa13210ed
3
+ size 5478925408
ko-gemma-2-9B-it_Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ee7afcb2f79887702005316b8230a8b4a30a52dbcbdf07f5659cbdf8edd8ae9
3
+ size 6647366752