Hugging Face's logo

swchoi1994
/
exaone3.0-8b-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
swchoi1994 commited on
Commit
d37ff2a
•
1 Parent(s): d21163a

Upload 4 files

Browse files

adding more GGUF quantized exaone models.

Files changed (5) hide show
  1. .gitattributes +4 -0
  2. exaone3.0-8b.Q4_0.gguf +3 -0
  3. exaone3.0-8b.bf16.gguf +3 -0
  4. exaone3.0-8b.tq1_0.gguf +3 -0
  5. exaone3.0-8b.tq2_0.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  exaone3.0-8b.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  exaone3.0-8b.gguf filter=lfs diff=lfs merge=lfs -text
37
+ exaone3.0-8b.bf16.gguf filter=lfs diff=lfs merge=lfs -text
38
+ exaone3.0-8b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
39
+ exaone3.0-8b.tq1_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ exaone3.0-8b.tq2_0.gguf filter=lfs diff=lfs merge=lfs -text
exaone3.0-8b.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e90200b78d5baaed7a7fd2fba6cff63b40cbc89ce618915323e86768b8c94631
3
+ size 8312083936
exaone3.0-8b.bf16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7ce2b47b931a2dd4d93cce876c653451c361dca03c19806a52805f39ef6e3de
3
+ size 15641630176
exaone3.0-8b.tq1_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6cfd21f937eb6d08b804346767e22079b8e7885788fd084fd3d37ee0cac06953
3
+ size 3155187168
exaone3.0-8b.tq2_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57b77ee0df1b43306492790a54108a34d624ef78ca24abc787ce550e5ebeb3c5
3
+ size 3482342880