Hugging Face's logo

second-state
/
Llama-3-8B-Instruct-GGUF

Text Generation
GGUF
English
conversational
Model card Files Community
Xin Liu commited on
Commit
5a9ab50
•
1 Parent(s): b485718

Update models

Browse files

Signed-off-by: Xin Liu <[email protected]>

Files changed (12) hide show
  1. Meta-Llama-3-8B-Instruct-Q2_K.gguf +3 -0
  2. Meta-Llama-3-8B-Instruct-Q3_K_L.gguf +3 -0
  3. Meta-Llama-3-8B-Instruct-Q3_K_M.gguf +3 -0
  4. Meta-Llama-3-8B-Instruct-Q3_K_S.gguf +3 -0
  5. Meta-Llama-3-8B-Instruct-Q4_0.gguf +3 -0
  6. Meta-Llama-3-8B-Instruct-Q4_K_M.gguf +3 -0
  7. Meta-Llama-3-8B-Instruct-Q4_K_S.gguf +3 -0
  8. Meta-Llama-3-8B-Instruct-Q5_0.gguf +3 -0
  9. Meta-Llama-3-8B-Instruct-Q5_K_S.gguf +3 -0
  10. Meta-Llama-3-8B-Instruct-Q6_K.gguf +3 -0
  11. Meta-Llama-3-8B-Instruct-Q8_0.gguf +3 -0
  12. Meta-Llama-3-8B-Instruct-f16.gguf +3 -0
Meta-Llama-3-8B-Instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d68ac41701708ea3d2ae86782512dbdda66feaeb396a170a53554724848141bf
3
+ size 3179131104
Meta-Llama-3-8B-Instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff72590849813d118aa8f3e73eb6375fb29c2d1e0ccca532c6756902d01800cf
3
+ size 4321956064
Meta-Llama-3-8B-Instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2866937b90add3b5b9b11e9b284f63eb5e85ccdb030a90ed424d248571b3918f
3
+ size 4018917600
Meta-Llama-3-8B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c442b24bcab9c15df64cb47dfc147d63be081c8fab6c719c3ac48998cd0528b9
3
+ size 3664498912
Meta-Llama-3-8B-Instruct-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54a161a881652bf4a2bca0fb7bcf5ffcde567c71d7194814a43800757d234acd
3
+ size 4661211360
Meta-Llama-3-8B-Instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d4c2369f29c685f740b0f23b4f8a39fa46221eb21429ef1ffa1b14b1970bb17
3
+ size 4920733920
Meta-Llama-3-8B-Instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de5a0eb7dc8f89a5858f4552b6e5133b3281ca172acdc7113cac76850143569c
3
+ size 4692668640
Meta-Llama-3-8B-Instruct-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc34607cef0f441c17a1a6440ac318a15143cc05dbebf6bbf213ed79bb4f8696
3
+ size 5599293664
Meta-Llama-3-8B-Instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ae59049f7cdb2a75ed96fae719750e4f91c61740575136f1b42fbc074b914d0
3
+ size 5599293664
Meta-Llama-3-8B-Instruct-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82a953c375815a00f1e36773ccd7a62d9e045bcabd1a6554ad4ddb9d337cb0f2
3
+ size 6596006112
Meta-Llama-3-8B-Instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0cc95c65e87360bfedfac50db3051d92b25f66a678959595a35a7e06556628b
3
+ size 8540770528
Meta-Llama-3-8B-Instruct-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1716d233aae1f0277b8717769824a24155a60403e096a5cdd598288d77d46b63
3
+ size 16068890816