Hugging Face's logo

second-state
/
Meta-Llama-3-70B-Instruct-GGUF

Text Generation
GGUF
English
conversational
Model card Files Community
Xin Liu commited on
Commit
108a577
•
1 Parent(s): 94d357e

Add Q2 and Q3 models

Browse files

Signed-off-by: Xin Liu <[email protected]>

Files changed (4) hide show
  1. Meta-Llama-3-70B-Instruct-Q2_K.gguf +3 -0
  2. Meta-Llama-3-70B-Instruct-Q3_K_L.gguf +3 -0
  3. Meta-Llama-3-70B-Instruct-Q3_K_M.gguf +3 -0
  4. Meta-Llama-3-70B-Instruct-Q3_K_S.gguf +3 -0
Meta-Llama-3-70B-Instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d34b2823ee6be2f7e5689b81cc76dc96bdb22e9403cb484ded745f0593b86610
3
+ size 26375621088
Meta-Llama-3-70B-Instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19d8ad907d62835f564eb0a509a10ce5c65e9bd0e2f8c91fd6b269923e6c926c
3
+ size 37141105120
Meta-Llama-3-70B-Instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9cc55d487c7bb1601603712ff5f10d16f1de3e4c91f620d26991aed12b6734eb
3
+ size 34268006880
Meta-Llama-3-70B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b5d29d4448f227e477eac2ddd90b8e501e7ad39a92d881d4b0faa07706624ad
3
+ size 30912563680