Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
7
MaziyarPanahi commited on
Commit
34e62c1
·
verified ·
1 Parent(s): a2eb363

46c15fca4efdbead019863eda4d5aa3762319887611e924cf1a2078cb6c2cd93

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. Meta-Llama-3.1-70B-Instruct.IQ2_XS.gguf +3 -0
.gitattributes CHANGED
@@ -50,3 +50,4 @@ Meta-Llama-3.1-70B-Instruct.Q6_K.gguf-00005-of-00006.gguf filter=lfs diff=lfs me
50
  Meta-Llama-3.1-70B-Instruct.Q6_K.gguf-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
51
  Meta-Llama-3.1-70B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
52
  Meta-Llama-3.1-70B-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
50
  Meta-Llama-3.1-70B-Instruct.Q6_K.gguf-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
51
  Meta-Llama-3.1-70B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
52
  Meta-Llama-3.1-70B-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Meta-Llama-3.1-70B-Instruct.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-70B-Instruct.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c9f39a2cd7c38194da02a0fdfcad7cd1d07e3596c995c12304b72cad7df1d21
3
+ size 21142108288