Hugging Face's logo

backyardai
/
WestLake-10.7B-v2-GGUF

Text Generation
Transformers
GGUF
English
roleplay
text-generation-inference
Inference Endpoints
Model card Files Community
brooketh commited on
Commit
73431f5
·
verified ·
1 Parent(s): 574866d

Upload 6 files

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. WestLake-10.7B-v2.IQ1_S.gguf +3 -0
  3. WestLake-10.7B-v2.IQ2_M.gguf +3 -0
  4. WestLake-10.7B-v2.IQ2_S.gguf +3 -0
  5. WestLake-10.7B-v2.IQ2_XS.gguf +3 -0
  6. WestLake-10.7B-v2.IQ2_XXS.gguf +3 -0
  7. WestLake-10.7B-v2.imatrix +3 -0
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ WestLake-10.7B-v2.imatrix filter=lfs diff=lfs merge=lfs -text
37
+ WestLake-10.7B-v2.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ WestLake-10.7B-v2.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ WestLake-10.7B-v2.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ WestLake-10.7B-v2.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ WestLake-10.7B-v2.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
WestLake-10.7B-v2.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90925216463256da658762af9589512213b85a976a559ee96a8a56bc828b362f
3
+ size 2351224992
WestLake-10.7B-v2.IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0c0d28d380c162f75db73e375939d01815860afafdbafc42926e7e46e06f9a7
3
+ size 3677485216
WestLake-10.7B-v2.IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6598c13a58d20ffbd831049fb7881a597b2f69639aa4daf3e28331b74010eeab
3
+ size 3392796832
WestLake-10.7B-v2.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3279a7504f90aa2db512e64c615b5c3b83bdcdd2564f4822c7259c13db1f0045
3
+ size 3230455968
WestLake-10.7B-v2.IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eff54325b1025da45dd6e00f007d0566614f991bc41b0a059abb3b8d4fdee13a
3
+ size 2920601760
WestLake-10.7B-v2.imatrix ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:123ecbaee435c6c24fcc5b24aec063ff01f38db1276f94958991daa607e24259
3
+ size 7482222