Hugging Face's logo

lianghsun
/
Llama-3.2-Taiwan-3B-GGUF

Text Generation
GGUF
ROC
Taiwan
zh-tw
llama-factory
Inference Endpoints
conversational
Model card Files Community
lianghsun commited on
Commit
bdae210
·
1 Parent(s): 9c28ec5

Upload all quantizations except I-series.

Browse files
Files changed (20) hide show
  1. .gitattributes +1 -0
  2. Llama-3.2-Taiwan-3B-BF16.gguf +3 -0
  3. Llama-3.2-Taiwan-3B-F16.gguf +3 -0
  4. Llama-3.2-Taiwan-3B-Q2_K.gguf +3 -0
  5. Llama-3.2-Taiwan-3B-Q3_K.gguf +3 -0
  6. Llama-3.2-Taiwan-3B-Q3_K_L.gguf +3 -0
  7. Llama-3.2-Taiwan-3B-Q3_K_M.gguf +3 -0
  8. Llama-3.2-Taiwan-3B-Q3_K_S.gguf +3 -0
  9. Llama-3.2-Taiwan-3B-Q4_0.gguf +3 -0
  10. Llama-3.2-Taiwan-3B-Q4_1.gguf +3 -0
  11. Llama-3.2-Taiwan-3B-Q4_K.gguf +3 -0
  12. Llama-3.2-Taiwan-3B-Q4_K_M.gguf +3 -0
  13. Llama-3.2-Taiwan-3B-Q4_K_S.gguf +3 -0
  14. Llama-3.2-Taiwan-3B-Q5_0.gguf +3 -0
  15. Llama-3.2-Taiwan-3B-Q5_1.gguf +3 -0
  16. Llama-3.2-Taiwan-3B-Q5_K.gguf +3 -0
  17. Llama-3.2-Taiwan-3B-Q5_K_M.gguf +3 -0
  18. Llama-3.2-Taiwan-3B-Q5_K_S.gguf +3 -0
  19. Llama-3.2-Taiwan-3B-Q6_K.gguf +3 -0
  20. Llama-3.2-Taiwan-3B-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-Taiwan-3B-BF16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d8aa23c52b34c6ebda2c43f649615b0280d5af254478c8218ee39a5d5ed9c4b
3
+ size 6433688544
Llama-3.2-Taiwan-3B-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9742bbbcac5fe9d8e1c9e5bb9fe6b6a8a0a0188be9cc3fa9fcfcd07668bf45ce
3
+ size 6433688544
Llama-3.2-Taiwan-3B-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01bf1537668cbacd5b8c33b7ab9bdd0c9f67273ddc91e0727b338a55b718e0ce
3
+ size 1363936224
Llama-3.2-Taiwan-3B-Q3_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1333ad5574b62778c0e7e2aaabd980750169e3deb39cd1bcc54736176fb1141f
3
+ size 1687159776
Llama-3.2-Taiwan-3B-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34c69c882591cc5b972ceef8c817a3633590fc31e4e3f2d9158d00dcd6b81782
3
+ size 1815348192
Llama-3.2-Taiwan-3B-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1333ad5574b62778c0e7e2aaabd980750169e3deb39cd1bcc54736176fb1141f
3
+ size 1687159776
Llama-3.2-Taiwan-3B-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f97cf6e338c1c23d39afe7090c898713eddb7fa01feeb3effddc7adf4516ba50
3
+ size 1542849504
Llama-3.2-Taiwan-3B-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a9a3077c75740ec1408b561088c8485ce323d24f91bb1db44dd305aae00f3cf
3
+ size 1917191136
Llama-3.2-Taiwan-3B-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8422d3f0036dea371aefbe2ee13c7165d4c98d80114dac37450b4d399cff3615
3
+ size 2093351904
Llama-3.2-Taiwan-3B-Q4_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b0e609dc7394002c201577be614c6e49c723ab5d6a39c88fb1e35e23ce3a6e8
3
+ size 2019378144
Llama-3.2-Taiwan-3B-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b0e609dc7394002c201577be614c6e49c723ab5d6a39c88fb1e35e23ce3a6e8
3
+ size 2019378144
Llama-3.2-Taiwan-3B-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7008631b816c107812078a6cd97d3b147521e51fc084ebea5d4790da673d1825
3
+ size 1928201184
Llama-3.2-Taiwan-3B-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f4039994e03b487d907a09384d05dcb6a14bde8bdbdbc5e9a63ebbc1a49640f
3
+ size 2269512672
Llama-3.2-Taiwan-3B-Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9ffcab5be6ca939c515aca9b031d2548412228f18a65b7b90175dccfb23c48c
3
+ size 2445673440
Llama-3.2-Taiwan-3B-Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7171bdc590f37bd796e53ee3dd0cf7dc784380aac6e2854c1557b32261a62b86
3
+ size 2322154464
Llama-3.2-Taiwan-3B-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7171bdc590f37bd796e53ee3dd0cf7dc784380aac6e2854c1557b32261a62b86
3
+ size 2322154464
Llama-3.2-Taiwan-3B-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:691b0d289cc539c24847fa2883094c491875c1bee77b4b539e48c332bba8e04f
3
+ size 2269512672
Llama-3.2-Taiwan-3B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd68de004178b4c2641514429c5084576481d1ea6488616f73cb7d1a23b75f08
3
+ size 2643854304
Llama-3.2-Taiwan-3B-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f97142d5cba17fe25ab75e29445a30176ebf256a92ec80d2b5d1caa6926c6f0
3
+ size 3421899744