apepkuss79 commited on
Commit
b0beec3
1 Parent(s): 8c0be96

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -73,6 +73,8 @@ tags:
73
  | Name | Quant method | Bits | Size | Use case |
74
  | ---- | ---- | ---- | ---- | ----- |
75
  | [Qwen1.5-110B-Chat-Q2_K.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q2_K.gguf) | Q2_K | 2 | 41.2 GB| smallest, significant quality loss - not recommended for most purposes |
 
 
76
  | [Qwen1.5-110B-Chat-Q3_K_M-00001-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q3_K_M-00001-of-00002.gguf) | Q3_K_M | 3 | 32.2 GB| very small, high quality loss |
77
  | [Qwen1.5-110B-Chat-Q3_K_M-00002-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q3_K_M-00002-of-00002.gguf) | Q3_K_M | 3 | 21.5 GB| very small, high quality loss |
78
  | [Qwen1.5-110B-Chat-Q4_0-00001-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q4_0-00001-of-00002.gguf) | Q4_0 | 4 | 32.1 GB| legacy; small, very high quality loss - prefer using Q3_K_M |
 
73
  | Name | Quant method | Bits | Size | Use case |
74
  | ---- | ---- | ---- | ---- | ----- |
75
  | [Qwen1.5-110B-Chat-Q2_K.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q2_K.gguf) | Q2_K | 2 | 41.2 GB| smallest, significant quality loss - not recommended for most purposes |
76
+ | [Qwen1.5-110B-Chat-Q3_K_L-00001-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q3_K_L-00001-of-00002.gguf) | Q3_K_L | 3 | 32.2 GB| small, substantial quality loss |
77
+ | [Qwen1.5-110B-Chat-Q3_K_L-00002-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q3_K_L-00002-of-00002.gguf) | Q3_K_L | 3 | 26 GB| small, substantial quality loss |
78
  | [Qwen1.5-110B-Chat-Q3_K_M-00001-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q3_K_M-00001-of-00002.gguf) | Q3_K_M | 3 | 32.2 GB| very small, high quality loss |
79
  | [Qwen1.5-110B-Chat-Q3_K_M-00002-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q3_K_M-00002-of-00002.gguf) | Q3_K_M | 3 | 21.5 GB| very small, high quality loss |
80
  | [Qwen1.5-110B-Chat-Q4_0-00001-of-00002.gguf](https://huggingface.co/second-state/Qwen1.5-110B-Chat-GGUF/blob/main/Qwen1.5-110B-Chat-Q4_0-00001-of-00002.gguf) | Q4_0 | 4 | 32.1 GB| legacy; small, very high quality loss - prefer using Q3_K_M |