Hugging Face's logo

second-state
/
DeepSeek-Coder-V2-Instruct-GGUF

GGUF
deepseek_v2
custom_code
conversational
Model card Files Community
apepkuss79 commited on
Commit
7df7fbd
•
1 Parent(s): 45d714d

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +19 -4
README.md CHANGED
@@ -83,10 +83,25 @@ quantized_by: Second State Inc.
83
  | [DeepSeek-Coder-V2-Instruct-Q3_K_M-00002-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_M-00002-of-00004.gguf) | Q3_K_M | 3 | 29.5 GB| very small, high quality loss |
84
  | [DeepSeek-Coder-V2-Instruct-Q3_K_M-00003-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_M-00003-of-00004.gguf) | Q3_K_M | 3 | 29.8 GB| very small, high quality loss |
85
  | [DeepSeek-Coder-V2-Instruct-Q3_K_M-00004-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_M-00004-of-00004.gguf) | Q3_K_M | 3 | 23.8 GB| very small, high quality loss |
86
- | [DeepSeek-Coder-V2-Instruct-Q3_K_S.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_S.gguf) | Q3_K_S | 3 | 7.49 GB| very small, high quality loss |
87
- | [DeepSeek-Coder-V2-Instruct-Q4_0.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_0.gguf) | Q4_0 | 4 | 8.91 GB| legacy; small, very high quality loss - prefer using Q3_K_M |
88
- | [DeepSeek-Coder-V2-Instruct-Q4_K_M.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_M.gguf) | Q4_K_M | 4 | 10.4 GB| medium, balanced quality - recommended |
89
- | [DeepSeek-Coder-V2-Instruct-Q4_K_S.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_S.gguf) | Q4_K_S | 4 | 9.53 GB| small, greater quality loss |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
90
  | [DeepSeek-Coder-V2-Instruct-Q5_0.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q5_0.gguf) | Q5_0 | 5 | 10.8 GB| legacy; medium, balanced quality - prefer using Q4_K_M |
91
  | [DeepSeek-Coder-V2-Instruct-Q5_K_M.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q5_K_M.gguf) | Q5_K_M | 5 | 11.9 GB| large, very low quality loss - recommended |
92
  | [DeepSeek-Coder-V2-Instruct-Q5_K_S.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q5_K_S.gguf) | Q5_K_S | 5 | 11.1 GB| large, low quality loss - recommended |
 
83
  | [DeepSeek-Coder-V2-Instruct-Q3_K_M-00002-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_M-00002-of-00004.gguf) | Q3_K_M | 3 | 29.5 GB| very small, high quality loss |
84
  | [DeepSeek-Coder-V2-Instruct-Q3_K_M-00003-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_M-00003-of-00004.gguf) | Q3_K_M | 3 | 29.8 GB| very small, high quality loss |
85
  | [DeepSeek-Coder-V2-Instruct-Q3_K_M-00004-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_M-00004-of-00004.gguf) | Q3_K_M | 3 | 23.8 GB| very small, high quality loss |
86
+ | [DeepSeek-Coder-V2-Instruct-Q3_K_S-00001-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_S-00001-of-00004.gguf) | Q3_K_S | 3 | 29.9 GB| very small, high quality loss |
87
+ | [DeepSeek-Coder-V2-Instruct-Q3_K_S-00002-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_S-00002-of-00004.gguf) | Q3_K_S | 3 | 29.7 GB| very small, high quality loss |
88
+ | [DeepSeek-Coder-V2-Instruct-Q3_K_S-00003-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_S-00003-of-00004.gguf) | Q3_K_S | 3 | 29.6 GB| very small, high quality loss |
89
+ | [DeepSeek-Coder-V2-Instruct-Q3_K_S-00004-of-00004.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q3_K_S-00004-of-00004.gguf) | Q3_K_S | 3 | 12.5 GB| very small, high quality loss |
90
+ | [DeepSeek-Coder-V2-Instruct-Q4_0-00001-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_0-00001-of-00005.gguf) | Q4_0 | 4 | 30.0 GB| legacy; small, very high quality loss - prefer using Q3_K_M |
91
+ | [DeepSeek-Coder-V2-Instruct-Q4_0-00002-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_0-00002-of-00005.gguf) | Q4_0 | 4 | 29.9 GB| legacy; small, very high quality loss - prefer using Q3_K_M |
92
+ | [DeepSeek-Coder-V2-Instruct-Q4_0-00003-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_0-00003-of-00005.gguf) | Q4_0 | 4 | 29.8 GB| legacy; small, very high quality loss - prefer using Q3_K_M |
93
+ | [DeepSeek-Coder-V2-Instruct-Q4_0-00004-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_0-00004-of-00005.gguf) | Q4_0 | 4 | 29.9 GB| legacy; small, very high quality loss - prefer using Q3_K_M |
94
+ | [DeepSeek-Coder-V2-Instruct-Q4_0-00005-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_0-00005-of-00005.gguf) | Q4_0 | 4 | 13.3 GB| legacy; small, very high quality loss - prefer using Q3_K_M |
95
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_M-00001-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_M-00001-of-00005.gguf) | Q4_K_M | 4 | 29.7 GB| medium, balanced quality - recommended |
96
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_M-00002-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_M-00002-of-00005.gguf) | Q4_K_M | 4 | 29.7 GB| medium, balanced quality - recommended |
97
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_M-00003-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_M-00003-of-00005.gguf) | Q4_K_M | 4 | 29.7 GB| medium, balanced quality - recommended |
98
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_M-00004-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_M-00004-of-00005.gguf) | Q4_K_M | 4 | 29.6 GB| medium, balanced quality - recommended |
99
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_M-00005-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_M-00005-of-00005.gguf) | Q4_K_M | 4 | 23.8 GB| medium, balanced quality - recommended |
100
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_S-00001-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_S-00001-of-00005.gguf) | Q4_K_S | 4 | 29.6 GB| small, greater quality loss |
101
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_S-00002-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_S-00002-of-00005.gguf) | Q4_K_S | 4 | 29.8 GB| small, greater quality loss |
102
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_S-00003-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_S-00003-of-00005.gguf) | Q4_K_S | 4 | 29.9 GB| small, greater quality loss |
103
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_S-00004-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_S-00004-of-00005.gguf) | Q4_K_S | 4 | 29.8 GB| small, greater quality loss |
104
+ | [DeepSeek-Coder-V2-Instruct-Q4_K_S-00005-of-00005.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q4_K_S-00005-of-00005.gguf) | Q4_K_S | 4 | 14.8 GB| small, greater quality loss |
105
  | [DeepSeek-Coder-V2-Instruct-Q5_0.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q5_0.gguf) | Q5_0 | 5 | 10.8 GB| legacy; medium, balanced quality - prefer using Q4_K_M |
106
  | [DeepSeek-Coder-V2-Instruct-Q5_K_M.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q5_K_M.gguf) | Q5_K_M | 5 | 11.9 GB| large, very low quality loss - recommended |
107
  | [DeepSeek-Coder-V2-Instruct-Q5_K_S.gguf](https://huggingface.co/second-state/DeepSeek-Coder-V2-Instruct-GGUF/blob/main/DeepSeek-Coder-V2-Instruct-Q5_K_S.gguf) | Q5_K_S | 5 | 11.1 GB| large, low quality loss - recommended |