|
--- |
|
license: other |
|
license_name: deepseek-license |
|
license_link: LICENSE |
|
quantized_by: bartowski |
|
pipeline_tag: text-generation |
|
base_model: deepseek-ai/DeepSeek-Coder-V2-Instruct |
|
--- |
|
Slowly creating, with imatrix, will add my usual details later |
|
|
|
So far IQ1_M is up with an eyewatering size of 52.7GB |
|
|
|
[IQ1_M](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-IQ1_M.gguf) |
|
|
|
[IQ2_XS](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-IQ2_XS.gguf) |
|
|
|
[Q2_K](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-Q2_K.gguf) |
