---
license: other
license_name: deepseek-license
license_link: LICENSE
quantized_by: bartowski
pipeline_tag: text-generation
base_model: deepseek-ai/DeepSeek-Coder-V2-Instruct
---
Slowly creating, with imatrix, will add my usual details later

So far IQ1_M is up with an eyewatering size of 52.7GB

[IQ1_M](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-IQ1_M.gguf)

[IQ2_XS](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-IQ2_XS.gguf)