| library_name: transformers | |
| tags: [] | |
| # BrokenSoul/GPT2-GPTQ-4bit | |
| <!-- Provide a quick summary of what the model is/does. --> | |
| This is a GPT2 Quantized model following this tutorial: [4-bit LLM Quantization with GPTQ](https://mlabonne.github.io/blog/posts/4_bit_Quantization_with_GPTQ.html). |