aya-23-8B-GPTQ-4bit / README.md
Adam Lugowski
initial add
2f55815
---
library_name: transformers
tags: []
---
# Model Card for parasail-ai/aya-23-8B-GPTQ-4-bit
GPTQ quantized 4-bit version of [CohereForAI/aya-23-8B](https://huggingface.co/CohereForAI/aya-23-8B), calibrated using [aya_dataset](https://huggingface.co/datasets/CohereForAI/aya_dataset).
See original model card for more information.