library_name: transformers | |
tags: [] | |
# Model Card for parasail-ai/aya-23-8B-GPTQ-4-bit | |
GPTQ quantized 4-bit version of [CohereForAI/aya-23-8B](https://huggingface.co/CohereForAI/aya-23-8B), calibrated using [aya_dataset](https://huggingface.co/datasets/CohereForAI/aya_dataset). | |
See original model card for more information. | |