Hugging Face's logo

parasail-ai
/
aya-23-8B-GPTQ-4bit

Text Generation
Transformers
Safetensors
cohere
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
aya-23-8B-GPTQ-4bit / README.md
Adam Lugowski
initial add
2f55815
preview code
|
raw
history blame contribute delete
336 Bytes
metadata
library_name: transformers
tags: []

Model Card for parasail-ai/aya-23-8B-GPTQ-4-bit

GPTQ quantized 4-bit version of CohereForAI/aya-23-8B, calibrated using aya_dataset. See original model card for more information.