aya-23-8B-GGUF

This is GGUF quantized version of CohereForAI/aya-23-8B created using llama.cpp 74f33adf

Downloads last month: 23

GGUF

Model size

8.03B params

Architecture

command-r

4-bit

5-bit

6-bit

8-bit

16-bit

View +1 file

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the HF Inference API does not support gguf models with pipeline type text-generation

Model tree for legraphista/aya-23-8B-GGUF

Base model

CohereForAI/aya-23-8B

Quantized

(16)

this model

Collection including legraphista/aya-23-8B-GGUF

aya-23

Collection

4 items • Updated Aug 5, 2024