aya-23-8B-GGUF

Downloads last month
34
GGUF
Model size
8.03B params
Architecture
command-r

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples
Inference API (serverless) does not yet support gguf models for this pipeline type.

Model tree for legraphista/aya-23-8B-GGUF

Quantized
(15)
this model

Collection including legraphista/aya-23-8B-GGUF