Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
legraphista
/
aya-23-35B-GGUF
like
2
Text Generation
GGUF
23 languages
conversational
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
Deploy
Use this model
aya-23-35B-GGUF
aya-23-35B-GGUF
This is GGUF quantized version of
CohereForAI/aya-23-35B
created using llama.cpp
74f33adf
Downloads last month
217
GGUF
Model size
35B params
Architecture
command-r
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
13.8 GB
3-bit
Q3_K_S
15.9 GB
Q3_K
17.6 GB
Q3_K_M
17.6 GB
Q3_K_L
19.1 GB
4-bit
Q4_K_S
20.4 GB
Q4_K
21.5 GB
Q4_K_M
21.5 GB
5-bit
Q5_K_S
24.3 GB
Q5_K
25 GB
Q5_K_M
25 GB
6-bit
Q6_K
28.7 GB
8-bit
Q8_0
37.2 GB
16-bit
BF16
70 GB
View +1 variant
Inference Providers
NEW
Text Generation
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.
Model tree for
legraphista/aya-23-35B-GGUF
Base model
CohereForAI/aya-23-35B
Quantized
(
12
)
this model
Collection including
legraphista/aya-23-35B-GGUF
aya-23
Collection
4 items
โข
Updated
Aug 5, 2024