Hugging Face's logo

Alcoft
/
granite-3.1-3b-a800m-instruct-GGUF

Text Generation
GGUF
Mixture of Experts
Inference Endpoints
conversational
Model card Files Community
README.md exists but content is empty.
Downloads last month
284
GGUF
Model size
3.3B params
Architecture
granitemoe

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples
Text Generation
Unable to determine this model's library. Check the docs .

Model tree for Alcoft/granite-3.1-3b-a800m-instruct-GGUF

Base model

ibm-granite/granite-3.1-3b-a800m-base
Finetuned
ibm-granite/granite-3.1-3b-a800m-instruct
Quantized
(7)
this model

Collection including Alcoft/granite-3.1-3b-a800m-instruct-GGUF