Hugging Face's logo

Aryanne
/
Mamba-gpt-3B-v4-ggml-and-gguf

Text Generation
GGUF
English
Inference Endpoints
Model card Files Community
1

q4_1

#1
by ct-2 - opened
Discussion
ct-2

thank you for making the models available. If possible, add q4_1?

Aryanne
 Owner

@ct-2 🙌 uploading soon

Aryanne
 Owner
•
edited Sep 8, 2023

uploaded https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/blob/main/q4_1-ggml-mamba-gpt-3B_v4.bin

Aryanne changed discussion status to closed
ct-2

thanks!, is .gguf available too? Whoops should've been specific

Aryanne
 Owner

https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/blob/main/q4_1-gguf-mamba-gpt-3B_v4.gguf

ct-2

🤗🤗

Sign up or log in to comment