Hugging Face's logo

jondurbin
/
airoboros-13b

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Model card Files Community
8

4bit?

#2
by Boffy - opened
Discussion
Boffy

4bit?

jondurbin
 Owner

https://huggingface.co/jondurbin/airoboros-13b-ggml-q4_0

Or the 7b version: https://huggingface.co/jondurbin/airoboros-7b-ggml-q4_0

Boffy

ggml? but that's not gpu accelerated is it? I just looking for a the 4bit one that does work on gpu

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment