Enable text inference

#2

I am not sure it works, but worth a try

I have tested the models, they work fine.

PS: Hugging Face doesn't support GGUF models to enable the inference.

MaziyarPanahi changed pull request status to closed

Sign up or log in to comment