Text Generation
Transformers
PyTorch
Safetensors
English
llama
text-generation-inference
Inference Endpoints

Only the q4 model works - there was a bug in convert.py that made them

#2
by ubuntulover - opened

Sorry not on this repo, but the -GGUF reop

ubuntulover changed discussion status to closed

Sign up or log in to comment