Not able to use with ctransformers

#12
by aravindsr - opened

Hi, do these GGUF files work with ctransformers?

@aravindsr no, they do not. Ctransformers is somewhat out of date, and does not have most new features. Use llama cpp python since its faster + it supports these models and it regularly gets updated.

Sign up or log in to comment