OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack
#41
by
swathiKonakanchi
- opened
Facing below error whentried with the code
from transformers import pipeline
pipe = pipeline("text-generation", model="TheBloke/Llama-2-7B-Chat-GGML")
OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack
@swathiKonakanchi
well first ggml is outdated(newer version of ggml is gguf)
use gguf models thebloke provides since only those work
2nd, gguf models only work with anything that uses llama cpp such as
text generation webui, ctransformers, llama cpp python, llama cpp itself, ollama.(there are much more that was some)