pip install ctransformers
from ctransformers import AutoModelForCausalLM

llm = AutoModelForCausalLM.from_pretrained('marella/gpt-2-ggml')

print(llm('AI is going to'))

See https://github.com/marella/ctransformers

Downloads last month
255
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Spaces using marella/gpt-2-ggml 2