YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Compatibilty These files are not compatible with llama.cpp.
Currently they can be used with:
KoboldCpp, a powerful inference engine based on llama.cpp, with good UI: KoboldCpp The ctransformers Python library, which includes LangChain support: ctransformers The GPT4All-UI which uses ctransformers: GPT4All-UI rustformers' llm The example mpt binary provided with ggml
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.