Based on llama-cpp-python we present a GGUF model hosted on this Huggingface Space. The model is accessible through an OpenAI-compatible API. This space includes comprehensive API documentation to facilitate seamless integration.