Original model: Poro-34B-chat

GGUF-format model files quantized using llama.cpp

We have Q4_K_M and Q5_K_M quantized models available.

GGUF

Model size

35.1B params

Architecture

bloom

4-bit

5-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including LumiOpen/Poro-34B-chat-GGUF