About
In the repository you can find only quantized versions of https://huggingface.co/CYFRAGOVPL/Llama-PLLuM-70B-instruct model. I am not the author of the model. I just converted to GGUF and quantized models.
Available versions
- Q4_K_M
- Q8
- Downloads last month
- 58
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no pipeline_tag.
Model tree for BMarcin/Llama-PLLuM-70B-chat-GGUF
Base model
CYFRAGOVPL/Llama-PLLuM-70B-instruct