GGUF
Orca
llama
llama2
Inference Endpoints
Orca-2-GGUF / README.md
kroonen's picture
Update README.md
4ef0371
---
license: mit
datasets:
- open-llm-leaderboard/details_microsoft__Orca-2-7b_public
- open-llm-leaderboard/details_microsoft__Orca-2-13b_public
tags:
- Orca
- gguf
- llama
- llama2
---
This is a quantized **GGUF** version of **Orca-2 7B and 13B** quantized to **4_0** and **8_0** bits.
*(link to the original model : https://www.microsoft.com/en-us/research/blog/orca-2-teaching-small-language-models-how-to-reason/)*