Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,12 @@ This repo contains 4bit GPTQ format quantised models of [OpenAccess AI Collectiv
|
|
| 16 |
|
| 17 |
It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
|
| 18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
## How to easily download and use this model in text-generation-webui
|
| 20 |
|
| 21 |
Open the text-generation-webui UI as normal.
|
|
|
|
| 16 |
|
| 17 |
It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com/qwopqwop200/GPTQ-for-LLaMa).
|
| 18 |
|
| 19 |
+
## Repositories available
|
| 20 |
+
|
| 21 |
+
* [4bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/wizard-mega-13B-GPTQ).
|
| 22 |
+
* [4bit and 5bit GGML models for CPU inference](https://huggingface.co/TheBloke/wizard-mega-13B-GGML).
|
| 23 |
+
* [OpenAccess AI Collective's original float16 HF format repo for GPU inference and further conversions](https://huggingface.co/openaccess-ai-collective/wizard-mega-13b).
|
| 24 |
+
|
| 25 |
## How to easily download and use this model in text-generation-webui
|
| 26 |
|
| 27 |
Open the text-generation-webui UI as normal.
|