TheBloke
/

wizard-mega-13B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on May 15, 2023

Commit

abf8554

·

1 Parent(s): 2eb56d6

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -18,8 +18,8 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
 ## Repositories available
-* [4bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/wizard-mega-13B-GPTQ).
-* [4bit and 5bit GGML models for CPU inference](https://huggingface.co/TheBloke/wizard-mega-13B-GGML).
 * [OpenAccess AI Collective's original float16 HF format repo for GPU inference and further conversions](https://huggingface.co/openaccess-ai-collective/wizard-mega-13b).
 ## How to easily download and use this model in text-generation-webui

 ## Repositories available
+* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/wizard-mega-13B-GPTQ).
+* [4-bit, 5-bit 8-bit GGML models for llama.cpp CPU (+CUDA) inference](https://huggingface.co/TheBloke/wizard-mega-13B-GGML).
 * [OpenAccess AI Collective's original float16 HF format repo for GPU inference and further conversions](https://huggingface.co/openaccess-ai-collective/wizard-mega-13b).
 ## How to easily download and use this model in text-generation-webui