Anthonyg5005
/

turbcat-instruct-8b-int8-ct2

Text Generation

quantized model

Model card Files Files and versions Community

Anthonyg5005 commited on Jun 20, 2024

Commit

35d55ca

·

verified ·

1 Parent(s): 914ddd3

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -16,9 +16,9 @@ tags:
 - int8
 base_model: turboderp/llama3-turbcat-instruct-8b
 ---
-# CTranslate2 int8 version of turbcat
-This is a int8_float16 quantization of [turbcat](https://huggingface.co/turboderp/llama3-turbcat-instruct-8b)\
 See more on CTranslate2: [Docs](https://opennmt.net/CTranslate2/index.html) | [Github](https://github.com/OpenNMT/CTranslate2)
 This model and it's dataset was created by [Kaltcit](discord://discord.com/users/550000146289524737), an admin of the [Exllama](https://discord.gg/NSFwVuCjRq) Discord server.

 - int8
 base_model: turboderp/llama3-turbcat-instruct-8b
 ---
+# CTranslate2 int8 version of turbcat 8b
+This is a int8_float16 quantization of [turbcat 8b](https://huggingface.co/turboderp/llama3-turbcat-instruct-8b)\
 See more on CTranslate2: [Docs](https://opennmt.net/CTranslate2/index.html) | [Github](https://github.com/OpenNMT/CTranslate2)
 This model and it's dataset was created by [Kaltcit](discord://discord.com/users/550000146289524737), an admin of the [Exllama](https://discord.gg/NSFwVuCjRq) Discord server.