Update README.md
Browse files
README.md
CHANGED
|
@@ -4,6 +4,9 @@ license: cc-by-nc-4.0
|
|
| 4 |
## There's some kind of gguf tokenization issue where its not properly handling the <|im_end|> EOS token and instead breaks it into multiple smaller ones which degrades performance for gguf users. Need to submit an issue ticket. Unsure if this impacts other quantization formats.
|
| 5 |
## If possible, please use the safetensors or Exllama2 for best performance. Exllama2 tokenizes correctly.
|
| 6 |
|
|
|
|
|
|
|
|
|
|
| 7 |
[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
|
| 8 |
|
| 9 |
This is the first public release of the Humanize model I've been working on. That way folks have a stable repo to download from and can expect some consistient level of performance when downloading.
|
|
|
|
| 4 |
## There's some kind of gguf tokenization issue where its not properly handling the <|im_end|> EOS token and instead breaks it into multiple smaller ones which degrades performance for gguf users. Need to submit an issue ticket. Unsure if this impacts other quantization formats.
|
| 5 |
## If possible, please use the safetensors or Exllama2 for best performance. Exllama2 tokenizes correctly.
|
| 6 |
|
| 7 |
+
Thank you to Lucyknada for Exl2 Quants
|
| 8 |
+
https://huggingface.co/lucyknada/cgato_Nemo-12b-Humanize-KTO-v0.1-exl2
|
| 9 |
+
|
| 10 |
[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
|
| 11 |
|
| 12 |
This is the first public release of the Humanize model I've been working on. That way folks have a stable repo to download from and can expect some consistient level of performance when downloading.
|