Update README.md
Browse files
README.md
CHANGED
|
@@ -29,15 +29,14 @@ tags:
|
|
| 29 |
# About
|
| 30 |
|
| 31 |
<!-- ### quantize_version: 3 -->
|
| 32 |
-
<!-- ### output_tensor_quantised: 1 -->
|
| 33 |
<!-- ### convert_type: hf -->
|
| 34 |
-
|
| 35 |
-
|
|
|
|
| 36 |
|
| 37 |
- Static quants of https://huggingface.co/Replete-AI/Replete-LLM-Qwen2-7b at commit [e356943](https://huggingface.co/Replete-AI/Replete-LLM-Qwen2-7b/commit/e3569433b23fde853683ad61f342d2c1bd01d60a)
|
| 38 |
- Quantized by [ThiloteE](https://huggingface.co/ThiloteE) with llama.cpp commit [e09a800](https://github.com/ggerganov/llama.cpp/commit/e09a800f9a9b19c73aa78e03b4c4be8ed988f3e6)
|
| 39 |
|
| 40 |
-
# Notes
|
| 41 |
|
| 42 |
These quants were created with a customized configuration that have been proven to not cause visible end of string (eos) tokens during inference with [GPT4All](https://www.nomic.ai/gpt4all).
|
| 43 |
The config.json, generation_config.json and tokenizer_config.json differ from the original configuration as can be found in the original model's repository at the time of creation of these quants.
|
|
|
|
| 29 |
# About
|
| 30 |
|
| 31 |
<!-- ### quantize_version: 3 -->
|
|
|
|
| 32 |
<!-- ### convert_type: hf -->
|
| 33 |
+
|
| 34 |
+
This is a featured model that is assumed to perform well, but may require more testing and user feedback. Be aware, only models that also are featured within the GUI of GPT4All, are curated and officially supported by Nomic. Use at your own risk.
|
| 35 |
+
|
| 36 |
|
| 37 |
- Static quants of https://huggingface.co/Replete-AI/Replete-LLM-Qwen2-7b at commit [e356943](https://huggingface.co/Replete-AI/Replete-LLM-Qwen2-7b/commit/e3569433b23fde853683ad61f342d2c1bd01d60a)
|
| 38 |
- Quantized by [ThiloteE](https://huggingface.co/ThiloteE) with llama.cpp commit [e09a800](https://github.com/ggerganov/llama.cpp/commit/e09a800f9a9b19c73aa78e03b4c4be8ed988f3e6)
|
| 39 |
|
|
|
|
| 40 |
|
| 41 |
These quants were created with a customized configuration that have been proven to not cause visible end of string (eos) tokens during inference with [GPT4All](https://www.nomic.ai/gpt4all).
|
| 42 |
The config.json, generation_config.json and tokenizer_config.json differ from the original configuration as can be found in the original model's repository at the time of creation of these quants.
|