Update README.md
Browse files
README.md
CHANGED
|
@@ -8,6 +8,8 @@ base_model:
|
|
| 8 |
- NeverSleep/Lumimaid-v0.2-123B
|
| 9 |
---
|
| 10 |
|
|
|
|
|
|
|
| 11 |
# SmartMaid-123b
|
| 12 |
|
| 13 |
This **experimental model** is a hybrid creation combining aspects of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407) and [Lumimaid-v0.2-123B](https://huggingface.co/NeverSleep/Lumimaid-v0.2-123B) using LoRA (Low-Rank Adaptation) on the `mlp.down_proj` module.
|
|
|
|
| 8 |
- NeverSleep/Lumimaid-v0.2-123B
|
| 9 |
---
|
| 10 |
|
| 11 |
+
Update: After further testing, this has turned out exactly like I wanted, and is one of my favorite models! It remains coherant at higher contexts and doesn't suffer the repetition issues I was having with Lumimaid.
|
| 12 |
+
|
| 13 |
# SmartMaid-123b
|
| 14 |
|
| 15 |
This **experimental model** is a hybrid creation combining aspects of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407) and [Lumimaid-v0.2-123B](https://huggingface.co/NeverSleep/Lumimaid-v0.2-123B) using LoRA (Low-Rank Adaptation) on the `mlp.down_proj` module.
|