|
--- |
|
license: cc-by-nc-4.0 |
|
base_model: |
|
- knifeayumu/Cydonia-v1.2-Magnum-v4-22B |
|
- Steelskull/MSM-MS-Cydrion-22B |
|
- TheDrummer/Cydonia-22B-v1.3 |
|
library_name: transformers |
|
tags: |
|
- mergekit |
|
- merge |
|
|
|
--- |
|
What is this? |
|
|
|
Model merge, I tested with Q4_K_S, so maybe that not final result. Overall, decent model, not too good or too bad. Still good for play RP, ERP if you have 16-24GB VRAM. |
|
|
|
Recommend CHATML, Mistral V3 instruct. Or you can find what is the best for you. Have fun! |
|
|
|
<details> |
|
<summary>Merge Detail</summary> |
|
<p> |
|
### Models Merged |
|
|
|
The following models were included in the merge: |
|
* [knifeayumu/Cydonia-v1.2-Magnum-v4-22B](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B) |
|
* [Steelskull/MSM-MS-Cydrion-22B](https://huggingface.co/Steelskull/MSM-MS-Cydrion-22B) |
|
|
|
### Configuration |
|
|
|
The following YAML configuration was used to produce this model: |
|
|
|
```yaml |
|
models: |
|
- model: knifeayumu/Cydonia-v1.2-Magnum-v4-22B |
|
parameters: |
|
density: 0.9 |
|
weight: 1 |
|
- model: Steelskull/MSM-MS-Cydrion-22B |
|
parameters: |
|
density: 0.6 |
|
weight: 0.8 |
|
merge_method: dare_ties |
|
base_model: TheDrummer/Cydonia-22B-v1.3 |
|
tokenizer_source: base |
|
|
|
``` |
|
|
|
</p> |
|
</details> |
|
|
|
|
