--- base_model: - anthracite-org/magnum-v4-22b - knifeayumu/Cydonia-v1.2-v1.3-22B library_name: transformers tags: - mergekit - merge license: other license_name: mrl inference: false license_link: https://mistral.ai/licenses/MRL-0.1.md --- # Cydonia-v1.25-Magnum-v4-22B* Supposedly halfway between [knifeayumu/Cydonia-v1.2-Magnum-v4-22B](https://huggingface.co/knifeayumu/Cydonia-v1.2-Magnum-v4-22B) and [knifeayumu/Cydonia-v1.3-Magnum-v4-22B](https://huggingface.co/knifeayumu/Cydonia-v1.3-Magnum-v4-22B). For some reason, I used a different method instead of merging both of those... IDK why but if it works well, give me a thumbs up(?) This is a merge of pre-trained language models created using [mergekit](https://github.com/arcee-ai/mergekit). ## Merge Details ### Merge Method This model was merged using the SLERP merge method. ### Models Merged The following models were included in the merge: * [anthracite-org/magnum-v4-22b](https://huggingface.co/anthracite-org/magnum-v4-22b) * [knifeayumu/Cydonia-v1.2-v1.3-22B](https://huggingface.co/knifeayumu/Cydonia-v1.2-v1.3-22B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: knifeayumu/Cydonia-v1.2-v1.3-22B - model: anthracite-org/magnum-v4-22b merge_method: slerp base_model: knifeayumu/Cydonia-v1.2-v1.3-22B parameters: t: [0.1, 0.3, 0.6, 0.3, 0.1] dtype: bfloat16 ```