--- base_model: - anthracite-org/magnum-v4-22b - knifeayumu/Cydonia-v1.2-v1.3-22B library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the SLERP merge method. ### Models Merged The following models were included in the merge: * [anthracite-org/magnum-v4-22b](https://huggingface.co/anthracite-org/magnum-v4-22b) * [knifeayumu/Cydonia-v1.2-v1.3-22B](https://huggingface.co/knifeayumu/Cydonia-v1.2-v1.3-22B) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: knifeayumu/Cydonia-v1.2-v1.3-22B - model: anthracite-org/magnum-v4-22b merge_method: slerp base_model: knifeayumu/Cydonia-v1.2-v1.3-22B parameters: t: [0.1, 0.3, 0.6, 0.3, 0.1] dtype: bfloat16 ```