--- base_model: - Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture - Kaoeiri/Mistral-magnum_X_Cydonia-v1.3_X_Waifu-22B - byroneverson/Mistral-Small-Instruct-2409-abliterated - Kaoeiri/Magnum-v4-Cydonia-v1.3-22B - Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-B - Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-C - Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-D library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [byroneverson/Mistral-Small-Instruct-2409-abliterated](https://huggingface.co/byroneverson/Mistral-Small-Instruct-2409-abliterated) as a base. ### Models Merged The following models were included in the merge: * [Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture](https://huggingface.co/Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture) * [Kaoeiri/Mistral-magnum_X_Cydonia-v1.3_X_Waifu-22B](https://huggingface.co/Kaoeiri/Mistral-magnum_X_Cydonia-v1.3_X_Waifu-22B) * [Kaoeiri/Magnum-v4-Cydonia-v1.3-22B](https://huggingface.co/Kaoeiri/Magnum-v4-Cydonia-v1.3-22B) * [Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-B](https://huggingface.co/Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-B) * [Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-C](https://huggingface.co/Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-C) * [Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-D](https://huggingface.co/Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-D) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-D - model: Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-C - model: Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture-B - model: Kaoeiri/Mistral-magnum-v4_X_Cydonia-VXXX_Mixture - model: Kaoeiri/Mistral-magnum_X_Cydonia-v1.3_X_Waifu-22B - model: Kaoeiri/Magnum-v4-Cydonia-v1.3-22B merge_method: model_stock base_model: byroneverson/Mistral-Small-Instruct-2409-abliterated dtype: bfloat16 tokenizer_source: union ```