--- base_model: - Aleteian/Instrumentality-2-MN-12B-RP - Aleteian/Saiga-Unleashed - Aleteian/Magnum-Opus-Galatea-MN-12B - Aleteian/On-the-Strange-Lands-MN-12B - Aleteian/Follow-the-Flow-MN-12B - Aleteian/Neverending-Story-MN-12B - Aleteian/Omnino-Obscoenum-Opus-Magnum-MN-12B - Aleteian/Way-to-Unseen-Horizon-MN-12B - Aleteian/Pathfinder-RP-12B-RU library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [Aleteian/Saiga-Unleashed](https://huggingface.co/Aleteian/Saiga-Unleashed) as a base. ### Models Merged The following models were included in the merge: * [Aleteian/Instrumentality-2-MN-12B-RP](https://huggingface.co/Aleteian/Instrumentality-2-MN-12B-RP) * [Aleteian/Magnum-Opus-Galatea-MN-12B](https://huggingface.co/Aleteian/Magnum-Opus-Galatea-MN-12B) * [Aleteian/On-the-Strange-Lands-MN-12B](https://huggingface.co/Aleteian/On-the-Strange-Lands-MN-12B) * [Aleteian/Follow-the-Flow-MN-12B](https://huggingface.co/Aleteian/Follow-the-Flow-MN-12B) * [Aleteian/Neverending-Story-MN-12B](https://huggingface.co/Aleteian/Neverending-Story-MN-12B) * [Aleteian/Omnino-Obscoenum-Opus-Magnum-MN-12B](https://huggingface.co/Aleteian/Omnino-Obscoenum-Opus-Magnum-MN-12B) * [Aleteian/Way-to-Unseen-Horizon-MN-12B](https://huggingface.co/Aleteian/Way-to-Unseen-Horizon-MN-12B) * [Aleteian/Pathfinder-RP-12B-RU](https://huggingface.co/Aleteian/Pathfinder-RP-12B-RU) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: Aleteian/Neverending-Story-MN-12B - model: Aleteian/Instrumentality-2-MN-12B-RP - model: Aleteian/Pathfinder-RP-12B-RU - model: Aleteian/On-the-Strange-Lands-MN-12B - model: Aleteian/Way-to-Unseen-Horizon-MN-12B - model: Aleteian/Omnino-Obscoenum-Opus-Magnum-MN-12B - model: Aleteian/Magnum-Opus-Galatea-MN-12B - model: Aleteian/Follow-the-Flow-MN-12B merge_method: model_stock base_model: Aleteian/Saiga-Unleashed dtype: bfloat16 tokenizer_source: "union" chat_template: "mistral" ```