--- base_model: - sometimesanotion/Qwenvergence-14B-v3-Prose - sometimesanotion/LoRA-la128 - Krystalan/DRT-o1-14B - huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated - sometimesanotion/Lamarck-14B-v0.7 - sometimesanotion/Lamarck-14B-v0.3 - sometimesanotion/LoRA-la128 - sometimesanotion/Qwenvergence-14B-v9 - sometimesanotion/LoRA-la128 - sometimesanotion/Qwenvergence-14B-v9 library_name: transformers tags: - mergekit - merge license: apache-2.0 language: - en metrics: - accuracy pipeline_tag: text-generation --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [sometimesanotion/Qwenvergence-14B-v9](https://huggingface.co/sometimesanotion/Qwenvergence-14B-v9) as a base. ### Models Merged The following models were included in the merge: * [sometimesanotion/Qwenvergence-14B-v3-Prose](https://huggingface.co/sometimesanotion/Qwenvergence-14B-v3-Prose) + [sometimesanotion/LoRA-la128](https://huggingface.co/sometimesanotion/LoRA-la128) * [Krystalan/DRT-o1-14B](https://huggingface.co/Krystalan/DRT-o1-14B) * [huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated](https://huggingface.co/huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated) * [sometimesanotion/Lamarck-14B-v0.7](https://huggingface.co/sometimesanotion/Lamarck-14B-v0.7) * [sometimesanotion/Lamarck-14B-v0.3](https://huggingface.co/sometimesanotion/Lamarck-14B-v0.3) + [sometimesanotion/LoRA-la128](https://huggingface.co/sometimesanotion/LoRA-la128) * [sometimesanotion/Qwenvergence-14B-v9](https://huggingface.co/sometimesanotion/Qwenvergence-14B-v9) + [sometimesanotion/LoRA-la128](https://huggingface.co/sometimesanotion/LoRA-la128) ### Configuration The following YAML configuration was used to produce this model: ```yaml name: Qwenvergence-14B-v10 merge_method: model_stock base_model: sometimesanotion/Qwenvergence-14B-v9 tokenizer_source: base dtype: float32 out_dtype: bfloat16 parameters: int8_mask: true normalize: true rescale: false models: - model: sometimesanotion/Lamarck-14B-v0.7 - model: sometimesanotion/Qwenvergence-14B-v3-Prose+sometimesanotion/LoRA-la128 - model: huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated - model: sometimesanotion/Lamarck-14B-v0.3+sometimesanotion/LoRA-la128 - model: huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated - model: Krystalan/DRT-o1-14B - model: sometimesanotion/Qwenvergence-14B-v9+sometimesanotion/LoRA-la128 - model: sometimesanotion/Qwenvergence-14B-v3-Prose+sometimesanotion/LoRA-la128 ```