--- base_model: - 01-ai/Yi-1.5-9B - BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B - vicgalle/Configurable-Yi-1.5-9B-Chat - byroneverson/Yi-1.5-9B-Chat-abliterated - cognitivecomputations/dolphin-2.9.1-yi-1.5-9b library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [01-ai/Yi-1.5-9B](https://huggingface.co/01-ai/Yi-1.5-9B) as a base. ### Models Merged The following models were included in the merge: * [BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B](https://huggingface.co/BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B) * [vicgalle/Configurable-Yi-1.5-9B-Chat](https://huggingface.co/vicgalle/Configurable-Yi-1.5-9B-Chat) * [byroneverson/Yi-1.5-9B-Chat-abliterated](https://huggingface.co/byroneverson/Yi-1.5-9B-Chat-abliterated) * [cognitivecomputations/dolphin-2.9.1-yi-1.5-9b](https://huggingface.co/cognitivecomputations/dolphin-2.9.1-yi-1.5-9b) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: byroneverson/Yi-1.5-9B-Chat-abliterated - model: BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B - model: cognitivecomputations/dolphin-2.9.1-yi-1.5-9b - model: vicgalle/Configurable-Yi-1.5-9B-Chat merge_method: model_stock base_model: 01-ai/Yi-1.5-9B dtype: bfloat16 ```