| license: apache-2.0 | |
| tags: | |
| - merge | |
| - mergekit | |
| - lazymergekit | |
| - rombodawg/Rombos-LLM-V2.5-Qwen-7b | |
| - fblgit/cybertron-v4-qw7B-MGS | |
| - newsbang/Homer-7B-v0.2 | |
| # Qandora-2.5-7B | |
| Qandora-2.5-7B is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): | |
| * [rombodawg/Rombos-LLM-V2.5-Qwen-7b](https://huggingface.co/rombodawg/Rombos-LLM-V2.5-Qwen-7b) | |
| * [fblgit/cybertron-v4-qw7B-MGS](https://huggingface.co/fblgit/cybertron-v4-qw7B-MGS) | |
| * [newsbang/Homer-7B-v0.2](https://huggingface.co/newsbang/Homer-7B-v0.2) | |
| ## 🧩 Configuration | |
| ```yaml | |
| models: | |
| - model: rombodawg/Rombos-LLM-V2.5-Qwen-7b | |
| parameters: | |
| weight: 0.5 | |
| - model: fblgit/cybertron-v4-qw7B-MGS | |
| parameters: | |
| weight: 0.5 | |
| - model: newsbang/Homer-7B-v0.2 | |
| parameters: | |
| weight: 0.5 | |
| merge_method: linear | |
| dtype: bfloat16 | |
| ``` |