File size: 844 Bytes
6abe9ef
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- rombodawg/Rombos-LLM-V2.5-Qwen-7b
- fblgit/cybertron-v4-qw7B-MGS
- newsbang/Homer-7B-v0.2
---

# Qandora-2.5-7B

Qandora-2.5-7B is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
* [rombodawg/Rombos-LLM-V2.5-Qwen-7b](https://huggingface.co/rombodawg/Rombos-LLM-V2.5-Qwen-7b)
* [fblgit/cybertron-v4-qw7B-MGS](https://huggingface.co/fblgit/cybertron-v4-qw7B-MGS)
* [newsbang/Homer-7B-v0.2](https://huggingface.co/newsbang/Homer-7B-v0.2)

## 🧩 Configuration

```yaml


models:
  - model: rombodawg/Rombos-LLM-V2.5-Qwen-7b
    parameters:
      weight: 0.5
  - model: fblgit/cybertron-v4-qw7B-MGS
    parameters:
      weight: 0.5
  - model: newsbang/Homer-7B-v0.2
    parameters:
      weight: 0.5
merge_method: linear
dtype: bfloat16



```