File size: 812 Bytes
4351136 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
---
library_name: transformers
tags:
- flow-merge
- merge
---
# qwen_merge_5
This model is the result of merge of the following models made with flow-merge:
- Base model:
- Qwen/Qwen1.5-0.5B
- Models:
- Qwen/Qwen1.5-0.5B-chat
- minghaowu/Qwen1.5-0.5B-OpenHermes-2.5
## flow-merge config
The following configuration was used to merge the models:
```yaml
base_model: Qwen/Qwen1.5-0.5B
models:
- path_or_id: Qwen/Qwen1.5-0.5B
- path_or_id: Qwen/Qwen1.5-0.5B-chat
- path_or_id: minghaowu/Qwen1.5-0.5B-OpenHermes-2.5
method: addition-task-arithmetic
device: !!python/object/apply:flow_merge.lib.constants.DeviceIdentifier
- cpu
method_global_parameters:
scaling_coefficient: 0.7
normalize: false
directory_settings:
cache_dir: null
local_dir: ./models
output_dir: ./merged_model/qwen_merge_5
```
|