| library_name: transformers | |
| tags: | |
| - flow-merge | |
| - merge | |
| # qwen_merge_5 | |
| This model is the result of merge of the following models made with flow-merge: | |
| - Base model: | |
| - Qwen/Qwen1.5-0.5B | |
| - Models: | |
| - Qwen/Qwen1.5-0.5B-chat | |
| - minghaowu/Qwen1.5-0.5B-OpenHermes-2.5 | |
| ## flow-merge config | |
| The following configuration was used to merge the models: | |
| ```yaml | |
| base_model: Qwen/Qwen1.5-0.5B | |
| models: | |
| - path_or_id: Qwen/Qwen1.5-0.5B | |
| - path_or_id: Qwen/Qwen1.5-0.5B-chat | |
| - path_or_id: minghaowu/Qwen1.5-0.5B-OpenHermes-2.5 | |
| method: addition-task-arithmetic | |
| device: !!python/object/apply:flow_merge.lib.constants.DeviceIdentifier | |
| - cpu | |
| method_global_parameters: | |
| scaling_coefficient: 0.7 | |
| normalize: false | |
| directory_settings: | |
| cache_dir: null | |
| local_dir: ./models | |
| output_dir: ./merged_model/qwen_merge_5 | |
| ``` | |