merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the linear merge method using fblgit/cybertron-v4-qw7B-UNAMGS as a base.
Models Merged
The following models were included in the merge:
- prithivMLmods/QwQ-LCoT-7B-Instruct
- bunnycore/FuseQwQen-7B
- prithivMLmods/Neumind-Math-7B-Instruct
- ClaudioItaly/Follex-7B
Configuration
The following YAML configuration was used to produce this model:
merge_method: linear
dtype: bfloat16
normalize: true
base_model: fblgit/cybertron-v4-qw7B-UNAMGS
models:
- model: ClaudioItaly/Follex-7B
parameters:
weight: 10
density: 1
- model: prithivMLmods/QwQ-LCoT-7B-Instruct
parameters:
weight: 7
density: 0.5
- model: bunnycore/FuseQwQen-7B
parameters:
weight: 8
density: 0.4
- model: prithivMLmods/Neumind-Math-7B-Instruct
parameters:
weight: 8
density: 0.4
- model: fblgit/cybertron-v4-qw7B-UNAMGS
parameters:
weight: 8
density: 0.45
- Downloads last month
- 14
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.