prithivMLmods commited on
Commit
de6ac7b
·
verified ·
1 Parent(s): 0777b6f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -5
README.md CHANGED
@@ -9,22 +9,24 @@ tags:
9
  - merge
10
 
11
  ---
12
- # merge
 
 
 
13
 
14
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
15
 
16
- ## Merge Details
17
- ### Merge Method
18
 
19
  This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) as a base.
20
 
21
- ### Models Merged
22
 
23
  The following models were included in the merge:
24
  * [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview)
25
  * [deepseek-ai/DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B)
26
 
27
- ### Configuration
28
 
29
  The following YAML configuration was used to produce this model:
30
 
 
9
  - merge
10
 
11
  ---
12
+ # **Qwen2.5-32B-DeepSeek-R1-Instruct**
13
+
14
+ This model is a merged pre-trained language model created using MergeKit with the TIES merge method. It uses **Qwen/Qwen2.5-32B-Instruct** as the base and combines **Qwen/QwQ-32B-Preview** and **deepseek-ai/DeepSeek-R1-Distill-Qwen-32B** with equal weight and density. The merge configuration includes normalization, int8 masking, and `bfloat16` precision for optimized performance.
15
+ # **Merge**
16
 
17
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
 
19
+ # **Merge Method**
 
20
 
21
  This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [Qwen/Qwen2.5-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-32B-Instruct) as a base.
22
 
23
+ # **Models Merged**
24
 
25
  The following models were included in the merge:
26
  * [Qwen/QwQ-32B-Preview](https://huggingface.co/Qwen/QwQ-32B-Preview)
27
  * [deepseek-ai/DeepSeek-R1-Distill-Qwen-32B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B)
28
 
29
+ # **Configuration**
30
 
31
  The following YAML configuration was used to produce this model:
32