Aryanne commited on
Commit
a0b6369
1 Parent(s): 22eeb53

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -5,4 +5,16 @@ tags:
5
  - merge
6
  - mergekit
7
  ---
8
- Another trial of merging models with different sizes, still under testing, should be more stable, but I have no ideia if it's improving or degrading the base model.
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  - merge
6
  - mergekit
7
  ---
8
+ Another trial of merging models with different sizes, still under testing, should be more stable, but I have no ideia if it's improving or degrading the base model.
9
+
10
+ In this I changed something, to have more Westlake.
11
+ Recipe:
12
+ ```
13
+ merge_method: task_anysize
14
+ base_model: princeton-nlp/Sheared-LLaMA-2.7B-ShareGPT
15
+ models:
16
+ - model: senseable/WestLake-7B-v2
17
+ parameters:
18
+ weight: 1.0
19
+ dtype: bfloat16
20
+ ```