Aryanne commited on
Commit
da55f8b
1 Parent(s): 9982ea9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -17
README.md CHANGED
@@ -27,24 +27,14 @@ The following models were included in the merge:
27
  The following YAML configuration was used to produce this model:
28
 
29
  ```yaml
30
- base_model:
31
- model:
32
- path: NeuralNovel/Senzu-7B-v0.1-DPO
33
- dtype: bfloat16
34
  merge_method: task_swapping
35
- slices:
36
- - sources:
37
- - layer_range: [0, 32]
38
- model:
39
- model:
40
- path: senseable/WestLake-7B-v2
41
  parameters:
42
- diagonal_offset: 2.0
43
- random_mask: 0.3333
44
- random_mask_seed: 98557.0
45
  weight: 0.75
46
- - layer_range: [0, 32]
47
- model:
48
- model:
49
- path: NeuralNovel/Senzu-7B-v0.1-DPO
50
  ```
 
27
  The following YAML configuration was used to produce this model:
28
 
29
  ```yaml
 
 
 
 
30
  merge_method: task_swapping
31
+ base_model: NeuralNovel/Senzu-7B-v0.1-DPO
32
+ models:
33
+ - model: senseable/WestLake-7B-v2
 
 
 
34
  parameters:
 
 
 
35
  weight: 0.75
36
+ diagonal_offset: 2 #it doesn't do anything when you use random_mask
37
+ random_mask: 0.3333
38
+ random_mask_seed: 98557
39
+ dtype: bfloat16
40
  ```