Update README.md
Browse files
README.md
CHANGED
@@ -27,24 +27,14 @@ The following models were included in the merge:
|
|
27 |
The following YAML configuration was used to produce this model:
|
28 |
|
29 |
```yaml
|
30 |
-
base_model:
|
31 |
-
model:
|
32 |
-
path: NeuralNovel/Senzu-7B-v0.1-DPO
|
33 |
-
dtype: bfloat16
|
34 |
merge_method: task_swapping
|
35 |
-
|
36 |
-
|
37 |
-
-
|
38 |
-
model:
|
39 |
-
model:
|
40 |
-
path: senseable/WestLake-7B-v2
|
41 |
parameters:
|
42 |
-
diagonal_offset: 2.0
|
43 |
-
random_mask: 0.3333
|
44 |
-
random_mask_seed: 98557.0
|
45 |
weight: 0.75
|
46 |
-
|
47 |
-
|
48 |
-
|
49 |
-
|
50 |
```
|
|
|
27 |
The following YAML configuration was used to produce this model:
|
28 |
|
29 |
```yaml
|
|
|
|
|
|
|
|
|
30 |
merge_method: task_swapping
|
31 |
+
base_model: NeuralNovel/Senzu-7B-v0.1-DPO
|
32 |
+
models:
|
33 |
+
- model: senseable/WestLake-7B-v2
|
|
|
|
|
|
|
34 |
parameters:
|
|
|
|
|
|
|
35 |
weight: 0.75
|
36 |
+
diagonal_offset: 2 #it doesn't do anything when you use random_mask
|
37 |
+
random_mask: 0.3333
|
38 |
+
random_mask_seed: 98557
|
39 |
+
dtype: bfloat16
|
40 |
```
|