grimjim commited on
Commit
6ecff26
1 Parent(s): 7e897df

Update README.md

Browse files

Added link; tweaked formatting

Files changed (1) hide show
  1. README.md +59 -59
README.md CHANGED
@@ -1,59 +1,59 @@
1
- ---
2
- base_model:
3
- - meta-llama/Meta-Llama-3-8B-Instruct
4
- - failspy/Llama-3-8B-Instruct-MopeyMule
5
- library_name: transformers
6
- tags:
7
- - mergekit
8
- - merge
9
- license: llama3
10
- pipeline_tag: text-generation
11
- ---
12
- # Llama-3-Perky-Pat-Instruct-8B
13
-
14
- Below, we explore negative weight merger, and propose Orthogonalized Vector Adaptation, or OVA.
15
-
16
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
-
18
- _"One must imagine Sisyphys happy."_
19
-
20
- Task arithmetic was used to invert the intervention vector that was applied in [MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule), via application of negative weight -1.0. The combination of model weights (Instruct - MopeyMule) comprises an Orthogonalized Vector Adaptation that can subsequently be applied to the base Instruct model, and could in principle be applied to other models derived from fine-tuning the Instruct model.
21
-
22
- This model is meant to continue exploration of behavioral changes that can be achieved via orthogonalized steering. The result appears to be more enthusiastic and lengthy responses in chat, though it is also clear that the merged model has some unhealed damage.
23
-
24
- Built with Meta Llama 3.
25
-
26
- ## Merge Details
27
- ### Merge Method
28
-
29
- This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) as a base.
30
-
31
- ### Models Merged
32
-
33
- The following models were included in the merge:
34
- * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule)
35
-
36
- ### Configuration
37
-
38
- The following YAML configuration was used to produce this model:
39
-
40
- ```yaml
41
- base_model: meta-llama/Meta-Llama-3-8B-Instruct
42
- dtype: bfloat16
43
- merge_method: task_arithmetic
44
- parameters:
45
- normalize: false
46
- slices:
47
- - sources:
48
- - layer_range: [0, 32]
49
- model: meta-llama/Meta-Llama-3-8B-Instruct
50
- - layer_range: [0, 32]
51
- model: meta-llama/Meta-Llama-3-8B-Instruct
52
- parameters:
53
- weight: 1.0
54
- - layer_range: [0, 32]
55
- model: failspy/Llama-3-8B-Instruct-MopeyMule
56
- parameters:
57
- weight: -1.0
58
-
59
- ```
 
1
+ ---
2
+ base_model:
3
+ - meta-llama/Meta-Llama-3-8B-Instruct
4
+ - failspy/Llama-3-8B-Instruct-MopeyMule
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ license: llama3
10
+ pipeline_tag: text-generation
11
+ ---
12
+ # Llama-3-Perky-Pat-Instruct-8B
13
+
14
+ Below, we explore negative weight merger, and propose Orthogonalized Vector Adaptation, or OVA.
15
+
16
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
+
18
+ _"One must imagine Sisyphys happy."_
19
+
20
+ Task arithmetic was used to invert the intervention vector that was applied in [MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule), via application of negative weight -1.0. The combination of model weights _(Instruct - MopeyMule)_ comprises an Orthogonalized Vector Adaptation that can subsequently be applied to the base [Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) model, and could in principle be applied to other models derived from fine-tuning the Instruct model.
21
+
22
+ This model is meant to continue exploration of behavioral changes that can be achieved via orthogonalized steering. The result appears to be more enthusiastic and lengthy responses in chat, though it is also clear that the merged model has some unhealed damage.
23
+
24
+ Built with Meta Llama 3.
25
+
26
+ ## Merge Details
27
+ ### Merge Method
28
+
29
+ This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) as a base.
30
+
31
+ ### Models Merged
32
+
33
+ The following models were included in the merge:
34
+ * [failspy/Llama-3-8B-Instruct-MopeyMule](https://huggingface.co/failspy/Llama-3-8B-Instruct-MopeyMule)
35
+
36
+ ### Configuration
37
+
38
+ The following YAML configuration was used to produce this model:
39
+
40
+ ```yaml
41
+ base_model: meta-llama/Meta-Llama-3-8B-Instruct
42
+ dtype: bfloat16
43
+ merge_method: task_arithmetic
44
+ parameters:
45
+ normalize: false
46
+ slices:
47
+ - sources:
48
+ - layer_range: [0, 32]
49
+ model: meta-llama/Meta-Llama-3-8B-Instruct
50
+ - layer_range: [0, 32]
51
+ model: meta-llama/Meta-Llama-3-8B-Instruct
52
+ parameters:
53
+ weight: 1.0
54
+ - layer_range: [0, 32]
55
+ model: failspy/Llama-3-8B-Instruct-MopeyMule
56
+ parameters:
57
+ weight: -1.0
58
+
59
+ ```