Safetensors
llama
chat
Delta-Vector commited on
Commit
c490c80
1 Parent(s): b4a4fee

Delete README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -40
README.md DELETED
@@ -1,40 +0,0 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # outputs
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using /home/mango/Trainers/mergekit/mergekit/models + /home/mango/Trainers/mergekit/mergekit/models/lora as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
-
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
-
27
- ```yaml
28
- base_model: /home/mango/Trainers/mergekit/mergekit/models+/home/mango/Trainers/mergekit/mergekit/models/lora
29
- dtype: bfloat16
30
- merge_method: task_arithmetic
31
- parameters:
32
- normalize: false
33
- slices:
34
- - sources:
35
- - layer_range: [0, 32]
36
- model: /home/mango/Trainers/mergekit/mergekit/models+/home/mango/Trainers/mergekit/mergekit/models/lora
37
- parameters:
38
- weight: 1.0
39
-
40
- ```