Azazelle commited on
Commit
933d5b9
1 Parent(s): 62f43ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md CHANGED
@@ -1,3 +1,34 @@
1
  ---
 
 
 
 
2
  license: cc-by-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ pipeline_tag: text-generation
3
+ tags:
4
+ - mistral
5
+ - merge
6
  license: cc-by-4.0
7
  ---
8
+ # Model Card for Tippy-Toppy-7b
9
+ <!-- Provide a quick summary of what the model is/does. -->
10
+ DARE merge intended to be build on Toppy-M-7b.
11
+
12
+ .yaml file for mergekit
13
+ ```.yaml:
14
+ models:
15
+ - model: mistralai/Mistral-7B-v0.1
16
+ # no parameters necessary for base model
17
+ - model: Undi95/Toppy-M-7B #175
18
+ parameters:
19
+ weight: 0.54
20
+ density: 0.81
21
+ - model: PistachioAlt/Noromaid-Bagel-7B-Slerp #75
22
+ parameters:
23
+ weight: 0.23
24
+ density: 0.61
25
+ - model: OpenPipe/mistral-ft-optimized-1227 #100
26
+ parameters:
27
+ weight: 0.31
28
+ density: 0.68
29
+ merge_method: dare_ties
30
+ base_model: mistralai/Mistral-7B-v0.1
31
+ parameters:
32
+ int8_mask: true
33
+ dtype: bfloat16
34
+ ```