OddTheGreat commited on
Commit
a9ae382
·
verified ·
1 Parent(s): 44fe0cd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -46
README.md CHANGED
@@ -9,58 +9,26 @@ library_name: transformers
9
  tags:
10
  - mergekit
11
  - merge
12
-
 
 
 
 
 
 
13
  ---
14
  # merge
15
 
16
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
17
-
18
- ## Merge Details
19
- ### Merge Method
20
 
21
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [OddTheGreat/Badman_12B](https://huggingface.co/OddTheGreat/Badman_12B) as a base.
22
 
23
- ### Models Merged
24
 
25
- The following models were included in the merge:
26
- * [bamec66557/VICIOUS_MESH-12B-OMEGA](https://huggingface.co/bamec66557/VICIOUS_MESH-12B-OMEGA)
27
- * [PocketDoc/Dans-SakuraKaze-V1.0.0-12b](https://huggingface.co/PocketDoc/Dans-SakuraKaze-V1.0.0-12b)
28
- * [PocketDoc/Dans-DangerousWinds-V1.1.0-12b](https://huggingface.co/PocketDoc/Dans-DangerousWinds-V1.1.0-12b)
29
- * [anthracite-org/magnum-v4-12b](https://huggingface.co/anthracite-org/magnum-v4-12b)
30
 
31
- ### Configuration
32
 
33
- The following YAML configuration was used to produce this model:
34
 
35
- ```yaml
36
- models:
37
- - model: bamec66557/VICIOUS_MESH-12B-OMEGA
38
- parameters:
39
- density: 0.5
40
- weight: 0.5
41
- - model: PocketDoc/Dans-DangerousWinds-V1.1.0-12b
42
- parameters:
43
- density: 0.3
44
- weight: 0.3
45
- - model: OddTheGreat/Badman_12B
46
- parameters:
47
- density: 0.5
48
- weight: 0.5
49
- - model: anthracite-org/magnum-v4-12b
50
- parameters:
51
- density: 0.3
52
- weight: 0.3
53
- - model: PocketDoc/Dans-SakuraKaze-V1.0.0-12b
54
- parameters:
55
- density: 0.2
56
- weight: 0.2
57
-
58
- merge_method: ties
59
- base_model: OddTheGreat/Badman_12B
60
- parameters:
61
- normalize: false
62
- int8_mask: true
63
- dtype: float16
64
- tokenizer:
65
- source: union
66
- ```
 
9
  tags:
10
  - mergekit
11
  - merge
12
+ - roleplay
13
+ - creative
14
+ - storytelling
15
+ - dark
16
+ language:
17
+ - ru
18
+ - en
19
  ---
20
  # merge
21
 
22
+ This is a merge of pre-trained language models.
 
 
 
23
 
24
+ I had idea for this merge, but it took many attempts to make my idea real.
25
 
26
+ Basically, it is upgraded Badman, more "smart", better in storytelling, and most important, way better in ERP.
27
 
28
+ Model capable to write cruel and even unsettling things, be aware.
 
 
 
 
29
 
30
+ Russian capabilities preserved, on full ru cards model works slightly better than its predecessor, on partly translated cards can lose language, but rarely (1 answer from 10)
31
 
32
+ Can write for user and generate some cliche, but it fixes easily by prompt and samplers. I like how it responds on t1.01 /t1.1, top p 0.95, min p 0.05, with XTC 0.1 0.1 (or 0.1 0.3)
33
 
34
+ Tested on various character cards and some adventures. Total responses ~600, Used ChatML format. Mistral format is supported, model's replies completely differently, i recommend give a try to both and compare what you like more.