Triangle104 commited on
Commit
a86c73f
·
verified ·
1 Parent(s): 44aed50

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +89 -0
README.md CHANGED
@@ -13,6 +13,95 @@ tags:
13
  This model was converted to GGUF format from [`SubtleOne/Rombos-Qwen2.5-Writer-32b`](https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b) for more details on the model.
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ## Use with llama.cpp
17
  Install llama.cpp through brew (works on Mac and Linux)
18
 
 
13
  This model was converted to GGUF format from [`SubtleOne/Rombos-Qwen2.5-Writer-32b`](https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/SubtleOne/Rombos-Qwen2.5-Writer-32b) for more details on the model.
15
 
16
+ ---
17
+ Model details:
18
+ -
19
+ This model is a merge using Rombos's top-ranked 32b model, based on
20
+ Qwen 2.5, and merging three creative writing finetunes. The creative
21
+ content is a serious upgrade over the base it started with, and I
22
+ enjoyed it in my DnD RPG campaign.
23
+
24
+
25
+
26
+
27
+
28
+
29
+
30
+ Merge
31
+
32
+
33
+
34
+
35
+ This is a merge of pre-trained language models created using mergekit.
36
+
37
+
38
+
39
+
40
+
41
+
42
+
43
+ Merge Method
44
+
45
+
46
+
47
+
48
+ This model was merged using the DELLA merge method using Rombos-LLM-V2.5-Qwen-32b as a base.
49
+
50
+
51
+
52
+
53
+
54
+
55
+
56
+ Models Merged
57
+
58
+
59
+
60
+
61
+ The following models were included in the merge:
62
+
63
+
64
+ EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
65
+ allura-org/Qwen2.5-32b-RP-Ink
66
+ nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
67
+
68
+
69
+
70
+
71
+
72
+
73
+
74
+ Configuration
75
+
76
+
77
+
78
+
79
+ The following YAML configuration was used to produce this model:
80
+
81
+
82
+ base_model: rombodawg/Rombos-LLM-V2.5-Qwen-32b
83
+ parameters:
84
+ int8_mask: true
85
+ rescale: false
86
+ normalize: true
87
+ dtype: bfloat16
88
+ tokenizer_source: union
89
+ merge_method: dare_ties
90
+ models:
91
+ - model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
92
+ parameters:
93
+ weight: [0.4]
94
+ density: [0.55]
95
+ - model: nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
96
+ parameters:
97
+ weight: [0.3]
98
+ density: [0.55]
99
+ - model: allura-org/Qwen2.5-32b-RP-Ink
100
+ parameters:
101
+ weight: [0.4]
102
+ density: [0.55]
103
+
104
+ ---
105
  ## Use with llama.cpp
106
  Install llama.cpp through brew (works on Mac and Linux)
107