Triangle104 commited on
Commit
f5b6a85
·
verified ·
1 Parent(s): 7cde86c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -0
README.md CHANGED
@@ -13,6 +13,49 @@ license: apache-2.0
13
  This model was converted to GGUF format from [`SubtleOne/Qwen2.5-32b-Erudite-Writer`](https://huggingface.co/SubtleOne/Qwen2.5-32b-Erudite-Writer) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/SubtleOne/Qwen2.5-32b-Erudite-Writer) for more details on the model.
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  ## Use with llama.cpp
17
  Install llama.cpp through brew (works on Mac and Linux)
18
 
 
13
  This model was converted to GGUF format from [`SubtleOne/Qwen2.5-32b-Erudite-Writer`](https://huggingface.co/SubtleOne/Qwen2.5-32b-Erudite-Writer) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
14
  Refer to the [original model card](https://huggingface.co/SubtleOne/Qwen2.5-32b-Erudite-Writer) for more details on the model.
15
 
16
+ ---
17
+ This model is a merge using Rombos's top-ranked 32b model, based on Qwen 2.5, and merging three creative writing finetunes. The creative content is a serious upgrade over the base it started with and has a much more literary style than the previous Writer model. I won't call it better or worse, merely a very distinct flavor and style. I quite like it, and enjoin you to try it as well. Enjoy!
18
+
19
+ Merge Method
20
+ -
21
+ This model was merged using the DELLA merge method using rombodawg/Rombos-LLM-V2.5-Qwen-32b as a base.
22
+ Models Merged
23
+
24
+ The following models were included in the merge:
25
+
26
+ nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
27
+ ArliAI/Qwen2.5-32B-ArliAI-RPMax-v1.3
28
+ EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
29
+
30
+ Configuration
31
+ -
32
+ The following YAML configuration was used to produce this model:
33
+
34
+ base_model: rombodawg/Rombos-LLM-V2.5-Qwen-32b
35
+ parameters:
36
+ int8_mask: true
37
+ rescale: false
38
+ normalize: true
39
+ lambda: 1.04
40
+ epsilon: 0.05
41
+ dtype: bfloat16
42
+ tokenizer_source: union
43
+ merge_method: della
44
+ models:
45
+ - model: EVA-UNIT-01/EVA-Qwen2.5-32B-v0.2
46
+ parameters:
47
+ weight: [0.40]
48
+ density: [0.53]
49
+ - model: nbeerbower/Qwen2.5-Gutenberg-Doppel-32B
50
+ parameters:
51
+ weight: [0.30]
52
+ density: [0.53]
53
+ - model: ArliAI/Qwen2.5-32B-ArliAI-RPMax-v1.3
54
+ parameters:
55
+ weight: [0.40]
56
+ density: [0.53]
57
+
58
+ ---
59
  ## Use with llama.cpp
60
  Install llama.cpp through brew (works on Mac and Linux)
61