aashish1904 commited on
Commit
a5d5c3e
1 Parent(s): d226e68

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +76 -0
README.md ADDED
@@ -0,0 +1,76 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+
4
+ base_model:
5
+ - UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
6
+ - crestf411/gemma2-9B-sunfall-v0.5.2
7
+ - allura-org/G2-9B-Sugarquill-v0
8
+ library_name: transformers
9
+ tags:
10
+ - mergekit
11
+ - merge
12
+ license: gemma
13
+
14
+ ---
15
+
16
+ [![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
17
+
18
+
19
+ # QuantFactory/G2-9B-Aletheia-v1-GGUF
20
+ This is quantized version of [allura-org/G2-9B-Aletheia-v1](https://huggingface.co/allura-org/G2-9B-Aletheia-v1) created using llama.cpp
21
+
22
+ # Original Model Card
23
+
24
+
25
+ <img src="inpaint.png">
26
+ <sub>Image by CalamitousFelicitouness</sub>
27
+
28
+ ---
29
+
30
+ # Gemma-2-9B Aletheia v1
31
+
32
+ A merge of Sugarquill and Sunfall. I wanted to combine Sugarquill's more novel-like writing style with something that would improve it's RP perfomance and make it more steerable, w/o adding superfluous synthetic writing patterns.
33
+
34
+ I quite like Crestfall's Sunfall models and I felt like Gemma version of Sunfall will steer the model in this direction when merged in. To keep more of Gemma-2-9B-it-SPPO-iter3's smarts, I've decided to apply Sunfall LoRA on top of it, instead of using the published Sunfall model.
35
+
36
+ I'm generally pleased with the result, this model has nice, fresh writing style, good charcard adherence and good system prompt following.
37
+ It still should work well for raw completion storywriting, as it's a trained feature in both merged models.
38
+
39
+ ---
40
+ Made by Auri.
41
+
42
+ Thanks to Prodeus, Inflatebot and ShotMisser for testing and giving feedback.
43
+
44
+ ### Format
45
+
46
+ Model responds to Gemma instruct formatting, exactly like it's base model.
47
+
48
+ ```
49
+ <bos><start_of_turn>user
50
+ {user message}<end_of_turn>
51
+ <start_of_turn>model
52
+ {response}<end_of_turn><eos>
53
+ ```
54
+
55
+
56
+ ### Mergekit config
57
+
58
+ The following YAML configuration was used to produce this model:
59
+
60
+ ```yaml
61
+ models:
62
+ - model: allura-org/G2-9B-Sugarquill-v0
63
+ parameters:
64
+ weight: 0.55
65
+ density: 0.4
66
+ - model: UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3+AuriAetherwiing/sunfall-g2-lora
67
+ parameters:
68
+ weight: 0.45
69
+ density: 0.3
70
+ merge_method: ties
71
+ base_model: UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
72
+ parameters:
73
+ normalize: true
74
+ dtype: bfloat16
75
+
76
+ ```