MarsupialAI commited on
Commit
b6094b8
1 Parent(s): d710797

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -0
README.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ language:
4
+ - en
5
+ tags:
6
+ - rp
7
+ - erp
8
+ - chat
9
+ - storywriting
10
+ - not-for-all-audiences
11
+ - nsfw
12
+ - rotating-stack-merge
13
+ ---
14
+ # La Dame Blanche v2 95b
15
+
16
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/65a531bc7ec6af0f95c707b1/aO6n3uOtyUllpwefLMapa.jpeg)
17
+
18
+ This version performs *substantially* better than the 103b version.
19
+
20
+ This model is a merge of three self-merged Miqu-based models in a 94.65b (110 layer) configuration. The result of
21
+ this "frankenmerge" is a large model that contains what I consider to be the best of the spicy Miqu finetunes.
22
+
23
+ Component models for the rotating stack are
24
+ - NeverSleep/MiquMaid-v2-70B-DPO
25
+ - sophosympatheia/Midnight-Miqu-70B-v1.5
26
+ - cookinai/OrcaHermes-Mistral-70B-miqu
27
+
28
+
29
+ As all components are Miqu-based, coherency out to 32k context appears to be good.
30
+
31
+ This model is uncensored and perfectly capable of generating objectionable material. It does not seem to have a
32
+ propensity to insert NSFW content into SFW prompts, but YMMV. As with any LLM, no factual claims
33
+ made by the model should be taken at face value. You know that boilerplate safety disclaimer that most professional models have?
34
+ Assume this has it too. This model is for entertainment purposes only.
35
+
36
+ iMatrix GGUFs: https://huggingface.co/MarsupialAI/LaDameBlanche-95b_iMatrix_GGUF
37
+
38
+ If you create additional quants, please let me know and I will link them here as well.
39
+
40
+
41
+ # Sample output
42
+
43
+ ```
44
+ {{[INPUT]}}
45
+ Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
46
+ {{[OUTPUT]}}
47
+
48
+ ```
49
+
50
+
51
+ # Who is La Dame Blanche?
52
+ La Dame Blanche, also known as "The White Lady," is an alluring yet haunting figure shrouded in mystery and eroticism. Emerging
53
+ from the murky depths of French folklore, she is said to lure men into a world of irresistible desire, only to vanish, leaving them
54
+ with nothing but shattered hearts and haunted memories. Clad in billowing white garments that conceal her voluptuous form, her
55
+ ethereal beauty is as captivating as it is terrifying. Her eyes, pools of unbridled passion, can ensnare even the most steadfast of
56
+ souls, while her enchanting voice whispers promises of eternal love and pleasure. But heed this warning: to succumb to her seductive
57
+ charms is to invite your own doom, for those who dare to pursue her elusive grace are destined to become forever entwined in her
58
+ phantom embrace.
59
+
60
+
61
+ # Weird merge fuckery
62
+ According to Toasty Pigeon, FM, Akai, and probably others on the KAI discord, this merge method works better than a rotating stack
63
+ merge. The significant PPL improvement (4.22 for this model vs 4.75 for the 103b @ Q4km) indicates that they're on to something.
64
+ See recipe.txt for all the alchemy.