File size: 1,756 Bytes
bddfbbe 3ebad93 4f4e648 bddfbbe 3ebad93 bddfbbe 3ebad93 bddfbbe 3ebad93 bddfbbe 3ebad93 bddfbbe 3ebad93 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
---
license: cc-by-nc-4.0
language:
- en
tags:
- solar
- rotating-stack-merge
---
# Skunk Ape 16b
This model is a rotating-stack merge of three Solar-based models in a 16b (72 layer) configuration. The result of
this "frankenmerge" is a medium-sized model that contains what I consider to be the best of the solar finetunes.
Mergefuel:
- Sao10K/Fimbulvetr-11B-v2
- Sao10K/Solstice-11B-v1
- TheDrummer/Moistral-11B-v1
This model is uncensored and capable of generating objectionable material. However, it is not an explicitely-NSFW model,
and it has never "gone rogue" and tried to insert NSFW content into SFW prompts in my experience. As with any LLM, no
factual claims made by the model should be taken at face value. You know that boilerplate safety disclaimer that most
professional models have? Assume this has it too. This model is for entertainment purposes only.
iMatrix GGUFs:
# Sample output
```
{{[INPUT]}}
Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
{{[OUTPUT]}}
```
# Prompt format
Prefers alpaca.
# WTF is a rotating-stack merge?
Inspired by Undi's experiments with stacked merges, Jeb Carter found that output quality and model initiative could be significantly
improved by reversing the model order in the stack, and then doing a linear merge between the original and reversed stacks. That is
what I did here. I created three passthrough stacked merges using the three source models (rotating the model order in each stack),
and then doing a linear merge of all three stacks. The exact merge configs can be found in the recipe.txt file. |