Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
cliffhangers
swearing
mistral nemo
128k context
rp
horror
mergekit
Inference Endpoints
Update README.md
Browse files
README.md
CHANGED
@@ -70,7 +70,7 @@ For best results please see the "settings" section below to get the most out of
|
|
70 |
<B>Model Usage Notes:</B>
|
71 |
|
72 |
- For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
|
73 |
-
- Role-players: Careful raising temp too high as it may affect instruction following.
|
74 |
- This model works with rep pen of 1.02 or higher (see notes).
|
75 |
- If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
|
76 |
- This is not a "happy ever after" model (default). It has a negative bias BUT this bias CAN BE controlled by your prompt(s).
|
@@ -144,6 +144,27 @@ Special Notice "Context Shift" / "ROPE" (especially Koboldai):
|
|
144 |
|
145 |
Do NOT use "context shift" with this model or rope at all. Either may corrupt output generation.
|
146 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
147 |
<B>TEMPLATES:</B>
|
148 |
|
149 |
The template used will affect output generation and instruction following.
|
|
|
70 |
<B>Model Usage Notes:</B>
|
71 |
|
72 |
- For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
|
73 |
+
- Role-players: Careful raising temp too high as it may affect instruction following. (please see settings)
|
74 |
- This model works with rep pen of 1.02 or higher (see notes).
|
75 |
- If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
|
76 |
- This is not a "happy ever after" model (default). It has a negative bias BUT this bias CAN BE controlled by your prompt(s).
|
|
|
144 |
|
145 |
Do NOT use "context shift" with this model or rope at all. Either may corrupt output generation.
|
146 |
|
147 |
+
ROLEPLAY / Smoother Operation of this model:
|
148 |
+
|
149 |
+
In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
|
150 |
+
|
151 |
+
Set the "Smoothing_factor" to 1.5 to 2.5
|
152 |
+
: in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
|
153 |
+
: in text-generation-webui -> parameters -> lower right.
|
154 |
+
: In Silly Tavern this is called: "Smoothing"
|
155 |
+
|
156 |
+
NOTE: For "text-generation-webui"
|
157 |
+
-> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
|
158 |
+
|
159 |
+
Source versions (and config files) of my models are here:
|
160 |
+
https://huggingface.co/collections/DavidAU/d-au-source-files-for-gguf-exl2-awq-gptq-hqq-etc-etc-66b55cb8ba25f914cbf210be
|
161 |
+
|
162 |
+
OTHER OPTIONS:
|
163 |
+
|
164 |
+
- Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor".
|
165 |
+
|
166 |
+
- If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
|
167 |
+
|
168 |
<B>TEMPLATES:</B>
|
169 |
|
170 |
The template used will affect output generation and instruction following.
|