DavidAU commited on
Commit
f3271a9
·
verified ·
1 Parent(s): 91e4bdc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -1
README.md CHANGED
@@ -70,7 +70,7 @@ For best results please see the "settings" section below to get the most out of
70
  <B>Model Usage Notes:</B>
71
 
72
  - For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
73
- - Role-players: Careful raising temp too high as it may affect instruction following.
74
  - This model works with rep pen of 1.02 or higher (see notes).
75
  - If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
76
  - This is not a "happy ever after" model (default). It has a negative bias BUT this bias CAN BE controlled by your prompt(s).
@@ -144,6 +144,27 @@ Special Notice "Context Shift" / "ROPE" (especially Koboldai):
144
 
145
  Do NOT use "context shift" with this model or rope at all. Either may corrupt output generation.
146
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
147
  <B>TEMPLATES:</B>
148
 
149
  The template used will affect output generation and instruction following.
 
70
  <B>Model Usage Notes:</B>
71
 
72
  - For more varied prose (sentence/paragraph/dialog) raise the temp and/or add more instructions in your prompt(s).
73
+ - Role-players: Careful raising temp too high as it may affect instruction following. (please see settings)
74
  - This model works with rep pen of 1.02 or higher (see notes).
75
  - If you want a specific type of prose (IE horror) add in "(vivid horror)" or "(graphic vivid horror)" (no quotes) in your prompt(s).
76
  - This is not a "happy ever after" model (default). It has a negative bias BUT this bias CAN BE controlled by your prompt(s).
 
144
 
145
  Do NOT use "context shift" with this model or rope at all. Either may corrupt output generation.
146
 
147
+ ROLEPLAY / Smoother Operation of this model:
148
+
149
+ In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
150
+
151
+ Set the "Smoothing_factor" to 1.5 to 2.5
152
+ : in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
153
+ : in text-generation-webui -> parameters -> lower right.
154
+ : In Silly Tavern this is called: "Smoothing"
155
+
156
+ NOTE: For "text-generation-webui"
157
+ -> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
158
+
159
+ Source versions (and config files) of my models are here:
160
+ https://huggingface.co/collections/DavidAU/d-au-source-files-for-gguf-exl2-awq-gptq-hqq-etc-etc-66b55cb8ba25f914cbf210be
161
+
162
+ OTHER OPTIONS:
163
+
164
+ - Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor".
165
+
166
+ - If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
167
+
168
  <B>TEMPLATES:</B>
169
 
170
  The template used will affect output generation and instruction following.