DavidAU commited on
Commit
393fc42
·
verified ·
1 Parent(s): f3271a9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -144,24 +144,30 @@ Special Notice "Context Shift" / "ROPE" (especially Koboldai):
144
 
145
  Do NOT use "context shift" with this model or rope at all. Either may corrupt output generation.
146
 
147
- ROLEPLAY / Smoother Operation of this model:
148
 
149
  In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
150
 
151
  Set the "Smoothing_factor" to 1.5 to 2.5
 
152
  : in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
 
153
  : in text-generation-webui -> parameters -> lower right.
 
154
  : In Silly Tavern this is called: "Smoothing"
155
 
 
156
  NOTE: For "text-generation-webui"
 
157
  -> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
158
 
159
  Source versions (and config files) of my models are here:
 
160
  https://huggingface.co/collections/DavidAU/d-au-source-files-for-gguf-exl2-awq-gptq-hqq-etc-etc-66b55cb8ba25f914cbf210be
161
 
162
  OTHER OPTIONS:
163
 
164
- - Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor".
165
 
166
  - If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
167
 
 
144
 
145
  Do NOT use "context shift" with this model or rope at all. Either may corrupt output generation.
146
 
147
+ <B>Settings: CHAT / ROLEPLAY and/or SMOOTHER operation of this model:</B>
148
 
149
  In "KoboldCpp" or "oobabooga/text-generation-webui" or "Silly Tavern" ;
150
 
151
  Set the "Smoothing_factor" to 1.5 to 2.5
152
+
153
  : in KoboldCpp -> Settings->Samplers->Advanced-> "Smooth_F"
154
+
155
  : in text-generation-webui -> parameters -> lower right.
156
+
157
  : In Silly Tavern this is called: "Smoothing"
158
 
159
+
160
  NOTE: For "text-generation-webui"
161
+
162
  -> if using GGUFs you need to use "llama_HF" (which involves downloading some config files from the SOURCE version of this model)
163
 
164
  Source versions (and config files) of my models are here:
165
+
166
  https://huggingface.co/collections/DavidAU/d-au-source-files-for-gguf-exl2-awq-gptq-hqq-etc-etc-66b55cb8ba25f914cbf210be
167
 
168
  OTHER OPTIONS:
169
 
170
+ - Increase rep pen to 1.1 to 1.15 (you don't need to do this if you use "smoothing_factor")
171
 
172
  - If the interface/program you are using to run AI MODELS supports "Quadratic Sampling" ("smoothing") just make the adjustment as noted.
173