Update README.md

README.md

@@ -8,14 +8,16 @@ tags:
 - merge
 license: llama3.3
 ---
-# This merge is an attempt at bringing a bit more humanity and creativity to the instruction following of huihui's abliterated llama3.3 instruct.  The flammenai model was trained on the gutenberg dataset as well as a dataset geared towards replying in a more human like fashion.  I haven't gotten to play around with it much, but I find that it has initially been promising in meeting my expectations.  I've had one instance of it quickly running away with itself, so keeping the temp around 1 or lower with a 1.02-1.04 rep pen has seemed promising in generating an even tone of responses.  But there is always more sampler tweaking to be done.
+# This merge is an attempt at bringing a bit more humanity and creativity to the instruction following of huihui's abliterated llama3.3 instruct.  The flammenai model was trained on the gutenberg dataset as well as a dataset geared towards replying in a more human like fashion.  I haven't gotten to play around with it much, but I find that it has initially been promising in meeting my expectations.  I've had one instance of it quickly running away with itself, so keeping the temp around 1 or lower with a 1.02-1.04 rep pen has seemed promising in generating an even tone of responses.  But there is always more sampler tweaking to be done. I have just Added an example chat with my sampler settings.  Ymmv with reproducing this exactly, my system prompting and additional chat injections are non-standard.
 
 This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
 
-Here is a snippet of chat using the Aria - guardian angel card in Silly Tavern
+# Here is a snippet of chat using the Aria - guardian angel card in Silly Tavern  
 
 
+# q4_k_m quant-
+
 
 Aria: Aria's face lights up with gratitude, and she smiles warmly at you. "Thank you for trusting me and giving me permission to help you. I promise to be mindful of your security and only use my abilities for your benefit."
 
@@ -57,7 +59,29 @@ Aria takes another sip of her coffee, savoring the warmth and flavor as she gaze
 
 As she waits for your response, Aria's fingers drum a gentle rhythm on the tabletop, betraying her growing excitement at the prospect of assisting you.
 
+# My sampler settings for this chat are:
+
+Temp: 0.9
+
+Topk: 100
+
+TopP: 0.98
+
+MinP: 0.02
+
+RepPen: 1.055
+
+Rep Pen Range: 640 tokens
+
+XTC: 0.1 threshhold, 0.45 Probablility
+
+DRY: 0.8 multi, 1.75 base, 2 allowed length, 0 range
+
+Add BOS Token: Yes
+
+KBCPP Sampler Order: rep pen, topK, topA, Temp, TFS, TypP, TopP & MinP
 
+# I find these settings to work fairly well generically, mostly the rep pen and range get tweaked based on how terse the conversations are.
 
 
 ## Merge Details