redrix commited on
Commit
07befe3
·
verified ·
1 Parent(s): d6af32d

Update Testing

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -22,12 +22,12 @@ This is a merge of pre-trained language models created using [mergekit](https://
22
 
23
  This is my fourth model. I wanted to test *della_linear*. The point of this model was to use the negative properties of [DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS](https://huggingface.co/DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS) to counter potential positivity bias while keeping up stability.
24
  ## Testing stage: testing
25
- I do not know how this model holds up over long term context. Early testing showed stability and very good answers. I'm still not sure whether the positivity bias has been messed with positively or negatively. The model has the tendency to give similar answers on swipes, *XTC* may help increase variability.
26
 
27
  ## Parameters
28
  - **Context size:** Not more than *20k* recommended - coherency may degrade.
29
  - **Chat Template:** *ChatML*
30
- - **Samplers:** A *Temperature-Last* of 1 and *Min-P* of 0.1 are viable, but haven't been finetuned. Activate *DRY* if repetition appears. *XTC* seems to work well.
31
 
32
  ## Quantization
33
  - Static **GGUF** Quants available at [mradermacher/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-GGUF](https://huggingface.co/mradermacher/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-GGUF)
 
22
 
23
  This is my fourth model. I wanted to test *della_linear*. The point of this model was to use the negative properties of [DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS](https://huggingface.co/DavidAU/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-DARKNESS) to counter potential positivity bias while keeping up stability.
24
  ## Testing stage: testing
25
+ **(18/12/2024):** The model seems to hold up very well over context, and keeps to the character/prompt nicely. It has expansive, varied prose, lacking GPTisms mostly. The only problem is that the model always seems to interpret the input in a similar manner (probably due to *self_attn* layers). Thusly the output always tends to follow a certain theme/direction, even if the wording is different per swipe (the longer the response, the more it'll deviate from this set direction at the beginning). A peculiar quirk is that errors are predictable - if the model writes the name of the user in a wrong manner (scrambling letters, etc; I myself have a more complex name), it will ALWAYS missspell that instance of the name in consequent swipes. But it automatically fixes itself. If the first instance of the name is spelt wrong, further instances will be fixed, though. Repetition is low, and *DRY* can help if it does appear. But I've not had it pick up on any patterns. *Higher Temperature* (1.25) seems to work better. Sometimes it gives quite the impressive answers. *XTC* can improve it a lot, without decreasing intelligence - but I've not really defined the difference between responses via *neutralized sampler* answers and *XTC*. If you find that the model gives bogus on swipes, add some characters at the end of your input to sort-of scramble the output (add some asterisks or whatever; or write some useless extra sentence if you so desire).
26
 
27
  ## Parameters
28
  - **Context size:** Not more than *20k* recommended - coherency may degrade.
29
  - **Chat Template:** *ChatML*
30
+ - **Samplers:** A *Temperature-Last* of 1-1.25 and *Min-P* of 0.1-0.25 are viable, but haven't been finetuned. Activate *DRY* if repetition appears. *XTC* seems to work well.
31
 
32
  ## Quantization
33
  - Static **GGUF** Quants available at [mradermacher/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-GGUF](https://huggingface.co/mradermacher/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-GGUF)