Koboldcpp customization request
If it's not too much trouble, can you make two priset for roleplaying (or more if you want) - the first priset with a temperature banas (let it be 0.8), and the second priset is a creative with a temperature of your choice?
Absolutely , this was / is on the to do list.
Same for Silly Tavern (presets).
Absolutely , this was / is on the to do list.
Same for Silly Tavern (presets).
Great, then I'll be waiting! Will there be a config with 0.8 temp? I'm communicating with language models in Russian (although I'm not from Russia) and at a temperature higher than 0.86 AI starts to hallucinate, so I don't like the high temperature (and maybe other languages other than English, too). Although it depends a lot on the setting, so maybe it is possible to achieve higher temperature with the right setting without severe hallucinations.
Just added all , 3 LLMs/AI apps, all classes covered.
Just added all , 3 LLMs/AI apps, all classes covered.
Yeah, thanks, I found it. In fact, I also tried to figure out how to set up the different parameters, but then I got stuck in the fact that I don't know what the correct value is for “Sampler Order”, because this parameter affects the sequence of execution of other parameters and it is more difficult than it seems to set up all these parameters to be in harmony. Initially I overlooked this parameter and my tuning was not taking it into account. Did you take “Sampler Order” into account when you customized the parameters in the screenshot? And what does model class mean?
I've been trying to read through the enormous amounts of information in the readme, the links, etc..
I don't mean to sound unappreciative of your efforts, but there's an insane information overload.
Even when taking my time to find the values, read through the things... It's just too much to take in. I simply don't have time or the mental fortitude to do a full university course read-through to add a few numbers in some boxes. Even when I understand what the numbers mean, I can't figure out which numbers are required for which model, because the document is waaaaay wayyy too large. This gets frustrating, when it's pointed out that the numbers are super important to get right for the model to function correctly!
Even after trying, the model keeps ignoring my instructions and keeps talking on my behalf. I don't know which context template to use, I don't know if I need to use instruct mode. I don't know if I should add some system prompt. And all of this seems like it's really important to get right for the model to work.
I added all the class 4 values suggested. Atleast I think I did, there's like 5 pages of explanations for the 10 params I need to change, some of which are more confusing than helpful. And those are just the ones that even included suggested values. Some value suggestions conflict with with other suggestions in other parts of the document.
In this thread, the above posts mention presets, but I can't for the life of me figure out where they are linked. I'm not sure if I need to click a link in the readme that will lead to the links?
In this thread, the above posts mention presets, but I can't for the life of me figure out where they are linked. I'm not sure if I need to click a link in the readme that will lead to the links?
Click on files, there are screenshots of the presets.
Please see "quick reference section" , then screenshots that
@Herman555
noted.
The other sections are for fine tuning model operation - the quick reference will get you up and running.