LMS Q4KM only 16k Context
#1
by
JJ404GO
- opened
In LMS the Q4KM shows a maximum context window of 16k, which appears to be an error. Any advice would be appreciated. Thank you.
is it not possible to increase it? that should just the be default, they did update their config to be 128k but it should be usable without needing the value updated
LMS only allows you to select up to 16k ctx. The slider will not go farther right. Looks like the config.json is limited to 16k.
You can edit the context length by clicking the text box and typing the value you want, even though it turns red and says it won't, it will
I was about to post this. Are you certain the context length in the config doesn't affect the conversion?
Yes, it's only a metadata difference