LMS Q4KM only 16k Context

#1
by JJ404GO - opened

In LMS the Q4KM shows a maximum context window of 16k, which appears to be an error. Any advice would be appreciated. Thank you.

LM Studio Community org

is it not possible to increase it? that should just the be default, they did update their config to be 128k but it should be usable without needing the value updated

LMS only allows you to select up to 16k ctx. The slider will not go farther right. Looks like the config.json is limited to 16k.

LM Studio Community org

You can edit the context length by clicking the text box and typing the value you want, even though it turns red and says it won't, it will

I was about to post this. Are you certain the context length in the config doesn't affect the conversion?

LM Studio Community org

Yes, it's only a metadata difference

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment