A new q5KM being loaded by koboldcpp causes koboldcpp to simply shut down and run for unknown reasons.
#2
by
Eilian
- opened
The automatic shutdown of the program was so fast that I couldn't see what was happening on the command line.
hmm, there was a new GGUF update the other day - I guess KoboldCpp isn't compatible with it yet.
I have confirmed that the files work fine in llama.cpp.
Please check KoboldCpp is updated to the latest version, and if the issue persists then wait for KoboldCpp to update for the latest change. I'm sure it'll come soon.
Eilian
changed discussion status to
closed