Which formats and contexts are available?
#2
by
deleted
- opened
Unfortunately, the 128k gguf has been buggy and I haven't gotten around to making it yet. So right now it's just bf16. I'm working on a project to improve this.
i think the problem is in llama.c : struct massage just have two options role and content, no more like tools or something like that.