LM Studio
#1
by
Auryza
- opened
Hi there,
I'm very interested in your Lt-Llama-2-7b-hf model and would love to use it in LM Studio. Unfortunately, it's not currently compatible with LM Studio due to its format. Would you be able to provide a version of the model that is compatible with LM Studio, such as a GGML or GPTQ format? This would be incredibly helpful for the community and allow for wider experimentation with your model.
Hi,
It should be simple straight forward to convert from HF format to GGML format.
I found script in github for that. It should do the job: https://gist.github.com/pdtgct/b8bcbf9220d4d5059b62b1c35615a650
I would recommend to try it.