GGUFs

#1
by MarsupialAI - opened

Regular Q_K and iMatrix GGUFs uploading here: https://huggingface.co/MarsupialAI/Qwen1.5-32B_iMatrix_GGUF

lgtm! would you mind telling us what data did you train imatrix on?

As per the model card, kalomaze's groups_merged.txt. The file is included in the repo.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment