https://huggingface.co/newsbang/Homer-v1.0-Qwen2.5-7B

#505
by jrruethe - opened

Could you quant this please?
https://huggingface.co/newsbang/Homer-v1.0-Qwen2.5-7B
Specifically, I'd like your IQ4_XS GGUF with imatrix! Thanks

Sure, it's queued, and should be done within an hour or so. If not, come back and complain to me :) The i1-IQ4_XS is one of the later ones to be generated, unfortunately. You can check on it's state at http://hf.tst.eu/status.html

mradermacher changed discussion status to closed

The i1-IQ4_XS is one of the later ones to be generated, unfortunately.

I don't think this matters as this is a 7B model and so below 10B which means due to recent HuggingFace API rate limits they will all be uploaded in a single commit once all quants are done which given its size really shouldn't take long at all.

Good point :)

Thank you!

Sign up or log in to comment