Zurich Models
#595
by
rubenroy
- opened
Hi!
Could you quantize the Zurich models? Zurich is based on Qwen 2.5 7B and 14B and are fine-tuned on different sizes of my dataset (GammaCorpus).
These are the model links:
Would heavily appreciate this, thanks!
I tried, but none of the ones I tried have a working tokenizer. I'll have a closer look.
Hmm, maybe I confused it with some preview model. I'll try to quant them :)
Thanks :D
you can watch their progress at http://hf.tst.eu/status.html btw. they are small, but numerous :) if you have any other quant requests (geneva, basel... :) drop me a note.
mradermacher
changed discussion status to
closed