Made directly from https://huggingface.co/Qwen/Qwen1.5-32B-Chat
I converted original model to f32 first.
3-bit
4-bit
5-bit
6-bit