@TheBloke @LoneStriker Could you add this model to your quantization list? Thanks in advance!
exl2 now up:https://huggingface.co/models?search=LoneStriker%20Yi-34Bx2-MoE-60B
· Sign up or log in to comment
