Request 3.5bpw
#1
by
jokemodel1710
- opened
Can i request a 3.5 bpw please, I've been trying to quantize my own 3.5 in exllamav2 but it's no use I'm getting a : ValueError: math domain error everytime so can i request a 3.5 or some info on how you quantize your own, I really like this model so far.