Add IQ Quants - Fixed

#7
by saishf - opened

As above, it adds rough bpw numbers for the new IQ quants. (without the error)
IQ1_S (1.56 BPW)

IQ2_XXS (2.06 BPW)

IQ2_XS (2.31 BPW)

IQ2_S (2.5 BPW)

IQ2_M (2.7 BPW)

IQ3_XXS (3.06 BPW)

IQ3_XS (3.3 BPW)

IQ3_S (3.5 BPW)

IQ3_M (3.7 BPW)

IQ4_XS (4.25 BPW)

IQ4_NL (4.5 BPW)

Thanks

NyxKrage changed pull request status to merged

Sign up or log in to comment