AWQ = clickbait
#1
by
mirekphd
- opened
I'd rename it removing any mention of AWQ (which was not used here, so weights are not improved by activation-saliency awareness), especially as this still the only version of this new model with awq in its name
Yea I'm aware, hence it's the first thing I mention in the README. I'm using AWQ as an INT4 model format (well, autoawq to be exact), so people know that this checkpoint should work with any code that can work with AWQ e.g. transformers, vLLM, SGLang...