Please add following backends for the GPTQ models.

#1
by SaffalPoosh - opened

GPTQ is also supported using following backend apis:

  • exllama v2
  • Transformers

Sign up or log in to comment