TheBloke
/

zephyr-7B-alpha-AWQ

Text Generation

Generated from Trainer

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

AWQ version failed to deploy on SageMaker

#2 opened over 1 year ago by

OOM on RTX 3090 with vLLM

#1 opened almost 2 years ago by