TheBloke
/

Llama-2-70B-Chat-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

Max length 2048 error

#5 opened about 2 years ago by

[AUTOMATED] Model Memory Requirements

#4 opened about 2 years ago by

model-sizer-bot

Performance and latency vs. GPTQ

#3 opened about 2 years ago by

Deployment via Sagemaker

#2 opened about 2 years ago by

Multi-turn chat?

#1 opened about 2 years ago by

mukundtibrewala