cac3226 578a315
1
2
3
4
5
6
7
8
--- library_name: transformers tags: [] --- AWQ Quantized version of [cognitivecomputations/dolphin-2.9-llama3-70b](/cognitivecomputations/dolphin-2.9-llama3-70b). For use with vllm and other inference engines.