File size: 212 Bytes
cac3226
 
 
 
 
578a315
 
 
1
2
3
4
5
6
7
8
---
library_name: transformers
tags: []
---

AWQ Quantized version of [cognitivecomputations/dolphin-2.9-llama3-70b](/cognitivecomputations/dolphin-2.9-llama3-70b).

For use with vllm and other inference engines.