julep-ai
/

dolphin-2.9-llama3-70b-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

dolphin-2.9-llama3-70b-awq / README.md

diwank's picture

Update README.md

578a315 verified 8 months ago

|

212 Bytes

metadata

library_name: transformers
tags: []

AWQ Quantized version of cognitivecomputations/dolphin-2.9-llama3-70b.

For use with vllm and other inference engines.