altomek
/

Yi-1.5-34B-8bpw-EXL2

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Yi-1.5-34B-8bpw-EXL2 / README.md

altomek's picture

Update README.md

8b64401 verified 2 months ago

|

history blame contribute delete

138 Bytes

metadata

base_model: 01-ai/Yi-1.5-34B
license: apache-2.0

Yi-1.5-34B

ExLlamav2 8 bpw quants of https://huggingface.co/01-ai/Yi-1.5-34B