altomek
/

New-Dawn-Llama-3-70B-32K-v1.0-4bpw-EXL2

Text Generation

Not-for-all-Audiences

text-generation-inference

4-bit precision

Model card Files Files and versions Community

New-Dawn-Llama-3-70B-32K-v1.0

ExLlamav2 4 bpw quants of https://huggingface.co/sophosympatheia/New-Dawn-Llama-3-70B-32K-v1.0

Downloads last month: 5

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for altomek/New-Dawn-Llama-3-70B-32K-v1.0-4bpw-EXL2

Base model

sophosympatheia/New-Dawn-Llama-3-70B-32K-v1.0

Quantized

(4)

this model