ISTA-DASLab
/

Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-70B-AQLM-2Bit-1x16 / model-00003-of-00005.safetensors

Commit History

Uploaded improved version of quantized model

c5c2ca6
verified

SpiridonSunRotator commited on May 3, 2024

Uploaded Meta-Llama-3-70B with AQLM 1x16 quantization

e48bc9d
verified

SpiridonSunRotator commited on Apr 29, 2024