ISTA-DASLab
/

Llama-2-70b-AQLM-4Bit-2x16-hf

Text Generation

Model card Files Files and versions Community

No model card

Downloads last month: 2

Safetensors

Model size

18.2B params

Tensor type

F32

·

I16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf

AQLM

AQLM quantized LLMs • 21 items • Updated Feb 28 • 46