Hugging Face's logo

relaxml
/
Llama-3.1-405B-Instruct-QTIP-2Bit

Safetensors
llama
Model card Files Community
1

image/png

Downloads last month
9
Safetensors
Model size
54.5B params
Tensor type
BF16
·
F32
·
FP16
·
I16
·
Inference API
Unable to determine this model's library. Check the docs .

Model tree for relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit

Base model

meta-llama/Llama-3.1-405B
Finetuned
meta-llama/Llama-3.1-405B-Instruct
Finetuned
(7)
this model

Collection including relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit