Model : Llama 3 8B 4bits

This is a Llama 3 8B model quantized on 4 bits using BitsandBytes. For fast upload enjoy !.

License : see https://huggingface.co/meta-llama/Meta-Llama-3-8B

Downloads last month
18
Safetensors
Model size
4.65B params
Tensor type
FP16
F32
U8
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.