darthhexx
/

Meta-Llama-3-8B-Instruct-FP8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Model Details

This model is an FP8 quantization of the meta-llama/Meta-Llama-3-8B-Instruct model in the safetensors format.

Downloads last month: 2

Safetensors

Model size

8.03B params

Tensor type

BF16

·

F8_E4M3

·

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.