Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
neuralmagic
/
Meta-Llama-3.1-70B-Instruct-FP8
like
28
Text Generation
Transformers
Safetensors
8 languages
llama
fp8
vllm
conversational
text-generation-inference
Inference Endpoints
License:
llama3.1
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
Will there be a 405B FP8 pushed?
#1
by
RonanMcGovern
- opened
Jul 24
Discussion
RonanMcGovern
Jul 24
thanks
Lin-K76
Neural Magic org
Jul 24
Yes! That will be released today.
See translation
RonanMcGovern
Jul 24
Great, thanks.
RonanMcGovern
changed discussion status to
closed
Jul 24
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment