meta-llama
/

Llama-3.1-405B-FP8

Text Generation

text-generation-inference

Model card Files Files and versions Community

Resources

View closed (15)

Access request FAQ

#13 opened 9 months ago by

Need access

#20 opened about 1 month ago by

inference api no longer working

#18 opened 8 months ago by

Config KV Heads should be 8 now?

#16 opened 8 months ago by

Updated eos_token to include multiple IDs

#14 opened 9 months ago by