meta-llama/Llama-4-Maverick-17B-128E-Instruct Image-Text-to-Text • Updated 8 days ago • 34.6k • • 291
meta-llama/Llama-4-Scout-17B-16E-Instruct Image-Text-to-Text • Updated 8 days ago • 671k • • 786
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4 Text Generation • Updated Aug 7, 2024 • 67.6k • 100
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • Updated Oct 9, 2024 • 429 • 5
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • Updated Oct 23, 2024 • 13.9k • 10
QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2 Text Generation • Updated May 6, 2024 • 634 • 16
Llama 3.1 GPTQ, AWQ, and BNB Quants Collection Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗 • 9 items • Updated Sep 26, 2024 • 56