-
-
-
-
-
-
Inference Providers
Active filters:
meta
tensorblock/Llama-3-Groq-8B-Tool-Use-GGUF
Text Generation
•
Updated
•
130
da-gRu/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
6
gautamgc17/llama3.2-vlm-torchtune
Image-Text-to-Text
•
Updated
•
6
gurro/Llama-3.1-8B-Q4_K_M-GGUF
Text Generation
•
Updated
•
3
•
1
amd/Llama-2-7b-hf-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation
•
Updated
•
24
gurro/Llama-3.1-8B-Q4_0-GGUF
Text Generation
•
Updated
•
3
amd/Llama-2-7b-chat-hf-awq-g128-int4-asym-fp16-onnx-hybrid
Text Generation
•
Updated
•
45
serena97/Llama-3.2-3B-Instruct-Q8_0-GGUF
Text Generation
•
Updated
•
4
jsjsam98/Llama-3.2-1B-Q8_0-GGUF
Text Generation
•
Updated
•
5
•
1
tekiny/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
4
•
1
tekiny/Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
4
•
1
tekiny/Llama-3.2-3B-Instruct-Q5_K_S-GGUF
Text Generation
•
Updated
•
25
•
1
tekiny/Llama-3.2-1B-Instruct-Q5_K_S-GGUF
Text Generation
•
Updated
•
8
•
1
tekiny/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
•
5
•
1
gurro/Llama-3.1-8B-IQ4_XS-GGUF
Text Generation
•
Updated
•
6
•
1
tensorblock/Llama-3-8B-Instruct-v0.4-GGUF
Text Generation
•
Updated
•
79
tensorblock/llama-3-8b-chat-GGUF
Text Generation
•
Updated
•
49
tensorblock/Meta-Llama-3-8B-hf-GGUF
Text Generation
•
Updated
•
65
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-asym
Text Generation
•
Updated
•
10
mradermacher/Meta-Llama-3-70B-hf-GGUF
knownasSohan/llama3.2-vlm-torchtune
Image-Text-to-Text
•
Updated
•
42
jwiggerthale/Llama-3.2-3B-Q2_K-GGUF
Text Generation
•
Updated
•
10
jwiggerthale/Llama-3.2-3B-Q4_0-GGUF
Text Generation
•
Updated
•
5
jwiggerthale/Llama-3.2-3B-Q8_0-GGUF
Text Generation
•
Updated
•
12
jwiggerthale/Llama-3.2-3B-Instruct-Q2_K-GGUF
Text Generation
•
Updated
•
6
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_awq-int4-gs128-sym
Text Generation
•
Updated
•
9
jwiggerthale/Llama-3.2-3B-Instruct-Q4_0-GGUF
Text Generation
•
Updated
•
16
fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_awq-int4-gs128-asym
Text Generation
•
Updated
•
18
fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_awq-int4-gs128-sym
Text Generation
•
Updated
•
26
fbaldassarri/meta-llama_Llama-3.2-1B-auto_round-int4-gs128-asym
Text Generation
•
Updated
•
33