Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,904

Full-text search

Active filters: facebook

tensorblock/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated Nov 29, 2024 • 53

da-gRu/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 29, 2024

gautamgc17/llama3.2-vlm-torchtune

Image-Text-to-Text • Updated Nov 29, 2024 • 6

mav23/ARIA-70B-V2-GGUF

Text Generation • Updated Nov 30, 2024 • 12

gurro/Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Nov 30, 2024 • 5 • 1

amd/Llama-2-7b-hf-awq-g128-int4-asym-fp16-onnx-hybrid

Text Generation • Updated about 1 month ago • 13

gurro/Llama-3.1-8B-Q4_0-GGUF

Text Generation • Updated Nov 30, 2024 • 9

amd/Llama-2-7b-chat-hf-awq-g128-int4-asym-fp16-onnx-hybrid

Text Generation • Updated about 1 month ago • 27

serena97/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 30, 2024 • 2

jsjsam98/Llama-3.2-1B-Q8_0-GGUF

Text Generation • Updated Dec 1, 2024 • 14 • 1

tekiny/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 1, 2024 • 1

tekiny/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 1, 2024 • 4 • 1

tekiny/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Dec 1, 2024 • 4 • 1

tekiny/Llama-3.2-1B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Dec 1, 2024 • 1

tekiny/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 1, 2024 • 6 • 1

gurro/Llama-3.1-8B-IQ4_XS-GGUF

Text Generation • Updated Dec 1, 2024 • 1

tensorblock/Llama-3-8B-Instruct-v0.4-GGUF

Text Generation • Updated Dec 1, 2024 • 7

tensorblock/llama-3-8b-chat-GGUF

Text Generation • Updated Dec 1, 2024 • 14

tensorblock/Meta-Llama-3-8B-hf-GGUF

Text Generation • Updated Dec 1, 2024 • 128

mradermacher/Meta-Llama-3-70B-hf-GGUF

Updated Dec 2, 2024 • 2

knownasSohan/llama3.2-vlm-torchtune

Image-Text-to-Text • Updated Dec 2, 2024 • 5

QuantFactory/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • Updated Dec 2, 2024 • 237 • 2

jwiggerthale/Llama-3.2-3B-Q2_K-GGUF

Text Generation • Updated Dec 2, 2024 • 14

jwiggerthale/Llama-3.2-3B-Q4_0-GGUF

Text Generation • Updated Dec 2, 2024 • 24

jwiggerthale/Llama-3.2-3B-Q8_0-GGUF

Text Generation • Updated Dec 2, 2024 • 9

jwiggerthale/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated Dec 2, 2024 • 9

jwiggerthale/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Dec 2, 2024 • 24

BronioInt/Lake-1

Text Generation • Updated Dec 3, 2024 • 4

spicychickennoodles/Llama-3.2-1B-Alpaca

Text Generation • Updated Dec 2, 2024 • 14

mradermacher/ContaLLM-Beauty-8B-Instruct-GGUF

Updated Dec 3, 2024 • 19 • 1