Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

256

Full-text search

Active filters: llama.cpp

codebasic/Qwen3-0.6B-GGUF

0.8B • Updated Jul 6 • 14

dzur658/Polaris-4B-Preview-IQ-GGUF

4B • Updated 30 days ago • 403

Darkhn/M3.2-24B-Animus-V5.1-Pro-GGUF

24B • Updated 20 days ago • 1.42k • 1

ReallyFloppyPenguin/Llama-3.1-Centaur-70B-GGUF

ReallyFloppyPenguin/Dhanishtha-2.0-preview-GGUF

ReallyFloppyPenguin/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

2B • Updated Jul 8 • 79

ReallyFloppyPenguin/DeepSWE-Preview-GGUF

33B • Updated Jul 8 • 83

Makatia/mistral-7b-instruct-v0.2.Q8_0-Q8_0.gguf

7B • Updated 29 days ago • 38

JonathanMiddleton/Qwen3-Reranker-4B-GGUF

Text Ranking • 4B • Updated 28 days ago • 147

Arivukkarasu/TinyLlama-1.1B-Chat-GGUF

1B • Updated 27 days ago • 36

Arivukkarasu/Mistral-7B-Instruct-v0.3-GGUF

7B • Updated 27 days ago • 93

PJEDeveloper/Mistral_Nemo_Instruct_2407-F16.gguf-Q4_K_M

12B • Updated 19 days ago • 55

theprint/Zeth-Gemma3-4B-GGUF

Text Generation • 5B • Updated 22 days ago • 132

HackNetAyush/smollm2-135M-instruct-gguf-q8

Text Generation • 0.1B • Updated 22 days ago • 457 • 2

sugiv/cardvaultplus-500m-gguf

Image-to-Text • 0.4B • Updated 20 days ago • 124

PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.3-F16.gguf-Q5_K_M

7B • Updated 20 days ago • 99

Bastion-AI/SmolLM3-3B-GGUF

3B • Updated 19 days ago • 543 • 1

mistralai/Magistral-Small-2507-GGUF

Text Generation • 24B • Updated 17 days ago • 12.8k • 6

PJEDeveloper/mistralai_Mistral-7B-Instruct-v0.2-Q5_K_M

7B • Updated 19 days ago • 51

Darkhn/M3.2-24B-Animus-V6-Exp-GGUF

24B • Updated 18 days ago • 419

Darkhn/L3.3-70B-Animus-V6-Exp-GGUF

71B • Updated 9 days ago • 213

Darkhn/L3.3-70B-Animus-V6.1-Exp-GGUF

71B • Updated 16 days ago • 249

theprint/TiTan-Llama-3.2-1B-GGUF

Text Generation • 1B • Updated 17 days ago • 194

theprint/TiTan-Gemma3-4B-GGUF

Text Generation • 5B • Updated 12 days ago • 130

dynomite567/Ministral-8B-Instruct-2410-Q4_K_M-GGUF

8B • Updated 16 days ago • 24

dynomite567/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

7B • Updated 16 days ago • 60

Darkhn/M3.2-24B-Animus-V7.0-GGUF

24B • Updated 9 days ago • 537

theprint/Pythonified-Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated 16 days ago • 129

theprint/ReasonableMath-Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated 15 days ago • 94

Darkhn/L3.3-70B-Animus-V7.0-GGUF

71B • Updated 9 days ago • 626 • 1