Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

8,659

Full-text search

Active filters: imatrix

bartowski/phi-4-GGUF

Text Generation • Updated about 18 hours ago • 17.8k • 34

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • Updated 12 days ago • 78.1k • 25

bartowski/Sky-T1-32B-Preview-GGUF

Text Generation • Updated about 8 hours ago • 9

mmnga/DeepSeek-V3-slice-jp64-gguf

Updated 6 days ago • 768 • 6

bartowski/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 46.1k • 47

bartowski/Qwentile2.5-32B-Instruct-GGUF

Text Generation • Updated 7 days ago • 1.31k • 5

bartowski/Dolphin3.0-Llama3.1-8B-GGUF

Text Generation • Updated 6 days ago • 2.19k • 4

bartowski/Dolphin3.0-Llama3.2-3B-GGUF

Text Generation • Updated 6 days ago • 2.44k • 4

bartowski/Dolphin3.0-Qwen2.5-3b-GGUF

Text Generation • Updated 6 days ago • 3.4k • 4

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • Updated Sep 22, 2024 • 30.5k • 31

bartowski/Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

Text Generation • Updated Nov 14, 2024 • 6.38k • 21

bartowski/QwQ-32B-Preview-abliterated-GGUF

Text Generation • Updated Dec 1, 2024 • 6.74k • 22

bartowski/QVQ-72B-Preview-GGUF

Image-Text-to-Text • Updated 3 days ago • 187k • 52

mradermacher/SmallThinker-3B-Preview-abliterated-i1-GGUF

Updated 10 days ago • 780 • 4

bartowski/Phi-3.5-MoE-instruct-GGUF

Text Generation • Updated 1 day ago • 962 • 3

benhaotang/Rombos-Coder-V2.5-Qwen-7b-GGUF_cline

Updated Nov 15, 2024 • 256 • 5

bartowski/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated Nov 10, 2024 • 36.2k • 48

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated Dec 7, 2024 • 63

bartowski/QwQ-32B-Preview-GGUF

Text Generation • Updated Nov 27, 2024 • 43.5k • 93

mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-i1-GGUF

Updated 26 days ago • 1.16k • 3

Lewdiculous/Captain-Eris_Twighlight-V0.420-12B-GGUF-ARM-Imatrix

Updated 14 days ago • 1.45k • 7

Lewdiculous/experimental-lwd-Mirau-RP-14B-GGUF-IQ-Imatrix

Updated 11 days ago • 1.8k • 9

mradermacher/14B-Qwen2.5-Freya-x1-i1-GGUF

Updated 11 days ago • 1.51k • 2

bartowski/32B-Qwen2.5-Kunou-v1-GGUF

Text Generation • Updated 8 days ago • 863 • 2

mmnga/c4ai-command-r7b-12-2024-gguf

Updated 7 days ago • 1.16k • 2

mradermacher/Lamarck-14B-v0.6-i1-GGUF

Updated 4 days ago • 772 • 2

mradermacher/phi-4-i1-GGUF

Updated 3 days ago • 765 • 2

mradermacher/Midnight-Rose-70B-v2.0.3-i1-GGUF

Updated May 10, 2024 • 39 • 1

Lewdiculous/LemonadeRP-4.5.3-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 96 • 13

Lewdiculous/Prima-LelantaclesV6.69-7b-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 17 • 5