Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

98,164

Full-text search

Active filters: gguf

ggml-org/WavTokenizer

Updated Jan 10 • 607 • 3

DevQuasar/ibm-granite.granite-3.1-8b-instruct-GGUF

Text Generation • Updated Feb 1 • 1.05k • 4

mradermacher/Llama-3.1-8B-Open-SFT-GGUF

Updated 2 days ago • 172 • 1

bartowski/Rombos-LLM-70b-Llama-3.3-GGUF

Text Generation • Updated Dec 23, 2024 • 1.17k • 1

mradermacher/Layris_9B-i1-GGUF

Updated 2 days ago • 148 • 1

mradermacher/maid-yuzu-v8-alter-GGUF

Updated Dec 19, 2024 • 138 • 2

mradermacher/sexting-GGUF

Updated Dec 19, 2024 • 655 • 2

MaziyarPanahi/Qwen2.5-7B-HomerCreative-Mix-GGUF

Text Generation • Updated Dec 19, 2024 • 552 • 1

tiiuae/Falcon3-7B-Instruct-1.58bit-GGUF

Updated Dec 19, 2024 • 119 • 3

tiiuae/Falcon3-10B-Instruct-1.58bit-GGUF

Updated Dec 19, 2024 • 39 • 3

mradermacher/Qwen2.5-14B-Wernickev3-GGUF

Updated Dec 19, 2024 • 88 • 2

SunJack/qwen2.5-7b-o1

Updated Jan 17 • 69 • 1

mradermacher/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v2-GGUF

Updated Jan 22 • 881 • 9

mradermacher/AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS-v2-i1-GGUF

Updated Jan 22 • 762 • 4

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q4_K_S-GGUF

Updated Dec 19, 2024 • 19 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q4_K_M-GGUF

Updated Dec 19, 2024 • 55 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q5_K_S-GGUF

Updated Dec 19, 2024 • 7 • 1

methodya/arabic-summarizer-philosophy-v3

Summarization • Updated Dec 19, 2024 • 28 • • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q5_K_M-GGUF

Updated Dec 19, 2024 • 6 • 1

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q6_K-GGUF

Updated Dec 19, 2024 • 18 • 1

QuantFactory/granite-3.1-3b-a800m-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 785 • 6

Triangle104/Hermes-3-Llama-3.2-3B-abliterated-Q8_0-GGUF

Updated Dec 19, 2024 • 92 • 1

itlwas/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 19, 2024 • 20 • 1

itlwas/Mistral-7B-Instruct-v0.1-Q4_K_M-GGUF

Text Generation • Updated Dec 19, 2024 • 595 • 1

Lewdiculous/Captain-Eris_Violet-V0.420-12B-GGUF-ARM-Imatrix

Updated Dec 27, 2024 • 6.91k • 23

mradermacher/Qwentile2.5-32B-Instruct-GGUF

Updated Dec 19, 2024 • 209 • 4

mradermacher/granite-3.1-8b-instruct-GGUF

Updated Dec 20, 2024 • 154 • 1

bartowski/TQ2.5-14B-Neon-v1-GGUF

Text Generation • Updated Dec 20, 2024 • 571 • 4

mradermacher/granite-3.1-8b-instruct-i1-GGUF

Updated Feb 13 • 499 • 2

mradermacher/granite-3.1-1b-a400m-instruct-i1-GGUF

Updated Dec 21, 2024 • 234 • 2