Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

7,859

Full-text search

Active filters: imatrix

Lewdiculous/MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix

Updated Oct 3 • 514 • 15

mradermacher/Llama-3.2-1B-Instruct-abliterated-i1-GGUF

Updated Oct 2 • 441 • 2

mradermacher/MN-12B-Vespa-x1-i1-GGUF

Updated Oct 3 • 179 • 6

alfredplpl/gemma-2-2b-jpn-it-gguf

Updated 8 days ago • 2.21k • 16

mradermacher/Mistral-Nemo-Gutenberg-Doppel-12B-v2-i1-GGUF

Updated Oct 4 • 618 • 3

bartowski/MSM-MS-Cydrion-22B-GGUF

Text Generation • Updated Oct 4 • 1.28k • 6

bartowski/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-7B-GGUF

Text Generation • Updated Oct 4 • 5.64k • 7

bartowski/Llama-3.1-WhiteRabbitNeo-2-8B-GGUF

Text Generation • Updated Oct 4 • 4.04k • 4

mradermacher/Llama-3.2-1B-Instruct-Uncensored-i1-GGUF

Updated Oct 11 • 656 • 2

mradermacher/Mistral-NeMo-Minitron-Upscale-v3-i1-GGUF

Updated Oct 11 • 248 • 1

bartowski/BlackSheep-RP-12B-GGUF

Text Generation • Updated Oct 6 • 413 • 3

mradermacher/Mistral-Nemo-Instruct-MCAI-SFT-DPO-revision-only-i1-GGUF

Updated 11 days ago • 102 • 1

bartowski/llama3.1-airoboros3.2-QDT-8B-GGUF

Text Generation • Updated Oct 6 • 304 • 2

bartowski/EVA-Qwen2.5-14B-v0.1-GGUF

Text Generation • Updated Oct 7 • 299 • 2

mradermacher/Mahou-1.5-mistral-nemo-12B-i1-GGUF

Updated Oct 11 • 292 • 2

mradermacher/Rombos-LLM-V2.5-Qwen-32b-i1-GGUF

Updated Oct 11 • 645 • 1

mradermacher/Rombos-LLM-V2.5-Qwen-72b-i1-GGUF

Updated Oct 11 • 223 • 2

mradermacher/EVA-Qwen2.5-14B-v0.1-i1-GGUF

Updated Oct 11 • 258 • 4

webbigdata/gemma-2-2b-jpn-it-translate-gguf

Updated Oct 22 • 906 • 5

mradermacher/MoE-Girl-1BA-7BT-i1-GGUF

Updated Oct 11 • 911 • 3

bartowski/Behemoth-123B-v1-GGUF

Text Generation • Updated Oct 9 • 807 • 3

bartowski/Stheno-Hercules-3.1-8B-GGUF

Text Generation • Updated Oct 9 • 677 • 3

bartowski/qwen2.5-7b-ins-v3-GGUF

Text Generation • Updated Oct 10 • 977 • 9

bartowski/Mistral-NeMo-Minitron-8B-Instruct-GGUF

Text Generation • Updated Oct 10 • 1.27k • 6

arcee-ai/SuperNova-Medius-GGUF

Updated Oct 17 • 22.4k • 53

mradermacher/MN-GRAND-Gutenberg-Lyra4-Lyra-12B-MADNESS-i1-GGUF

Updated Oct 11 • 88 • 2

mradermacher/Orca-2-13b-Alpaca-Uncensored-i1-GGUF

Updated Oct 11 • 251 • 1

bartowski/Pantheon-RP-1.6.2-22b-Small-GGUF

Text Generation • Updated Oct 11 • 486 • 5

bartowski/SuperNova-Medius-GGUF

Text Generation • Updated Oct 13 • 9.75k • 40

mradermacher/Qwen2.5-7B-Instruct-Uncensored-i1-GGUF

Updated Oct 11 • 468 • 2