Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

7,765

Full-text search

Active filters: imatrix

mradermacher/Mahou-1.3d-mistral-7B-i1-GGUF

Updated 7 days ago • 128 • 1

lmstudio-community/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16 • 4.43k • 8

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 17 • 7 • 2

arcee-ai/Arcee-Scribe-GGUF

Updated Jul 17 • 119 • 11

bartowski/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Nov 5 • 13.8k • 53

bartowski/Arcee-Nova-GGUF

Text Generation • Updated Jul 19 • 244 • 5

bartowski/turbcat-instruct-72b-GGUF

Text Generation • Updated Jul 22 • 149 • 2

mradermacher/gemma-2-9b-it-SimPO-i1-GGUF

Updated Aug 2 • 325 • 6

mradermacher/saiga_gemma2_10b-i1-GGUF

Updated 9 days ago • 152 • 3

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

Updated Aug 2 • 1.13k • 6

mradermacher/L3-Himerus-Basis.C-13B-i1-GGUF

Updated 9 days ago • 444 • 1

duyntnet/Nous-Hermes-Llama2-13b-imatrix-GGUF

Text Generation • Updated Jul 23 • 333 • 1

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 902 • 5

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 2.22M • 37

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 908 • 11

mmnga/Llama-3.1-70B-Instruct-gguf

Updated Jul 24 • 649 • 2

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 28 • 800 • 37

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • Updated Jul 25 • 1.06k • 29

mradermacher/Hathor_Sofit-L3-8B-v1-i1-GGUF

Updated Aug 2 • 207 • 2

lmstudio-community/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Aug 29 • 271 • 13

bartowski/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Text Generation • Updated Jul 28 • 2.74k • 8

lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Jul 25 • 3.93k • 4

Reiterate3680/Sekhmet_Bet-L3.1-8B-v0.2-GGUF

Text Generation • Updated Aug 6 • 42 • 1

mradermacher/lumi-nemo-e2.0-i1-GGUF

Updated Nov 17 • 31 • 2

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

Updated Aug 2 • 4.05k • 9

mradermacher/Meta-Llama-3.1-Chat-Uncensored-i1-GGUF

Updated Aug 2 • 286 • 2

mradermacher/Meta-Llama-3.1-13B-Instruct-abliterated-i1-GGUF

Updated Aug 2 • 280 • 4

bartowski/Gemmasutra-Pro-27B-v1-GGUF

Text Generation • Updated Jul 29 • 4.86k • 2

mradermacher/Llama-Guard-3-8B-i1-GGUF

Updated Aug 2 • 139 • 3

mradermacher/L3-TheGreenLion-8b-SFT-v0.1.2-i1-GGUF

Updated 9 days ago • 77 • 1