Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

7,765

Full-text search

Active filters: imatrix

mradermacher/Prox-Llama-3-8B-i1-GGUF

Updated Aug 2 • 236 • 1

mradermacher/Hathor_Unstable-L3-8B-v0.3-i1-GGUF

Updated 9 days ago • 159 • 1

mradermacher/Hathor_Enigmatica-L3-8B-v0.4-i1-GGUF

Updated 9 days ago • 73 • 1

mradermacher/Tenebra_30B_Alpha01_FP16-i1-GGUF

Updated Aug 2 • 227 • 1

mradermacher/Llama3-Sophie-i1-GGUF

Updated 9 days ago • 129 • 2

lmstudio-community/Qwen2-500M-Instruct-GGUF

Text Generation • Updated Jun 24 • 146 • 6

bartowski/dolphin-2.9.3-Yi-1.5-34B-32k-GGUF

Text Generation • Updated Jun 24 • 1.3k • 23

bartowski/Replete-Coder-Llama3-8B-GGUF

Text Generation • Updated Jun 24 • 520 • 15

mradermacher/L3-8B-Lunaris-v1-i1-GGUF

Updated Aug 2 • 463 • 13

MaziyarPanahi/calme-2.1-qwen2-72b-GGUF

Text Generation • Updated Aug 2 • 396 • 13

mradermacher/L-MChat-7b-i1-GGUF

Updated Aug 2 • 256 • 1

lmstudio-community/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 16 • 9.23k • 21

lmstudio-community/gemma-2-27b-it-GGUF

Text Generation • Updated Jul 2 • 6.79k • 11

grapevine-AI/gemma-2-27b-it-gguf

Updated Oct 26 • 433 • 12

mradermacher/QuartetAnemoi-70B-t0.0001-i1-GGUF

Updated Aug 2 • 190 • 9

mradermacher/Llama-3-Nerdy-RP-8B-i1-GGUF

Updated Aug 2 • 68 • 1

mradermacher/llama3-8B-DarkIdol-2.2-Uncensored-1048K-i1-GGUF

Updated Aug 2 • 541 • 5

duyntnet/Silicon-Maid-7B-imatrix-GGUF

Text Generation • Updated Jul 2 • 841 • 4

lmstudio-community/Phi-3.1-mini-4k-instruct-GGUF

Text Generation • Updated Aug 1 • 9.34k • 22

mradermacher/L3-8B-Everything-COT-i1-GGUF

Updated Aug 2 • 124 • 1

mradermacher/DeepSeek-V2-Lite-Chat-i1-GGUF

Updated Aug 2 • 145 • 1

bartowski/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Aug 3 • 4.09k • 31

mradermacher/Llama3-UmbralMind-v1-15M-i1-GGUF

Updated 9 days ago • 126 • 2

dahara1/gemma-2-27b-it-gguf-japanese-imatrix

Updated Sep 24 • 341 • 13

mradermacher/Gemma-2-9B-It-SPPO-Iter3-i1-GGUF

Updated Oct 20 • 448 • 3

mradermacher/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-i1-GGUF

Updated Aug 2 • 1.23k • 3

mradermacher/ArliAI-Llama-3-8B-Formax-v1.0-i1-GGUF

Updated 9 days ago • 160 • 1

mradermacher/L3-8B-Stheno-v3.2-abliterated-i1-GGUF

Updated Aug 2 • 875 • 4

THUDM/codegeex4-all-9b-GGUF

Text Generation • Updated Jul 15 • 1.43k • 9

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14 • 731 • 12