Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

Models

97,240

Full-text search

Active filters: gguf

city96/HunyuanVideo-gguf

Text-to-Video • Updated Dec 17, 2024 • 23.2k • 152

Pinkstack/PARM-V2-QwQ-Qwen-2.5-o1-3B-GGUF

Text Generation • Updated Jan 15 • 550 • 6

mradermacher/MT3-Gen4-gemma-2-9B-GGUF

Updated Dec 17, 2024 • 192 • 2

gghfez/72B-Qwen2.5-Kunou-v1-control-vectors

Updated Dec 19, 2024 • 1.61k • 1

RippleLinks/Flux_Models

Updated 29 days ago • 93 • 2

mradermacher/PARM-V1.5-QwQ-Qwen-2.5-o1-3B-VLLM-GGUF

Updated Jan 17 • 641 • 2

mradermacher/Falcon3-10B-Base-GGUF

Updated Dec 17, 2024 • 424 • 1

mradermacher/Falcon3-10B-Base-i1-GGUF

Updated Dec 17, 2024 • 555 • 1

lmstudio-community/Falcon3-10B-Instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 425 • 1

bartowski/Falcon3-7B-Instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 2.33k • 1

itlwas/aya-expanse-8b-abliterated-Q4_K_M-GGUF

Updated Dec 17, 2024 • 90 • 1

itlwas/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated Dec 17, 2024 • 23 • 1

bartowski/Llama-Song-Stream-3B-Instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 14.4k • 2

tensorblock/sexyGPT-Uncensored-GGUF

Updated Dec 18, 2024 • 1.47k • 3

DavidAU/L3.1-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-Uncensored-47B-GGUF

Text Generation • Updated Dec 20, 2024 • 382 • 2

prithivMLmods/Llama-3.1-8B-Open-SFT-GGUF

Text Generation • Updated Dec 18, 2024 • 222 • 9

itlwas/Devple-8B-Q4_K_M-GGUF

Text Generation • Updated Dec 18, 2024 • 11 • 1

IntelligentEstate/fblgit_miniclaus-qw1.5B-UNAMGS-Q8_0-GGUF

Updated Dec 18, 2024 • 22 • 2

bartowski/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 4.15k • 11

lmstudio-community/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 9.29k • 13

bartowski/granite-3.1-2b-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 3.25k • 4

lmstudio-community/granite-3.1-2b-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 307 • 1

bartowski/granite-3.1-3b-a800m-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 3.88k • 6

bartowski/moxin-chat-7b-GGUF

Text Generation • Updated Dec 18, 2024 • 761 • 3

lmstudio-community/granite-embedding-125m-english-GGUF

Text Generation • Updated Dec 23, 2024 • 241 • 1

bartowski/granite-embedding-278m-multilingual-GGUF

Text Generation • Updated Dec 23, 2024 • 2.94k • 3

lmstudio-community/granite-embedding-278m-multilingual-GGUF

Text Generation • Updated Dec 23, 2024 • 1.57k • 1

ggml-org/WavTokenizer

Updated Jan 10 • 696 • 2

DevQuasar/ibm-granite.granite-3.1-8b-instruct-GGUF

Text Generation • Updated Feb 1 • 1.06k • 4

mradermacher/Llama-3.1-8B-Open-SFT-GGUF

Updated 10 minutes ago • 145 • 1