Edit Models filters

Inference status

Misc

Inference Endpoints

Merge

text-generation-inference

text-embeddings-inference

Misc with no match

gguf

Models

73,902

Full-text search

Active filters: gguf

DavidAU/Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF

Text Generation • Updated 24 days ago • 101k • 50

cognitivecomputations/Dolphin3.0-Llama3.1-8B-GGUF

Updated 7 days ago • 8.83k • 22

prithivMLmods/SmolLM2-CoT-360M-GGUF

Text Generation • Updated 7 days ago • 246 • 14

NexaAIDev/OmniAudio-2.6B

Audio-Text-to-Text • Updated about 1 month ago • 10.9k • 225

city96/FLUX.1-dev-gguf

Text-to-Image • Updated Aug 18, 2024 • 108k • 798

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • Updated 13 days ago • 78.8k • 25

city96/FastHunyuan-gguf

Text-to-Video • Updated 4 days ago • 4.09k • 9

google/gemma-2b

Text Generation • Updated Sep 27, 2024 • 212k • 941

city96/llava-llama-3-8b-v1_1-imat-gguf

Image-Text-to-Text • Updated 23 days ago • 3.98k • 12

Qwen/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated about 22 hours ago • 63.4k • 117

prithivMLmods/GWQ-9B-Preview2-GGUF

Text Generation • Updated 4 days ago • 81 • 7

prithivMLmods/Llama-Thinker-3B-Preview2-GGUF

Text Generation • Updated 5 days ago • 182 • 7

prithivMLmods/GWQ-9B-Preview2-Q8_0-GGUF

Text Generation • Updated 4 days ago • 80 • 7

prithivMLmods/GWQ-9B-Preview2-Q6_K-GGUF

Text Generation • Updated 4 days ago • 21 • 7

prithivMLmods/GWQ-9B-Preview2-Q5_K_M-GGUF

Text Generation • Updated 4 days ago • 39 • 7

prithivMLmods/GWQ-9B-Preview-Q5_K_M-GGUF

Text Generation • Updated 4 days ago • 23 • 7

prithivMLmods/GWQ-9B-Preview-Q6_K-GGUF

Text Generation • Updated 4 days ago • 24 • 7

prithivMLmods/GWQ-9B-Preview-Q8_0-GGUF

Text Generation • Updated 4 days ago • 57 • 7

kz919/QwQ-0.5B-Distilled-SFT-gguf

Text Generation • Updated 3 days ago • 320 • 7

moondream/moondream2-gguf

Updated Apr 25, 2024 • 667 • 17