Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

4-bit precision

Models

10,159

Full-text search

Active filters: llama-cpp

mattritchey/N3N_gemma-2-9b-it_20241029_1532-Q4_K_M-GGUF

Updated Nov 12 • 10 • 1

C10X/qwen-2.5-o1.like-pluse-Q4_K_M-GGUF

Updated Nov 12 • 42 • 2

ZeroXClem/Qwen2.5-7B-Qandora-CySec-Q4_K_M-GGUF

Updated Nov 12 • 2 • 1

ZeroXClem/Qwen2.5-7B-Qandora-CySec-Q5_K_M-GGUF

Updated Nov 12 • 2 • 1

ZeroXClem/Qwen2.5-7B-Qandora-CySec-Q8_0-GGUF

Updated Nov 12 • 3 • 1

ZeroXClem/Qwen2.5-7B-Qandora-CySec-Q6_K-GGUF

Updated Nov 12 • 10 • 1

zelk12/MT2-Gen2-gemma-2-9B-Q6_K-GGUF

Updated Nov 12 • 5 • 1

ZeroXClem/Qwen2.5-7B-Qandora-CySec-Q5_K_S-GGUF

Updated Nov 12 • 1

ZeroXClem/Qwen2.5-7B-Qandora-CySec-Q5_0-GGUF

Updated Nov 12 • 3 • 1

ZeroXClem/Qwen2.5-7B-Qandora-CySec-Q4_K_S-GGUF

Updated Nov 12 • 4 • 1

ZeroXClem/Qwen2.5-7B-Qandora-CySec-Q4_0-GGUF

Updated Nov 12 • 55 • 1

TanXS/miscii-14b-1028-Q4_K_M-GGUF

Text Generation • Updated Nov 13 • 7 • 1

ddsbg/gemma2-9b-cpt-sahabatai-v1-instruct-Q4_K_M-GGUF

Updated Nov 15 • 4 • 1

Triangle104/Llama-3.1-8B-ArliAI-RPMax-v1.3-Q5_K_S-GGUF

Updated Nov 23 • 10 • 1

Triangle104/Llama-3.1-8B-ArliAI-RPMax-v1.3-Q5_K_M-GGUF

Updated Nov 23 • 7 • 1

Triangle104/Llama-3.1-8B-ArliAI-RPMax-v1.3-Q6_K-GGUF

Updated Nov 23 • 6 • 1

Triangle104/Llama-3.1-8B-ArliAI-RPMax-v1.3-Q8_0-GGUF

Updated Nov 23 • 14 • 1

win10/ArliAI-RPMax-v1.3-merge-8B-Q8_0-GGUF

Updated Nov 17 • 1 • 1

win10/Norns-Qwen2.5-12B-Q8_0-GGUF

Updated Nov 17 • 2 • 1

win10/EVA-Norns-Qwen2.5-v0.1-Q8_0-GGUF

Updated Nov 17 • 1

Triangle104/AstroSage-8B-Q4_K_M-GGUF

Text Generation • Updated Nov 17 • 8 • 1

Supa-AI/llama3-8b-cpt-sahabatai-v1-instruct-gguf

Updated Nov 18 • 33.6k • 1

win10/miscii-14b-1028-Q8_0-GGUF

Text Generation • Updated Nov 19 • 8 • 1

Triangle104/Qwen2.5-Coder-3B-Q5_K_M-GGUF

Text Generation • Updated Nov 20 • 18 • 1

NikolayKozloff/LLaMA-Mesh-Q8_0-GGUF

Text Generation • Updated Nov 20 • 52 • 3

Triangle104/MN-Chunky-Lotus-12B-Q4_K_S-GGUF

Updated Nov 20 • 3 • 1

Triangle104/MN-Chunky-Lotus-12B-Q4_K_M-GGUF

Updated Nov 20 • 8 • 1

Triangle104/MN-Chunky-Lotus-12B-Q5_K_S-GGUF

Updated Nov 20 • 9 • 1

Triangle104/MN-Chunky-Lotus-12B-Q5_K_M-GGUF

Updated Nov 20 • 3 • 1

Triangle104/MN-Chunky-Lotus-12B-Q6_K-GGUF

Updated Nov 20 • 10 • 1