Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

4-bit precision

Models

10,177

Full-text search

Active filters: llama-cpp

kabachuha/gemma-2-2b-it-abl-rudpo-Q8_0-GGUF

Text Generation • Updated Nov 23 • 8 • 1

yemiao2745/Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • Updated Nov 23 • 790 • 3

zelk12/MT5-Gen2-gemma-2-9B-Q6_K-GGUF

Text Generation • Updated Nov 23 • 2 • 1

win10/SphinxMind-14B-normalize-false-Q8_0-GGUF

Updated Nov 23 • 9 • 1

kabachuha/gemma-2-2b-it-abl-rudpo-Q4_K_M-GGUF

Text Generation • Updated Nov 23 • 6 • 1

yemiao2745/Meissa-Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 23 • 114 • 1

yemiao2745/Meissa-Qwen2.5-14B-Instruct-Q4_K_M-GGUF

Updated Nov 23 • 11 • 1

drean26/omost-llama-3-8b-Q4_K_M-GGUF

Updated Nov 23 • 12 • 2

yemiao2745/Qwen2.5-14B-Instruct-Uncensored-Q4_K_M-GGUF

Updated Nov 23 • 1.9k • 2

bunnycore/Tulu-3.1-8B-SuperNova-Smart-IQ4_XS-GGUF

Updated Nov 23 • 4 • 1

MLking2/banking_chatbot_master-Q8_0-GGUF

Updated Nov 24 • 9 • 1

Triangle104/Qwen2.5-Coder-32B-Instruct-Q6_K-GGUF

Text Generation • Updated Nov 24 • 131 • 1

mrheinen/gemma2-9b-lophiid-1.1-Q6_K-GGUF

Updated Nov 24 • 6 • 1

tokoin/Mistral-7B-Instruct-v0.3-Q8_0-GGUF

Updated Nov 24 • 20 • 1

Shamil12/Qwen2.5-1.5B-Matrix-Q3_K_S-GGUF

Updated Nov 24 • 5 • 1

Aashraf995/Phi-3-mini-128k-instruct-Q8_0-GGUF

Text Generation • Updated Nov 24 • 27 • 1

ricardocostaza/mistral-doryV2-12b-Q4_K_M-GGUF

Updated Nov 24 • 14 • 1

mrheinen/gemma2-9b-lophiid-1.2-Q6_K-GGUF

Updated Nov 24 • 1 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q4_K_S-GGUF

Text Generation • Updated Nov 24 • 11 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q4_K_M-GGUF

Text Generation • Updated Nov 24 • 8 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_S-GGUF

Text Generation • Updated Nov 24 • 5 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q5_K_M-GGUF

Text Generation • Updated Nov 24 • 11 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q6_K-GGUF

Text Generation • Updated Nov 24 • 7 • 1

Triangle104/Llama3.1-8B-ShiningValiant2-Q8_0-GGUF

Text Generation • Updated Nov 24 • 9 • 1

Triangle104/ADELIE-DPO-Q4_K_S-GGUF

Text Generation • Updated Nov 24 • 5 • 1

Triangle104/ADELIE-DPO-Q4_K_M-GGUF

Text Generation • Updated Nov 24 • 8 • 1

Triangle104/ADELIE-DPO-Q5_K_S-GGUF

Text Generation • Updated Nov 24 • 8 • 1

Triangle104/ADELIE-DPO-Q5_K_M-GGUF

Text Generation • Updated Nov 24 • 7 • 1

Triangle104/ADELIE-DPO-Q6_K-GGUF

Text Generation • Updated Nov 24 • 14 • 1

Triangle104/ADELIE-DPO-Q8_0-GGUF

Text Generation • Updated Nov 24 • 7 • 1