Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

16,597

Full-text search

Active filters: llama-cpp

attashe/q-2.5-deepseek-r1-veltha-v0.3-Q5_K_M-GGUF

Updated Jan 28 • 27 • 1

multimodalart/YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

Text Generation • Updated Jan 28 • 55 • 2

KenLi315/Conan-embedding-v1-Q4_K_M-GGUF

Updated Jan 28 • 182 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-Q4_K_M-GGUF

Text Generation • Updated Feb 7 • 79 • 8

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q6_K-GGUF

Text Generation • Updated Jan 28 • 349k • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q8_0-GGUF

Text Generation • Updated Jan 28 • 868k • 4

KatyTheCutie/Repose-12B-Q6_K-GGUF

Updated Jan 28 • 27 • 1

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q4_K_M-GGUF

Text Generation • Updated Jan 29 • 1.86k • 2

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q4_K_S-GGUF

Text Generation • Updated Jan 29 • 10 • 2

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q4_K_M-GGUF

Text Generation • Updated Jan 29 • 29 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q5_K_S-GGUF

Text Generation • Updated Jan 29 • 3 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q5_K_M-GGUF

Text Generation • Updated Jan 29 • 4 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q6_K-GGUF

Text Generation • Updated Jan 29 • 27 • 1

Triangle104/Qwen2.5-7B-Instruct-1M-abliterated-Q8_0-GGUF

Text Generation • Updated Jan 29 • 130 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_S-GGUF

Updated Jan 29 • 814 • 4

Triangle104/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q4_K_M-GGUF

Updated Jan 29 • 215 • 1

roleplaiapp/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q6_K-GGUF

Text Generation • Updated Jan 29 • 255 • 1

roleplaiapp/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q3_K_L-GGUF

Text Generation • Updated Jan 29 • 111 • 1

DoppelReflEx/MN-12B-Kakigori-Q6_K-GGUF

Updated Jan 29 • 10 • 1

Theros/Qwen2.5-ColdBrew-R1-Q4_K_M-GGUF

Updated Jan 29 • 8 • 1

reedmayhew/DeepSeek-R1-2025Navigator-Llama-3.1-8B-hf-Q4_K_M-GGUF

Updated Jan 29 • 18 • 1

NikolayKozloff/Virtuoso-Lite-Q8_0-GGUF

Updated Jan 29 • 13 • 1

NikolayKozloff/Virtuoso-Lite-Q6_K-GGUF

Updated Jan 29 • 18 • 1

ZeroXClem/Qwen2.5-7B-CelestialHarmony-1M-Q4_K_M-GGUF

Updated Jan 30 • 17 • 2

ozone-research/2x-lite-Q4_K_M-GGUF

Updated Jan 30 • 79 • 1

cwjoneill/finetuned_llama3.2-F16-GGUF

Updated Jan 30 • 14 • 1

pradma/DeepSeek-R1-Distill-Qwen-7B-abliterated-Q8_0-GGUF

Updated Jan 30 • 1.13k • 1

NikolayKozloff/YuE-s1-7B-anneal-en-cot-Q8_0-GGUF

Text Generation • Updated Jan 30 • 9 • 1

NikolayKozloff/YuE-s2-1B-general-Q8_0-GGUF

Text Generation • Updated Jan 30 • 10 • 1

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated Jan 30 • 38 • 2