Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

16,603

Full-text search

Active filters: llama-cpp

NikolayKozloff/Mistral-Small-24B-Instruct-2501-Q3_K_S-GGUF

Updated Jan 30 • 13 • 1

Hasso5703/Mistral-Small-24B-Instruct-2501-Q4_0-GGUF

Updated Jan 30 • 105 • 2

Hasso5703/Mistral-Small-24B-Instruct-2501-Q2_K-GGUF

Updated Jan 30 • 16 • 1

Triangle104/Mistral-Small-24B-Instruct-2501-Q5_K_S-GGUF

Updated Jan 30 • 18 • 1

lolnoyarite/Mistral-Small-24B-Base-2501-Q4_K_M-GGUF

Updated Jan 30 • 67 • 1

Triangle104/L3.1-8b-RP-Ink-Q4_K_S-GGUF

Updated Jan 30 • 6 • 1

IntelligentEstate/Israfel_Qwen2.6-iQ4_K_M-GGUF

Text Generation • Updated Feb 2 • 49 • 2

Triangle104/L3.1-8b-RP-Ink-Q4_K_M-GGUF

Updated Jan 30 • 7 • 1

NikolayKozloff/Llama-3.1-8B-ReasonChatV1-Q8_0-GGUF

Updated Jan 30 • 8 • 1

Triangle104/L3.1-8b-RP-Ink-Q5_K_S-GGUF

Updated Jan 30 • 5 • 1

NikolayKozloff/DeepSeek-R1-ReDistill-Llama3-8B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 17 • 1

Triangle104/L3.1-8b-RP-Ink-Q5_K_M-GGUF

Updated Jan 30 • 5 • 1

Triangle104/L3.1-8b-RP-Ink-Q6_K-GGUF

Updated Jan 30 • 3 • 1

Triangle104/L3.1-8b-RP-Ink-Q8_0-GGUF

Updated Jan 30 • 11 • 1

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.0-Q8_0-GGUF

Text Generation • Updated Jan 30 • 15 • 1

NikolayKozloff/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.1-Q8_0-GGUF

Text Generation • Updated Jan 30 • 26 • 1

msyukorai/Qwen2.5-14B-DeepSeek-R1-1M-Q4_0-GGUF

Updated Jan 30 • 109 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-7B-abliterated-Q4_K_M-GGUF

Updated Jan 30 • 335 • 2

BernTheCreator/Mistral-Nemo-12B-ArliAI-RPMax-v1.3-Q4_0-GGUF

Updated Jan 31 • 78 • 2

BernTheCreator/DeepSeek-R1-ReDistill-Qwen-1.5B-v1.1-Q4_0-GGUF

Text Generation • Updated Jan 31 • 119 • 1

roleplaiapp/Mistral-Small-24B-Instruct-2501-Q3_K_M-GGUF

Text Generation • Updated Jan 31 • 130 • 1

roleplaiapp/Qwen2.5-Coder-14B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • Updated Jan 31 • 52 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q8_0-GGUF

Text Generation • Updated Jan 31 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-7B-Multilingual-Q8_0-GGUF

Updated Jan 31 • 236 • 3

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Multilingual-Q5_K_S-GGUF

Updated Jan 31 • 282 • 1

NikolayKozloff/DeepSeek-R1-Distill-Qwen-14B-Multilingual-Q4_K_M-GGUF

Updated Jan 31 • 101 • 1

ClaudioItaly/DeepSeek-R1-Distill-Qwen-7B-Multilingual-Q5_K_M-GGUF

Updated Jan 31 • 112 • 1

ggml-org/Qwen2.5-Coder-0.5B-Q8_0-GGUF

Text Generation • Updated Jan 31 • 300 • 3

DigitalLearningGmbH/educa-ai-nemo-dpo-GGUF

Updated Feb 2 • 142 • 1

NikolayKozloff/HEFT-Qwen-Q8_0-GGUF

Updated Jan 31 • 19 • 1