Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

16,603

Full-text search

Active filters: llama-cpp

roleplaiapp/R1-Qwen2.5-32B-Instruct-1k-Q5_K_S-GGUF

Text Generation • Updated Jan 31 • 39 • 1

Lucy-in-the-Sky/deepseek-moe-16b-base-Q4_K_M-GGUF

Updated Jan 31 • 327 • 2

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q4_K_M-GGUF

Updated Jan 31 • 13 • 1

Alptekinege/DeepSeek-R1-Qwen-Coder-8B-Q4_K_M-GGUF

Updated Jan 31 • 896 • 1

bhismaperkasa/DeepSeek-R1-Distill-Qwen-14B-uncensored-Q8_0-GGUF

Updated Feb 1 • 528 • 2

roleplaiapp/Qwen2.5-32B-DeepSeek-R1-Instruct-i1-IQ4_XS-GGUF

Text Generation • Updated Feb 1 • 71 • 1

NikolayKozloff/Virtuoso-Small-v2-Q5_K_S-GGUF

Updated Feb 1 • 5 • 1

NikolayKozloff/Virtuoso-Small-v2-Q4_K_M-GGUF

Updated Feb 1 • 21 • 1

brazilianslib/Nemo-12b-Humanize-SFT-v0.2-Quarter-Q4_K_M-GGUF

Updated Feb 1 • 156 • 1

Ransss/L3.1-8b-RP-Ink-Q8_0-GGUF

Updated Feb 1 • 8 • 1

Otakadelic/MT-Gen6-gemma-2-9B-Q8_0-GGUF

Text Generation • Updated Feb 2 • 26 • 2

darkc0de/Dolphin3.0-Mistral-24B-Q4_K_M-GGUF

Updated Feb 2 • 20 • 1

RedSQID/Aggregat_18.5B-Q3_K_M-GGUF

Updated Feb 2 • 4 • 1

bunnycore/Llama-3.2-3B-R1-lora-F16-GGUF

Updated Feb 2 • 25 • 1

Triangle104/Atlas-Flash-7B-Preview-Q4_K_M-GGUF

Updated Feb 2 • 27 • 1

roleplaiapp/Janus-Pro-7B-LM-Q8_0-GGUF

Text Generation • Updated Feb 2 • 240 • 1

darkc0de/Mistral-Small-24B-Instruct-2501-abliterated-Q4_K_M-GGUF

Updated Feb 2 • 195 • 2

roleplaiapp/Janus-Pro-7B-LM-Q4_K_S-GGUF

Text Generation • Updated Feb 2 • 206 • 3

ClaudioItaly/Sensorial-V2-12B-Q4_K_M-GGUF

Updated Feb 2 • 1 • 1

roleplaiapp/FastHunyuan-gguf-Q4_K_M-GGUF

Text Generation • Updated Feb 2 • 26 • 1

itchindigo/NeuralSillyMaid-Q4_K_M-GGUF

Updated Feb 2 • 1 • 1

itchindigo/NeuralLemonKuno-Q4_K_M-GGUF

Updated Feb 3 • 2 • 1

Otakadelic/MT-Gen6fix-gemma-2-9B-Q8_0-GGUF

Text Generation • Updated Feb 3 • 129 • 1

BernTheCreator/GodSlayer-12B-ABYSS-Q4_0-GGUF

Updated Feb 3 • 12 • 2

Alex01837178373/QVikhr-2.5-1.5B-Instruct-SMPO-Q4_0-GGUF

Updated Feb 3 • 8 • 1

mpkmkk/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q4_K_M-GGUF

Updated Feb 3 • 438 • 1

matrixportal/Qwen2.5-7B-CelestialHarmony-1M-GGUF

Updated Feb 3 • 210 • 1

Triangle104/DeepSeek-R1-Distill-Qwen-7B-uncensored-Q4_K_M-GGUF

Updated Feb 3 • 166 • 1

Triangle104/Wingless_Imp_8B-Q4_K_S-GGUF

Updated Feb 3 • 6 • 1

Triangle104/Wingless_Imp_8B-Q4_K_M-GGUF

Updated Feb 3 • 6 • 1