Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

AutoTrain Compatible

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

16,631

Full-text search

Active filters: llama-cpp

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Q6_K-GGUF

Text Generation • Updated Jan 21 • 102 • 1

netease-youdao/Confucius-o1-14B-GGUF

Updated Jan 22 • 316 • 1

NikolayKozloff/Llasa-1B-Q8_0-GGUF

Text-to-Speech • Updated Jan 21 • 80 • 3

Triangle104/Phi4-abliterated-Q6_K-GGUF

Updated Jan 21 • 31 • 1

srinivasbilla/llasa-3b-Q4_K_M-GGUF

Updated Jan 21 • 142 • 3

srinivasbilla/llasa-3b-Q8_0-GGUF

Updated Jan 21 • 28 • 2

Triangle104/Dria-Agent-a-3B-Q5_K_M-GGUF

Text Generation • Updated Jan 21 • 10 • 1

NikolayKozloff/q1-3B-PRIME-Q8_0-GGUF

Text Generation • Updated Jan 21 • 20 • 2

ClaudioItaly/Magdala-9B-Q4_K_M-GGUF

Updated Jan 21 • 5 • 1

matrixportal/DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M-GGUF

Updated Jan 21 • 222 • 1

Cran-May/Lamarck-14B-v0.7-Q4_K_M-GGUF

Text Generation • Updated Jan 22 • 14 • 1

ClaudioItaly/Vangelus-Poetic-9B-Q4_K_M-GGUF

Updated Jan 22 • 5 • 1

matrixportal/LLama3.1-Hawkish-Theia-Fireball-8B-GGUF

Text Generation • Updated Jan 22 • 251 • 1

roleplaiapp/ALIA-40b-Q8_0-GGUF

Text Generation • Updated Jan 22 • 39 • 3

jlopez-dl/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q5_K_M-GGUF

Updated Jan 23 • 80 • 1

DataSoul/FuseO1-DeepSeekR1-Qwen2.5-Coder-32B-Preview-Q4_K_M-GGUF

Updated Jan 22 • 28 • 1

RedSQID/sororicide-12B-Farer-Mell-Unslop-Q4_K_M-GGUF

Updated Jan 22 • 16 • 1

IntelligentEstate/Pancho-V1va-Replicant-qw25-Q8_0-GGUF

Updated Jan 24 • 172 • 3

kagevazquez/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q4_K_M-GGUF

Updated Jan 23 • 227 • 1

CronoBJS/FuseO1-DeepSeekR1-Qwen2.5-Coder-14B-Preview-Q4_K_M-GGUF

Updated Jan 23 • 657 • 1

jimi0209/lb-reranker-0.5B-v1.0-Q5_K_M-GGUF

Text Generation • Updated Jan 23 • 30 • 2

ClaudioItaly/Vangelus-Secundus-Q5_K_M-GGUF

Updated Jan 23 • 6 • 1

maicog/DeepSeek-R1-Distill-Llama-8B-abliterated-Q4_K_S-GGUF

Updated Jan 23 • 525 • 7

NikolayKozloff/salt-asr_wav-uni_1_tts_wav-uni_1-12k-Q8_0-GGUF

Updated Jan 23 • 112 • 1

matrixportal/Bio-Medical-Llama-3-2-1B-CoT-012025-GGUF

Updated Jan 23 • 197 • 2

capa8/salamandra-7b-Q4_K_M-GGUF

Text Generation • Updated Jan 23 • 34 • 1

havenwood/DeepSeek-R1-Distill-Qwen-32B-abliterated-Q5_K_M-GGUF

Updated Jan 23 • 177 • 1

ggml-org/LoRA-Qwen2.5-1.5B-Instruct-abliterated-F16-GGUF

Updated Jan 23 • 119 • 2

Ashcomposer/jina-embeddings-v2-base-zh-Q8_0-GGUF

Feature Extraction • Updated Jan 24 • 101 • 1

harkov000/R1-DarkIdol-8B-v0.4-Q6_K-GGUF

Updated Jan 24 • 24 • 2