Edit Models filters

Inference status

Misc

AutoTrain Compatible

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,693

Full-text search

Active filters: 2-bit

MaziyarPanahi/Qwen2.5-14B-Merge-GGUF

Text Generation • Updated 20 days ago • 224

jsongst/Llama-3.2-1B_GPTQ_INT2

Text Generation • Updated 19 days ago • 11

MaziyarPanahi/Qwen-2.5-14B-MINUS-GGUF

Text Generation • Updated 20 days ago • 147

MaziyarPanahi/UwU-7B-Instruct-GGUF

Text Generation • Updated 19 days ago • 190

MaziyarPanahi/light-3B-GGUF

Text Generation • Updated 19 days ago • 122

gxunda/Qwen2.5-3B-Instruct-2bit-no-act

Updated 19 days ago • 10

MaziyarPanahi/Matsu-7B-GGUF

Text Generation • Updated 19 days ago • 171

MaziyarPanahi/phi-4-GGUF

Text Generation • Updated 17 days ago • 360k • 2

mlx-community/qwen2.5-0.5b-instruct-q2

Text Generation • Updated 17 days ago • 30

MaziyarPanahi/phi3.5_mini_exp_825_uncensored-GGUF

Text Generation • Updated 17 days ago • 397

MaziyarPanahi/phi-2-instruct-v0.1-GGUF

Text Generation • Updated 17 days ago • 115

MaziyarPanahi/phi-2-pytdml-GGUF

Text Generation • Updated 17 days ago • 117

MaziyarPanahi/Phi-3-medium-4k-instruct-GGUF

Text Generation • Updated 17 days ago • 98

MaziyarPanahi/JSL-MedPhi2-2.7B-GGUF

Text Generation • Updated 17 days ago • 123

MaziyarPanahi/Phi-3-mini-4k-instruct-GGUF

Text Generation • Updated 17 days ago • 99

MaziyarPanahi/phi-3-portuguese-tom-cat-4k-instruct-GGUF

Text Generation • Updated 17 days ago • 110

MaziyarPanahi/fietje-2-instruct-GGUF

Text Generation • Updated 17 days ago • 141

mlx-community/phi-4-abliterated-2bit

Text Generation • Updated 16 days ago • 26

CuckmeisterFuller/phi-4-Q2-mlx

Text Generation • Updated 12 days ago • 9

CuckmeisterFuller/Cydonia-v1.2-Magnum-v4-22B-Q2-mlx

Text Generation • Updated 12 days ago • 10

CuckmeisterFuller/Cydonia-22B-v1.2-Q2-mlx

Updated 12 days ago • 5

CuckmeisterFuller/Cydonia-22B-v1.3-Q2-mlx

Updated 11 days ago • 5

lilmeaty/SmolLM2-135M-Instruct-GPTQ

Text Generation • Updated 10 days ago • 16

XelotX/WizardLM-2-8x22B-GGUF

Text Generation • Updated 10 days ago • 16

lilmeaty/SmolLM2-135M-Instruct-GPTQ-2bit

Text Generation • Updated 9 days ago • 14

roleplaiapp/ReaderLM-v2-Q2_K-GGUF

Text Generation • Updated 7 days ago • 20

roleplaiapp/Dria-Agent-a-3B-Q2_K-GGUF

Text Generation • Updated 7 days ago • 28

roleplaiapp/Dria-Agent-a-7B-Q2_K-GGUF

Text Generation • Updated 7 days ago • 29

roleplaiapp/AceInstruct-72B-Q2_K-GGUF

Text Generation • Updated 7 days ago • 24

roleplaiapp/Wayfarer-12B-Q2_K-GGUF

Text Generation • Updated 7 days ago • 2