Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,887

Full-text search

Active filters: 3-bit

MaziyarPanahi/Llama-3-8B-Stroganoff-4.0-GGUF

Text Generation • Updated Nov 2 • 138 • 1

MaziyarPanahi/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

Text Generation • Updated Nov 2 • 154 • 1

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 3 • 658 • 1

MaziyarPanahi/SmolLM2-360M-Instruct-GGUF

Text Generation • Updated Nov 3 • 189 • 2

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • Updated Nov 6 • 6.38k • 1

MaziyarPanahi/Mistral-Crab-DPO-GGUF

Text Generation • Updated Nov 7 • 53 • 2

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • Updated Nov 7 • 117 • 1

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 513 • 1

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 390 • 2

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • Updated Nov 15 • 768 • 1

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated Nov 15 • 118 • 1

DrNicefellow/Qwen2.5-Coder-32B-Instruct-3.0bpw-exl2

Updated Nov 12 • 19 • 1

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15 • 243 • 7

Jellon/Athene-V2-Chat-72b-exl2-3bpw

Text Generation • Updated Nov 16 • 32 • 2

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20 • 675k • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-3.0bpw-h6-exl2

Updated Nov 19 • 14 • 1

mlx-community/Qwen2.5-Coder-32B-Instruct-3bit

Text Generation • Updated Nov 23 • 149 • 3

mlx-community/Hunyuan-A52B-Instruct-3bit

Text Generation • Updated about 1 month ago • 188 • 5

mlx-community/QwQ-32B-Preview-3bit

Text Generation • Updated 27 days ago • 241 • 5

Dracones/Athene-V2-Chat_exl2_3.0bpw

Text Generation • Updated 10 days ago • 43 • 2

Dracones/Qwen2.5-72B-Instruct_exl2_3.0bpw

Text Generation • Updated 22 days ago • 24 • 1

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated 21 days ago • 696k • 3

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • Updated 20 days ago • 402 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • Updated 20 days ago • 479 • 2

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated 18 days ago • 328 • 1

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • Updated 18 days ago • 168 • 1

mlx-community/Llama-3.3-70B-Instruct-3bit

Text Generation • Updated 18 days ago • 424 • 4

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated 17 days ago • 1.54M • 8

MaziyarPanahi/Pleias-Nano-GGUF

Text Generation • Updated 17 days ago • 339 • 3

MaziyarPanahi/EXAONE-3.5-2.4B-Instruct-GGUF

Text Generation • Updated 15 days ago • 335 • 1