Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,541

Full-text search

Active filters: 5-bit

MaziyarPanahi/uncertain_llama3_8b-GGUF

Text Generation • Updated Nov 1 • 79 • 1

MaziyarPanahi/Llama-3.2-3B-bf16-GGUF

Text Generation • Updated Nov 2 • 167 • 1

MaziyarPanahi/EZO-Llama-3.2-3B-Instruct-dpoE-GGUF

Text Generation • Updated Nov 2 • 54 • 1

MaziyarPanahi/Llama-3-8B-Stroganoff-4.0-GGUF

Text Generation • Updated Nov 2 • 138 • 1

MaziyarPanahi/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

Text Generation • Updated Nov 2 • 154 • 1

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 3 • 658 • 1

MaziyarPanahi/SmolLM2-360M-Instruct-GGUF

Text Generation • Updated Nov 3 • 189 • 2

async0x42/EVA-Qwen2.5-32B-v0.2-exl2_5.0bpw

Text Generation • Updated Nov 6 • 38 • 1

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • Updated Nov 6 • 6.38k • 1

MaziyarPanahi/Mistral-Crab-DPO-GGUF

Text Generation • Updated Nov 7 • 53 • 2

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • Updated Nov 7 • 117 • 1

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 513 • 1

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated Nov 15 • 390 • 2

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • Updated Nov 15 • 768 • 1

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated Nov 15 • 118 • 1

async0x42/Qwen2.5-Coder-0.5B-Instruct-exl2_5.0bpw

Text Generation • Updated Nov 12 • 23 • 1

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15 • 243 • 7

async0x42/Qwen2.5-Gutenberg-Doppel-32B-exl2_5.0bpw

Text Generation • Updated Nov 18 • 19 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20 • 675k • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-5.0bpw-h6-exl2

Updated Nov 19 • 19 • 1

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_5.0bpw_h6

Updated 30 days ago • 127 • 2

MikeRoz/TheDrummer_Behemoth-123B-v2.1-5.0bpw-h6-exl2

Updated 29 days ago • 525 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.2-5.0bpw-h6-exl2

Updated 22 days ago • 174 • 3

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated 21 days ago • 696k • 3

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • Updated 20 days ago • 402 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • Updated 20 days ago • 479 • 2

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_5.0bpw_h6

Text Generation • Updated 15 days ago • 190 • 1

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated 18 days ago • 328 • 1

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • Updated 18 days ago • 168 • 1

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated 17 days ago • 1.54M • 8