Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,040

Full-text search

Active filters: 3-bit

roleplaiapp/Codestral-22B-v0.1-Q3_K_M-GGUF

Text Generation • Updated 7 days ago • 19

roleplaiapp/Codestral-22B-v0.1-Q3_K_L-GGUF

Text Generation • Updated 7 days ago • 13

roleplaiapp/AceInstruct-7B-Q3_K_S-GGUF

Text Generation • Updated 7 days ago • 18

roleplaiapp/AceInstruct-7B-Q3_K_M-GGUF

Text Generation • Updated 7 days ago • 22

roleplaiapp/AceInstruct-1.5B-Q3_K_S-GGUF

Text Generation • Updated 7 days ago • 18

roleplaiapp/AceInstruct-1.5B-Q3_K_M-GGUF

Text Generation • Updated 7 days ago • 21

roleplaiapp/AceInstruct-1.5B-Q3_K_L-GGUF

Text Generation • Updated 7 days ago • 21

roleplaiapp/AceInstruct-7B-Q3_K_L-GGUF

Text Generation • Updated 7 days ago • 23

mlx-community/DeepSeek-R1-Distill-Qwen-1.5B-3bit

Updated 6 days ago • 1.37k

mlx-community/DeepSeek-R1-Distill-Qwen-7B-3bit

Updated 6 days ago • 2.04k

mlx-community/DeepSeek-R1-Distill-Llama-8B-3bit

Updated 6 days ago • 2.61k

adamo1139/DeepSeek-R1-Distill-Qwen-1.5B-3bpw-exl2

Updated 6 days ago • 3

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • Updated 6 days ago • 3.18k

ubaitur5/DeepSeek-R1-Distill-Qwen-14B-Q3-mlx

Text Generation • Updated 5 days ago • 24

ubaitur5/Qwen2.5-32B-Instruct-Q3-mlx

Text Generation • Updated 5 days ago • 9

mlx-community/DeepSeek-V2.5-1210-3bit-32

Text Generation • Updated 4 days ago • 13

MaziyarPanahi/SuperThoughts-CoT-14B-16k-o1-QwQ-GGUF

Text Generation • Updated 3 days ago • 103

MaziyarPanahi/Phi-4-Empathetic-GGUF

Text Generation • Updated 3 days ago • 106

MaziyarPanahi/Phi-4-QwQ-GGUF

Text Generation • Updated 3 days ago • 339

MaziyarPanahi/Llama-8B-Distill-CoT-GGUF

Text Generation • Updated 2 days ago • 114

MaziyarPanahi/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 2 days ago • 96

MaziyarPanahi/xLAM-7b-fc-r-GGUF

Text Generation • Updated 2 days ago • 98

MaziyarPanahi/xLAM-1b-fc-r-GGUF

Text Generation • Updated 2 days ago • 79

sleepdeprived3/UnslopNemo-12B-v3_3bpw_H8

Text Generation • Updated about 4 hours ago

mlx-community/Evathene-v1.3-MLX-3Bit

Text Generation • Updated 2 days ago • 4

ReadyArt/creative-writer-32b-preview-01-2025_EXL2_3.0bpw_H8

Text Generation • Updated 1 day ago

mlx-community/Nova-Tempus-70B-v0.1-MLX-3Bit

Text Generation • Updated about 14 hours ago

mlx-community/Qwen2.5-7B-Instruct-1M-3bit

Text Generation • Updated about 7 hours ago

ReadyArt/Chuluun-Qwen2.5-32B-v0.01_EXL2_3.0bpw_H8

Text Generation • Updated about 6 hours ago

mlx-community/Qwen2.5-14B-Instruct-1M-3bit

Text Generation • Updated about 6 hours ago