Edit Models filters

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,955

Full-text search

Active filters: 6-bit

MaziyarPanahi/Phi-4-QwQ-GGUF

Text Generation • Updated 11 days ago • 390

SicariusSicariiStuff/Wingless_Imp_8B-6.0bpw

Updated 11 days ago • 3

MaziyarPanahi/Llama-8B-Distill-CoT-GGUF

Text Generation • Updated 11 days ago • 241

MaziyarPanahi/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 11 days ago • 360

MaziyarPanahi/xLAM-7b-fc-r-GGUF

Text Generation • Updated 11 days ago • 179

MaziyarPanahi/xLAM-1b-fc-r-GGUF

Text Generation • Updated 11 days ago • 150

ReadyArt/EVA-Qwen2.5-14B-v0.2_EXL2_6.0bpw_H8

Text Generation • Updated 11 days ago • 3

mlx-community/Evathene-v1.3-MLX-6Bit

Text Generation • Updated 10 days ago • 7

gghfez/DeepSeek-R1-Distill-Llama-70B-exl2-6bpw

Text Generation • Updated 10 days ago • 7

ReadyArt/EVA-Qwen2.5-1.5B-v0.0_EXL2_6.0bpw_H8

Text Generation • Updated 10 days ago

riveRiPH/Wayfarer_Eris_Noctis-12B-6bpw-h8-exl2

Text Generation • Updated 10 days ago • 15

sleepdeprived3/UnslopNemo-12B-v3_6bpw_H8

Text Generation • Updated 9 days ago • 5

mlx-community/Nova-Tempus-70B-v0.1-MLX-6Bit

Text Generation • Updated 9 days ago • 5

ReadyArt/Beeper-King-22B_EXL2_6bpw_H8

Updated 9 days ago • 3

ReadyArt/Mistral-Small-Instruct-2409_EXL2_6.0bpw_H8

Updated 9 days ago • 6

sleepdeprived3/Qwen2.5-14B-Instruct-1M_EXL2_6bpw_H8

Text Generation • Updated 8 days ago • 5

roleplaiapp/Llama-3.2-3B-Instruct-uncensored-Q6_K-GGUF

Text Generation • Updated 8 days ago • 38

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q6_K-GGUF

Text Generation • Updated 8 days ago • 30

SicariusSicariiStuff/Impish_QWEN_14B-1M-6.0bpw

Updated 8 days ago • 5

djphoenix/Qwen2.5-Coder-14B-Instruct-Q6-mlx

Text Generation • Updated 8 days ago • 15

beezu/Nova-Tempus-70B-v0.2-MLX-6Bit

Text Generation • Updated 1 day ago • 6

roleplaiapp/MN-12B-Mag-Mell-R1-Q6_K-GGUF

Text Generation • Updated 8 days ago • 7

beezu/Anubis-70B-v1-MLX-6Bit

Updated 8 days ago • 1

ReadyArt/Wayfarer-12B_EXL2_6.0bpw_H8

Text Generation • Updated 8 days ago • 5

ReadyArt/Chuluun-Qwen2.5-32B-v0.01_EXL2_6.0bpw_H8

Text Generation • Updated 8 days ago • 4

roleplaiapp/Midnight-Miqu-70B-v1.5-i1-Q6_K-GGUF

Text Generation • Updated 7 days ago

isv2lf/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-Q6-mlx

Text Generation • Updated 7 days ago • 46

isv2lf/DeepSeek-R1-Distill-Qwen-14B-Uncensored-Q6-mlx

Updated 7 days ago

sleepdeprived3/Beepo-22B_EXL2_6bpw_H8

Updated 7 days ago

Darkhn/Nova-Tempus-v0.2-6.0bpw-h8-exl2

Text Generation • Updated 7 days ago • 2