Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Inference Endpoints

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,749

Full-text search

Active filters: 6-bit

TheBlueObserver/gemma-2-2b-it-MLX-8777b

Text Generation • Updated 21 days ago • 8

FrenzyBiscuit/Anubis-70B-v1-6.0bpw-h8-exl2

Updated 21 days ago • 73

Jellon/Qwen2.5-14b-Kunou-v1-exl2-6bpw-h8

Text Generation • Updated 20 days ago • 14

TheBlueObserver/Falcon3-7B-Instruct-MLX-8777b

Text Generation • Updated 20 days ago • 18

TheBlueObserver/gemma-2-27b-it-MLX-8777b

Text Generation • Updated 20 days ago • 14

TheBlueObserver/Llama-3.2-3B-Instruct-MLX-8777b

Text Generation • Updated 20 days ago • 10

MaziyarPanahi/Lumimaid-Magnum-v4-12B-GGUF

Text Generation • Updated 19 days ago • 189

MaziyarPanahi/Dans-PersonalityEngine-V1.1.0-12b-GGUF

Text Generation • Updated 19 days ago • 158

TheBlueObserver/Qwen2.5-Coder-32B-Instruct-MLX-8777b

Text Generation • Updated 19 days ago • 11

MaziyarPanahi/MISCHIEVOUS-12B-Mix_0.4v-GGUF

Text Generation • Updated 19 days ago • 149

MaziyarPanahi/MN-Chinofun-12B-3-GGUF

Text Generation • Updated 19 days ago • 153 • 1

MaziyarPanahi/relay-v0.1-Mistral-Nemo-2407-GGUF

Text Generation • Updated 19 days ago • 158

Statuo/Aletheia-14b-EXL2-6bpw

Text Generation • Updated 19 days ago • 14

Dracones/Anubis-70B-v1_exl2_6.0bpw

Text Generation • Updated 18 days ago • 26

cnfusion/Microsoft_Phi-4-mlx-6bit

Text Generation • Updated 18 days ago • 17

Dracones/QVQ-72B-Preview_exl2_6.0bpw

Image-Text-to-Text • Updated 17 days ago • 17

bullerwins/QVQ-72B-Preview-exl2_6.0bpw

Image-Text-to-Text • Updated 17 days ago • 4

Jellon/Tissint-14B-v1.2-128k-RP-exl2-6bpw-h8

Text Generation • Updated 16 days ago • 18

mlx-community/Phi-3.5-mini-instruct-6bit

Updated 16 days ago • 9

MaziyarPanahi/DarkCamelot_2-GGUF

Text Generation • Updated 16 days ago • 148

MaziyarPanahi/Mistral-Nemo-VICIOUS_MESH-12B-2407-GGUF

Text Generation • Updated 16 days ago • 142

MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF

Text Generation • Updated 16 days ago • 131

MaziyarPanahi/VICIOUS_MESH-12B-BETA-GGUF

Text Generation • Updated 16 days ago • 136

MaziyarPanahi/Captain_BMO-0.420-Magnum-12B-GGUF

Text Generation • Updated 16 days ago • 121

MaziyarPanahi/Captain-Eris_Twighlight-V0.420-12B-GGUF

Text Generation • Updated 14 days ago • 130

MaziyarPanahi/Kosmos-EVAA-Fusion-light-8B-GGUF

Text Generation • Updated 14 days ago • 125

MaziyarPanahi/Kosmos-EVAA-v9-8B-GGUF

Text Generation • Updated 14 days ago • 131

MaziyarPanahi/Kosmos-Elusive-VENN-Aurora_faustus-8B-GGUF

Text Generation • Updated 14 days ago • 115

MaziyarPanahi/Kosmos-VENN-8B-GGUF

Text Generation • Updated 14 days ago • 160

MaziyarPanahi/stackexchange_movies-GGUF

Text Generation • Updated 14 days ago • 121