Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,982

Full-text search

Active filters: 6-bit

cnfusion/Sky-T1-32B-Preview-Q6-mlx

Text Generation • Updated 26 days ago • 25

MikeRoz/sophosympatheia_Nova-Tempus-70B-v0.1-6.0bpw-h6-exl2

Text Generation • Updated 25 days ago • 24

XelotX/WizardLM-2-8x22B-GGUF

Text Generation • Updated 24 days ago • 59

Annuvin/Wayfarer-12B-6.0bpw-exl2

Updated 24 days ago • 30

MikeRoz/Doctor-Shotgun_L3.3-70B-Magnum-v4-SE-6.0bpw-h6-exl2

Text Generation • Updated 23 days ago • 12

Statuo/LatitudeGames_Wayfarer-12B-EXL2-6bpw

Updated 24 days ago • 9

Jellon/Wayfarer-12B-exl2-6bpw

Updated 23 days ago • 19

MikeRoz/Sao10K_70B-L3.3-Cirrus-x1-6.0bpw-h6-exl2

Text Generation • Updated 23 days ago • 10

Minthy/ToriiGate-v0.4-7B-exl2-6bpw

Updated 22 days ago • 7

roleplaiapp/internlm3-8b-instruct-Q6_K-GGUF

Text Generation • Updated 22 days ago • 11

roleplaiapp/ReaderLM-v2-Q6_K-GGUF

Text Generation • Updated 22 days ago • 24

roleplaiapp/Dria-Agent-a-3B-Q6_K-GGUF

Text Generation • Updated 22 days ago • 7

roleplaiapp/Dria-Agent-a-7B-Q6_K-GGUF

Text Generation • Updated 22 days ago • 3

Statuo/Allura-Qwen2.5-32b-RP-Ink-EXL2-6bpw

Updated 22 days ago • 10

MikeRoz/DatToad_Chuluun-Qwen2.5-72B-v0.08-6.0bpw-h6-exl2

Text Generation • Updated 21 days ago • 3

Statuo/Allura-MN-12b-RP-Ink-EXL2-6bpw

Updated 21 days ago • 11

roleplaiapp/Wayfarer-12B-Q6_K-GGUF

Text Generation • Updated 21 days ago • 10

roleplaiapp/AceInstruct-72B-Q6_K-GGUF

Text Generation • Updated 21 days ago • 46

roleplaiapp/Codestral-22B-v0.1-Q6_K-GGUF

Text Generation • Updated 21 days ago • 99

roleplaiapp/AceInstruct-1.5B-Q6_K-GGUF

Text Generation • Updated 21 days ago • 49

roleplaiapp/AceInstruct-7B-Q6_K-GGUF

Text Generation • Updated 21 days ago • 25

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF

Text Generation • Updated 21 days ago • 49

mlx-community/DeepSeek-R1-Distill-Qwen-1.5B-6bit

Updated 20 days ago • 9.09k

zhitels/DeepSeek-R1-Distill-Llama-70B-6bit

Updated 20 days ago • 47

mlx-community/DeepSeek-R1-Distill-Llama-8B-6bit

Updated 20 days ago • 3.26k

adamo1139/DeepSeek-R1-Distill-Qwen-1.5B-6bpw-exl2

Updated 20 days ago • 8

zhitels/DeepSeek-R1-Distill-Qwen-32B-6bit

Text Generation • Updated 20 days ago • 222

SicariusSicariiStuff/Eximius_Persona_5B-6.0bpw

Updated 19 days ago • 4

sleepdeprived3/Sto-vo-kor-12B_EXL2_6bpw_H8

Updated 17 days ago • 4

Darkhn/L3.3-MS-Nevoria-V0.1-6.0bpw-h8-exl2

Text Generation • Updated 18 days ago • 7