Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,183

Full-text search

Active filters: exl2

lucyknada/NeverSleep_Lumimaid-v0.2-8B-exl2-6.0bpw

Text Generation • Updated Jul 26 • 6

lucyknada/NeverSleep_Lumimaid-v0.2-12B-exl2-4.0bpw

Text Generation • Updated Jul 26 • 13 • 1

bluuwhale/Lumimaid-v0.2-12B-8.0bpw-h8-exl2-rpcal

Text Generation • Updated Jul 26 • 15

Statuo/Atlantis-v0.1-EXL2-8bpw

Text Generation • Updated Jul 27 • 12 • 1

Statuo/Atlantis-v0.1-EXL2-4bpw

Text Generation • Updated Jul 27 • 8

ek826/Meta-Llama-3.1-405B-Instruct-4.0bpw-exl2

Text Generation • Updated Jul 27 • 8 • 3

Statuo/Lumimaidv0.2-12b-EXL2-8bpw

Text Generation • Updated Jul 27 • 11

Statuo/Lumimaidv0.2-12b-EXL2-6bpw

Text Generation • Updated Jul 27 • 6

lucyknada/NeverSleep_Lumimaid-v0.2-70B-exl2-5.0bpw

Text Generation • Updated Jul 27 • 5

DBMe/Tess-v2.5.2-Qwen2-72B-5.0bpw-h6-exl2-pippa

Text Generation • Updated Oct 21 • 16

bluuwhale/Lumimaid-v0.2-8B-8.0bpw-h8-exl2-rpcal

Text Generation • Updated Jul 27 • 11 • 1

Annuvin/Lumimaid-v0.2-12B-5.0bpw-exl2

Text Generation • Updated Jul 27 • 12 • 1

altomek/Lumimaid-v0.2-12B-8bpw-EXL2

Text Generation • Updated Aug 30 • 13

altomek/dolphin-2.9.3-mistral-nemo-12b-8bpw-EXL2

Text Generation • Updated Aug 30 • 9

DBMe/Tess-v2.5.2-Qwen2-72B-4.65bpw-h6-exl2-pippa

Text Generation • Updated Oct 21 • 8

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-exl2

Text Generation • Updated Aug 3 • 10

MikeRoz/NeverSleep_Lumimaid-v0.2-123B-5.0bpw-h8-exl2

Text Generation • Updated Jul 27 • 11

cgus/gemma-2-9b-it-abliterated-exl2

Text Generation • Updated Jul 28 • 19 • 1

MikeRoz/NeverSleep_Lumimaid-v0.2-123B-3.0bpw-h8-exl2

Text Generation • Updated Jul 28 • 4

bullerwins/Mistral-Large-Instruct-2407-exl2_5.5bpw

Text Generation • Updated Jul 27 • 9

AuriAetherwiing/L3.1-8B-Celeste-V1.5-exl2-h8-8.0bpw

Text Generation • Updated Jul 28 • 5 • 1

bullerwins/L3.1-8B-Celeste-V1.5-exl2_4.0bpw

Text Generation • Updated Jul 28 • 4

bullerwins/L3.1-8B-Celeste-V1.5-exl2_5.0bpw

Text Generation • Updated Jul 28 • 5

bullerwins/L3.1-8B-Celeste-V1.5-exl2_6.0bpw

Text Generation • Updated Jul 28 • 5

bullerwins/L3.1-8B-Celeste-V1.5-exl2_8.0bpw

Text Generation • Updated Jul 28 • 11 • 2

AuriAetherwiing/L3.1-8B-Celeste-V1.5-exl2-h6-6.0bpw

Text Generation • Updated Jul 28 • 4

AuriAetherwiing/L3.1-8B-Celeste-V1.5-exl2-h6-5.0bpw

Text Generation • Updated Jul 28 • 5

AuriAetherwiing/L3.1-8B-Celeste-V1.5-exl2-h6-4.5bpw

Text Generation • Updated Jul 28 • 5

MikeRoz/NeverSleep_Lumimaid-v0.2-123B-2.75bpw-h6-exl2

Text Generation • Updated Jul 28 • 4

AuriAetherwiing/L3.1-8B-Celeste-V1.5-exl2-h6-4.0bpw

Text Generation • Updated Jul 28 • 4 • 1