Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,183

Full-text search

Active filters: exl2

Orion-zhen/athene-70b-4.5bpw-exl2

Text Generation • Updated Aug 9 • 9

DeusImperator/magnum-32b-v2_exl2_4.7bpw_rpcal_mk2

Text Generation • Updated Aug 27 • 7

Alias1964/Llama-3.1-70B-Instruct-lorablated-Q4-EXL2

Text Generation • Updated Aug 8 • 11 • 1

Statuo/Theia-21b-EXL2-6bpw

Updated Aug 10 • 5

Statuo/Theia-21b-EXL2-4bpw

Updated Aug 10 • 7

FuturisticVibes/dolphin-2.9.3-mistral-nemo-12b-8.0bpw-h8-exl2

Updated Aug 23 • 2

Statuo/Theia-21b-EXL2-8bpw

Updated Aug 10 • 3

FuturisticVibes/Theia-21B-v1-8.0bpw-h8-exl2

Updated Aug 23 • 5

FuturisticVibes/dolphin-2.9.4-llama3.1-8b-8.0bpw-h8-exl2

Updated Aug 23 • 4

Slvcxc/Hathor_Colt_Tahsin-L3-8B-v0.945-8.0bpw-h8-exl2

Updated Aug 10 • 5

blockblockblock/Hathor_Tahsin-L3-8B-v0.9-bpw6-exl2

Updated Aug 10 • 3

SicariusSicariiStuff/2B_or_not_2B-EXL2-8.0bpw

Updated Aug 11 • 3

SicariusSicariiStuff/2B_or_not_2B-EXL2-7.5bpw

Updated Aug 11 • 3

SicariusSicariiStuff/2B_or_not_2B-EXL2-7.0bpw

Updated Aug 11 • 3

SicariusSicariiStuff/2B_or_not_2B-EXL2-6.5bpw

Updated Aug 11 • 3

SicariusSicariiStuff/2B_or_not_2B-EXL2-6.0bpw

Updated Aug 11 • 3

SicariusSicariiStuff/2B_or_not_2B-EXL2-5.0bpw

Updated Aug 11 • 7

SicariusSicariiStuff/2B_or_not_2B-EXL2-4.0bpw

Updated Aug 11 • 3

SicariusSicariiStuff/2B_or_not_2B-EXL2-3.0bpw

Updated Aug 11 • 3

zelias/BgGPT-7B-Instruct-v0.2_exl2_8bpw

Text Generation • Updated Aug 11 • 8

zelias/BgGPT-7B-Instruct-v0.2_exl2_6bpw

Text Generation • Updated Aug 11 • 5

DBMe/magnum-72b-v1_exl2_4.8bpw

Text Generation • Updated Oct 21 • 7

ek826/Meta-Llama-3.1-405B-Instruct-4.5bpw-gqa-exl2

Text Generation • Updated Aug 11 • 5

denru/Tess-3-Mistral-Large-2-123B-4_5bpw-h6-exl2-pippa

Updated Aug 13 • 11

blockblockblock/Cathallama-70B-bpw4.4-exl2

Text Generation • Updated Aug 13 • 4

Orion-zhen/RYS-XLarge-4.2bpw-exl2

Updated Aug 13 • 3

Edens-Gate/Ohashi-9B-V1-EXl2-6.0BPW

TeeZee/2xbagel-dpo-34b-v0.2-bpw2.8-h6-exl2

Updated Aug 14 • 4

KnutJaegersberg/LongWriter-8b-exl-8.0bpw

Text Generation • Updated Aug 14 • 4 • 1

MikeRoz/sophosympatheia_New-Dawn-Llama-3.1-70B-v1.1-8.0bpw-h8-exl2

Text Generation • Updated Aug 14 • 4 • 1