Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,182

Full-text search

Active filters: exl2

Statuo/Mistral-Nemo-Instruct-2407-EXL2-8bpw

Text Generation • Updated Aug 1 • 16

Statuo/Mistral-Nemo-Instruct-2407-EXL2-6bpw

Text Generation • Updated Aug 1 • 12

Statuo/Mistral-Nemo-Instruct-2407-EXL2-4bpw

Text Generation • Updated Aug 1 • 17

Annuvin/gemma-2-2b-it-abliterated-6.5bpw-h8-exl2

Text Generation • Updated Aug 1 • 6

Annuvin/gemma-2-2b-it-abliterated-4.0bpw-exl2

Text Generation • Updated Aug 1 • 16 • 1

DeusImperator/Nemomix-v4.0-12B_exl2_8bpw_max

Text Generation • Updated Aug 1 • 8

DBMe/Tess-v2.5.2-Qwen2-72B-4.8bpw-h6-exl2-pippa

Updated Oct 21 • 6

grimjim/Mistral-Nemo-Base-2407-12B-6.4bpw-exl2

Text Generation • Updated Aug 25 • 3

dmanary-pronavigator/gemma-2-27b-it-exl2-6.0bpw

Text Generation • Updated Jul 7 • 5

dmanary-pronavigator/gemma-2-27b-it-exl2-5.0bpw

Text Generation • Updated Jul 7 • 5

dmanary-pronavigator/gemma-2-27b-it-exl2-4.5bpw

Text Generation • Updated Jul 7 • 9

ek826/Meta-Llama-3.1-405B-Instruct-6.0bpw-exl2

Text Generation • Updated Aug 4 • 21 • 2

Statuo/MN-Lyra-12b-EXL2-8bpw

Updated Aug 4 • 3

Statuo/MN-Lyra-12b-EXL2-6bpw

Updated Aug 4 • 3

Statuo/MN-Lyra-12b-EXL2-4bpw

Updated Aug 4 • 3

dmanary-pronavigator/gemma-2-27b-it-exl2-4.0bpw

Text Generation • Updated Jul 7 • 12

Orion-zhen/Y1.5-MS-Mysteria-34b-4.0bpw-exl2

Text Generation • Updated Aug 5 • 5

Orion-zhen/Y1.5-MS-Mysteria-34b-6.5bpw-exl2

Text Generation • Updated Aug 5 • 5

Slvcxc/Sekhmet_Gimmel-L3.1-8B-v0.3-8.0bpw-h8-exl2

Updated Aug 5 • 4

blockblockblock/internlm2_5-20b-chat-bpw4-exl2

Text Generation • Updated Aug 5 • 2 • 1

blockblockblock/LLaMA-33B-HF-bpw4-exl2

Text Generation • Updated Aug 5 • 10

blockblockblock/llama-13b-bpw6-exl2

Updated Aug 6 • 3

DeusImperator/MN-12B-Lyra-v1_exl2_8bpw_max

Updated Aug 6 • 3

Kotokin/internlm_internlm2_5-20b-chat-exl2-8bpw

Text Generation • Updated Aug 6 • 7

DeusImperator/magnum-32b-v2_exl2_4.7bpw

Text Generation • Updated Aug 27 • 8

TeeZee/2xbagel-34b-v0.2-bpw3.0-h6-exl2

Text Generation • Updated Aug 7 • 9

Annuvin/EXAONE-3.0-7.8B-Instruct-Llamafied-6.5bpw-h8-exl2

Updated Aug 8 • 3 • 2

TeeZee/2xbagel-34b-v0.2-bpw2.8-h6-exl2

Text Generation • Updated Aug 7 • 7

JackCloudman/RYS-XLarge-6.0bpw-h6-exl2

Updated Aug 16 • 4

TeeZee/2xbagel-34b-v0.2-bpw2.9-h6-exl2

Text Generation • Updated Aug 8 • 7