Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

214

Full-text search

Active filters: vllm

bartowski/Mistral-Large-Instruct-2411-exl2

Text Generation • Updated Nov 19, 2024 • 76 • 3

MikeRoz/mistralai_Mistral-Large-Instruct-2411-2.5bpw-h6-exl2

Updated Nov 19, 2024 • 8 • 2

MikeRoz/mistralai_Mistral-Large-Instruct-2411-5.0bpw-h6-exl2

Updated Nov 19, 2024 • 4 • 1

TechxGenus/Mistral-Large-Instruct-2411-AWQ

Updated Nov 19, 2024 • 1.54k • 5

MikeRoz/mistralai_Mistral-Large-Instruct-2411-8.0bpw-h8-exl2

Updated Nov 19, 2024 • 3

bullerwins/Mistral-Large-Instruct-2411-exl2_4.0bpw

Updated Nov 20, 2024 • 5

bullerwins/Mistral-Large-Instruct-2411-exl2_4.5bpw

Updated Nov 20, 2024 • 3

bullerwins/Mistral-Large-Instruct-2411-exl2_5.0bpw

Updated Nov 20, 2024 • 4

tokoin/Ministral-8B-Instruct-2410-IQ4_NL-GGUF

Updated Nov 19, 2024 • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-6.0bpw-h6-exl2

Updated Nov 20, 2024 • 3

BigHuggyD/Mistral-Large-Instruct-2411_exl2_4.0bpw_h6

Updated Nov 19, 2024 • 7

wolfram/Mistral-Large-Instruct-2411-2.75bpw-h6-exl2

Updated Nov 20, 2024 • 12 • 2

BigHuggyD/Mistral-Large-Instruct-2411_exl2_5.0bpw_h6

Updated Nov 20, 2024 • 6

MikeRoz/mistralai_Mistral-Large-Instruct-2411-3.5bpw-h6-exl2

Updated Nov 20, 2024 • 7

TechxGenus/Mistral-Large-Instruct-2411-GPTQ

Updated Nov 20, 2024 • 193 • 2

BigHuggyD/Mistral-Large-Instruct-2411_exl2_6.0bpw_h6

Updated Nov 20, 2024 • 8

MikeRoz/mistralai_Mistral-Large-Instruct-2411-2.25bpw-h6-exl2

Updated Nov 20, 2024 • 5

bullerwins/Mistral-Large-Instruct-2411-exl2_3.0bpw

Updated Nov 20, 2024 • 4

bullerwins/Mistral-Large-Instruct-2411-exl2_3.5bpw

Updated Nov 20, 2024 • 3

bullerwins/Mistral-Large-Instruct-2411-exl2_6.0bpw

Updated Nov 20, 2024 • 8

bullerwins/Mistral-Large-Instruct-2411-exl2_8.0bpw

Updated Nov 20, 2024 • 4

bullerwins/Mistral-Large-Instruct-2411-exl2_5.5bpw

Updated Nov 20, 2024 • 4

tokoin/Ministral-8B-Instruct-2410-Q4_0-GGUF

Updated Nov 20, 2024 • 11

BigHuggyD/Mistral-Large-Instruct-2411_exl2_7.0bpw_h8

Updated Nov 20, 2024 • 3

BigHuggyD/Mistral-Large-Instruct-2411_exl2_8.0bpw_h8

Updated Nov 20, 2024 • 11

ZeroXClem/L3-Aspire-Heart-Matrix-8B

Text Generation • Updated Nov 24, 2024 • 39 • 3

ZeroXClem/L3-Aspire-Heart-Matrix-8B-Q8_0-GGUF

Text Generation • Updated Nov 21, 2024 • 1

ZeroXClem/L3-Aspire-Heart-Matrix-8B-Q6_K-GGUF

Text Generation • Updated Nov 21, 2024 • 13

ZeroXClem/L3-Aspire-Heart-Matrix-8B-Q5_K_M-GGUF

Text Generation • Updated Nov 21, 2024 • 6

ZeroXClem/L3-Aspire-Heart-Matrix-8B-Q5_0-GGUF

Text Generation • Updated Nov 21, 2024 • 5 • 1