Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

219

Full-text search

Active filters: vllm

ZeroXClem/L3-Aspire-Heart-Matrix-8B-Q4_0-GGUF

Text Generation • Updated Nov 21 • 10

mradermacher/L3.1-Aspire-Heart-Matrix-8B-GGUF

Updated 10 days ago • 86 • 1

mradermacher/L3.1-Aspire-Heart-Matrix-8B-i1-GGUF

Updated 10 days ago • 202 • 1

neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4

Text Generation • Updated Nov 21 • 119

neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16

Text Generation • Updated 6 days ago • 41

neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16

Text Generation • Updated 6 days ago • 45

Supa-AI/Ministral-8B-Instruct-2410-gguf

Updated Nov 22 • 420

mradermacher/L3-Aspire-Heart-Matrix-8B-GGUF

Updated Nov 22 • 18

mradermacher/L3-Aspire-Heart-Matrix-8B-i1-GGUF

Updated Nov 22 • 34

DBMe/Mistral-Large-Instruct-2411-2.86bpw-h6-exl2

Updated Nov 23 • 17

gallantpigeon/mistral-large-instruct-2411-w8a16

Updated Nov 23 • 32

gallantpigeon/mistral-large-instruct-2411-int8-w8a8

Updated Nov 23 • 221

JackCloudman/Mistral-Large-Instruct-2411

Updated Nov 24 • 172

tensorblock/Sparse-Llama-3.1-8B-2of4-GGUF

Text Generation • Updated 23 days ago • 225

dangvansam/gemma-2-27b-it-FP8-fix-system-role

Text Generation • Updated 22 days ago • 176

dangvansam/gemma-2-2b-it-fix-system-role

Text Generation • Updated 18 days ago • 19

dangvansam/gemma-2-9b-it-fix-system-role

Text Generation • Updated 18 days ago • 15

yejingfu/nmagic-Meta-Llama-3-8B-Instruct-FP8

Updated 21 days ago • 42

neuralmagic-ent/Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 15 days ago • 20

neuralmagic-ent/Llama-3.1-8B-quantized.w8a8

Text Generation • Updated 15 days ago • 5

neuralmagic-ent/Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 15 days ago • 4

neuralmagic-ent/Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation • Updated 15 days ago • 665

neuralmagic-ent/Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated 15 days ago • 7

neuralmagic-ent/Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated 15 days ago • 11

neuralmagic-ent/Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated 15 days ago • 51

neuralmagic-ent/Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated 15 days ago • 17

neuralmagic-ent/Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated 15 days ago • 14

neuralmagic-ent/Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • Updated 15 days ago • 22

neuralmagic-ent/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • Updated 15 days ago • 11

neuralmagic-ent/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated 15 days ago • 14