Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

982

Full-text search

Active filters: compressed-tensors

evajagodic/Meta-Llama-3-8B-Instruct2of4-W8A8-FP8-Dynamic-Per-Token

Text Generation • Updated Feb 10 • 11

evajagodic/Meta-Llama-3-8B-Instruct2of4-sparse

Text Generation • Updated Feb 10 • 10

ICSFR-HF-ORG-01/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic

Updated Feb 10 • 3

nm-testing/Meta-Llama-3-8B-FP8-AttnQuant

Updated Feb 11 • 10

nm-testing/Meta-Llama-3-8B-FP8-AttnQuant-WeightQuant

Updated Feb 11 • 20

nm-testing/Meta-Llama-3-8B-Instruct-AttnQuantOnly

Updated Feb 11 • 17

nm-testing/Qwen2.5-0.5B-sparse2of4_fp8_dynamic-e2e

Updated 5 days ago • 21

darthhexx/Qwen2.5-VL-3B-Instruct-FP8-Dynamic

Image-Text-to-Text • Updated Feb 11 • 18

nm-testing/llama2.c-stories42M-gsm8k-quantized-only-compressed

Updated Feb 12 • 19

nm-testing/llama2.c-stories42M-gsm8k-quantized-only-uncompressed

Updated Feb 12 • 12

nm-testing/llama2.c-stories42M-gsm8k-sparse-only-compressed

Updated Feb 12 • 20

nm-testing/llama2.c-stories42M-gsm8k-sparse-only-uncompressed

Updated Feb 12 • 261

nm-testing/llama2.c-stories42M-gsm8k-stacked-compressed

Updated Feb 12 • 16

nm-testing/llama2.c-stories42M-gsm8k-stacked-uncompressed

Updated Feb 12 • 13

EliasOenal/Llama-3.1-Nemotron-70B-Instruct-W8A8-dynamic

Text Generation • Updated Feb 12 • 9

SicariusSicariiStuff/Phi-lthy4_FP8

Updated Feb 12 • 7

neuralmagic/Llama-3.2-11B-Vision-Instruct-quantized.w4a16

Image-Text-to-Text • Updated about 1 month ago • 543

ExceedZhang/DeepSeek-R1-Distill-Qwen-32B-W4A16-G128

Updated 29 days ago • 44

nm-testing/whisper-large-v2.w4a16

Updated 29 days ago • 9

alpindale/Magnum-v2-12B-W8A8-INT8

Updated 28 days ago • 166

Arkhiveus/DeepHermes-3-Llama-3-8B-Preview-W8A8-int8

Updated 28 days ago • 24

brokenlander/AlphaBuffett-FP8-Dynamic

Text Generation • Updated 28 days ago • 4

cortecs/Qwen2.5-7B-Instruct-1M-FP8-Dynamic

Updated 19 days ago • 292

Ollsoft-ai/olingo_structured_v1_full-FP8-Dynamic

Text Generation • Updated 26 days ago • 197

nm-testing/Meta-Llama-3-8B-Instruct-FP8-Dynamic-refac

Updated 26 days ago • 29

nm-testing/Meta-Llama-3-8B-Instruct-FP8-Dynamic

Updated 26 days ago • 46

nm-testing/Meta-Llama-3-8B-Instruct-W4A16-G128-refac

Updated 26 days ago • 8

nm-testing/Meta-Llama-3-8B-Instruct-W4A16-G128

Updated 26 days ago • 11

SicariusSicariiStuff/Phi-Line_14B_FP8

Updated 26 days ago • 9

starsy/Mistral-Small-24B-Instruct-2501-FP8-Dynamic

Text Generation • Updated 26 days ago • 214