Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

4

Full-text search

Active filters: vLLM

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • Updated Jul 23 • 203 • 2

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • Updated Jul 17 • 48 • 6

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • Updated Nov 4 • 76

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • Updated Nov 4 • 70