Edit Models filters

Inference status

Misc

quantized model

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

3

Full-text search

Active filters: quantized model

Anthonyg5005/WizardLM-13B-V1.2-int8-ct2

Text Generation • Updated Feb 27 • 9 • 1

Anthonyg5005/L3-8B-Stheno-v3.1-int8-ct2

Text Generation • Updated Jun 17 • 13

Anthonyg5005/turbcat-instruct-8b-int8-ct2

Text Generation • Updated Jun 20 • 13