Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

8-bit precision

4-bit precision

text-generation-inference

Carbon Emissions

text-embeddings-inference

Misc with no match

Mixture of Experts

Models

104

Full-text search

Active filters: nncf

AIFunOver/Llama-3.1-70B-Instruct-openvino-4bit

Text Generation • Updated Nov 16 • 12

AIFunOver/FLUX.1-dev-openvino-8bit

Text-to-Image • Updated Nov 18

AIFunOver/FLUX.1-dev-openvino-4bit

Text-to-Image • Updated Nov 18

hsuwill000/Qwen2.5-0.5B-openvino-8bit

Text Generation • Updated Nov 19 • 14

TheHierophant/Umbral-Devil-Hermes-Mind-V0.1-openvino-8bit

Text Generation • Updated 25 days ago • 20

AIFunOver/QwQ-32B-Preview-openvino-8bit

Text Generation • Updated 20 days ago • 20

AIFunOver/QwQ-32B-Preview-openvino-4bit

Text Generation • Updated 20 days ago • 15

AIFunOver/Llama-Guard-3-1B-openvino-fp16

Text Generation • Updated 20 days ago • 21

AIFunOver/Llama-Guard-3-1B-openvino-8bit

Text Generation • Updated 20 days ago • 12

AIFunOver/Llama-Guard-3-1B-openvino-4bit

Text Generation • Updated 19 days ago • 9

muhuott/Qwen2.5-1.5B-Instruct-openvino-4bit

Text Generation • Updated 16 days ago • 8

echarlaix/distilgpt2-openvino-8bit

Text Generation • Updated 12 days ago • 37

lukeyourheart/distilgpt2-openvino-8bit

Text Generation • Updated 11 days ago • 6

hsuwill000/stable-diffusion-xl-base-1.0-openvino-8bit

Text-to-Image • Updated 20 minutes ago