Models

Intel/Qwen3-Next-80B-A3B-Instruct-int4-mixed-AutoRound

Text Generation • Updated 7 days ago • 8.06k • 15

Intel/Qwen3-Next-80B-A3B-Thinking-int4-mixed-AutoRound

Text Generation • Updated 7 days ago • 2.82k • 27

Intel/Qwen3-Next-80B-A3B-Instruct-int4-AutoRound

Text Generation • Updated 7 days ago • 2.44k • 8

Intel/Qwen3-30B-A3B-Instruct-2507-int4-mixed-AutoRound

0.6B • Updated 7 days ago • 170 • 6

Intel/Qwen3-Next-80B-A3B-Thinking-int4-AutoRound

Text Generation • Updated 7 days ago • 152 • 4

AlexanderKyng/Devstral-Small-2507-int4-AutoRound

Text Generation • 1B • Updated 6 days ago • 19 • 1

Intel/DeepSeek-V3.1-Terminus-int4-mixed-AutoRound

Text Generation • Updated 2 days ago • 815 • 1

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int4-gs128-sym

Text Generation • 0.3B • Updated Jan 4 • 6

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int4-gs128-asym

Text Generation • 0.3B • Updated Jan 4 • 6

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 0.3B • Updated Jan 4 • 65

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 0.3B • Updated Jan 4 • 6

OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc

11B • Updated Apr 30 • 5 • 1

OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc

6B • Updated Apr 30 • 8 • 1

OPEA/Qwen2.5-14B-Instruct-int4-sym-inc

3B • Updated Apr 30 • 4

OPEA/Meta-Llama-3.1-8B-Instruct-int4-sym-inc

2B • Updated Jun 5 • 10

OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc

3B • Updated Jun 5 • 18 • 1

OPEA/Phi-3.5-vision-instruct-int4-sym-inc

Updated Apr 30 • 6

OPEA/Qwen2.5-7B-Instruct-int4-sym-inc

2B • Updated Apr 30 • 5 • 1

OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

3B • Updated Jun 5 • 23 • 2

OPEA/llava-v1.5-7b-int4-sym-inc

1B • Updated Jul 18 • 21 • 1

OPEA/Qwen2.5-72B-Instruct-int4-sym-inc

12B • Updated Apr 30 • 4 • 1

OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc

14B • Updated Jul 18 • 13

OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc

0.2B • Updated 14 days ago • 4.87k

OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc

0.4B • Updated 2 days ago • 1.13k

OPEA/Qwen2.5-3B-Instruct-int4-sym-inc

0.7B • Updated Apr 30 • 5

OPEA/QwQ-32B-Preview-int4-sym-mixed-inc

6B • Updated Apr 30 • 6 • 8

OPEA/glm-4-9b-chat-int4-sym-inc

2B • Updated Apr 30 • 5

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24 • 7 • 1

OPEA/glm-4-9b-chat-int4-sym-lm-head-inc

2B • Updated Apr 30 • 3

OPEA/internlm2_5-7b-chat-int4-sym-inc

2B • Updated Apr 30 • 4