Edit Models filters

Model Tree

Qwen/Qwen2.5-32B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

126

Full-text search

Active filters: Qwen/Qwen2.5-32B-Instruct

Daemonrat/Qwen2.5-32B-AGI_Q4_K_M

Updated Nov 15, 2024 • 8

osllmai-community/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated Nov 17, 2024 • 4

async0x42/Qwen2.5-Gutenberg-Doppel-32B-exl2_4.0bpw

Text Generation • Updated Nov 18, 2024 • 6

async0x42/Qwen2.5-Gutenberg-Doppel-32B-exl2_5.0bpw

Text Generation • Updated Nov 18, 2024 • 7 • 1

async0x42/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated Nov 29, 2024 • 4

DrNicefellow/Qwen-QwQ-32B-Preview-4.25bpw-exl2

Text Generation • Updated Nov 28, 2024 • 37 • 3

async0x42/QwQ-32B-Preview-exl2_3.5bpw

Text Generation • Updated Nov 29, 2024 • 6

async0x42/QwQ-32B-Preview-exl2_4.5bpw

Text Generation • Updated Nov 29, 2024 • 27 • 1

async0x42/QwQ-32B-Preview-exl2_5.0bpw

Text Generation • Updated Nov 29, 2024 • 4

OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc

Updated 13 days ago • 20 • 1

ThomasBaruzier/QwQ-32B-Preview-GGUF

Updated Dec 16, 2024 • 62 • 1

Dracones/Qwen2.5-32B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 1, 2024 • 4

Dracones/Qwen2.5-32B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 1, 2024 • 4

Dracones/Qwen2.5-32B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 1, 2024 • 6

Dracones/Qwen2.5-32B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 1, 2024 • 5

Dracones/Qwen2.5-32B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 1, 2024 • 9

Dracones/Qwen2.5-32B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 1, 2024 • 4

numen-tech/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Dec 2, 2024

bullerwins/QwQ-32B-Preview-exl2_4.5bpw

Text Generation • Updated Dec 3, 2024 • 4

bullerwins/QwQ-32B-Preview-exl2_5.5bpw

Text Generation • Updated Dec 3, 2024 • 3

bullerwins/QwQ-32B-Preview-exl2_6.5bpw

Text Generation • Updated Dec 3, 2024 • 3

cphan-intersystems/Qwen2.5-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 12, 2024 • 1

ericliu2007/Qwen2.5-32B-Instruct-Q2_K-GGUF

Text Generation • Updated Dec 13, 2024

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-0cb1b

Text Generation • Updated Dec 18, 2024 • 1

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-104ce

Text Generation • Updated Dec 19, 2024 • 4

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-196c8

Text Generation • Updated Dec 19, 2024 • 2

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-8777b

Text Generation • Updated Dec 20, 2024 • 1

TheBlueObserver/Qwen2.5-32B-Instruct-MLX-393a7

Text Generation • Updated Dec 20, 2024 • 2

Triangle104/Qwen2.5-32B-Instruct-Q3_K_S-GGUF

Text Generation • Updated 28 days ago • 25

Triangle104/Qwen2.5-32B-Instruct-Q3_K_M-GGUF

Text Generation • Updated 28 days ago • 27