nisten
/

deepseek-r1-qwen32b-mlx-6bit

Text Generation

text-generation-inference

Model card Files Files and versions Community

This is a 6bit quant of deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

Probably the sweet spot for running o1 at home :)

Downloads last month: 34

Safetensors

Model size

6.66B params

Tensor type

FP16

·

U32

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for nisten/deepseek-r1-qwen32b-mlx-6bit

Base model

Qwen/Qwen2.5-32B

Finetuned

Qwen/Qwen2.5-Coder-32B

Quantized

(23)

this model