DeepSeek-R1-INT4 for fastllm

project homepage:

https://github.com/ztxz16/fastllm

Usage:

pip install ftllm
ftllm run fastllm/DeepSeek-R1-INT4
Downloads last month
20
Safetensors
Model size
685B params
Tensor type
F32
·
fastllm
·
FP16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support