DeepSeek-V3-0324-INT4 for fastllm

project homepage:

https://github.com/ztxz16/fastllm

Usage:

pip install ftllm
ftllm run fastllm/DeepSeek-V3-0324-INT4
Downloads last month
55
Safetensors
Model size
685B params
Tensor type
F32
fastllm
FP16
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support