matrixportal
/

DeepSeek-R1-Distill-Qwen-7B-GGUF

Inference Endpoints

Model card Files Files and versions Community

DeepSeek-R1-Distill-Qwen-7B-GGUF

1 contributor

History: 20 commits

matrixportal's picture

Upload deepseek-r1-distill-qwen-7b-q5_k_m.gguf with huggingface_hub

708ff0e verified 14 days ago

.gitattributes

2.27 kB

Upload deepseek-r1-distill-qwen-7b-q5_k_m.gguf with huggingface_hub 14 days ago
README.md

1.91 kB

Upload README.md with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q2_k.gguf

3.02 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q2_k.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q3_k_l.gguf

4.09 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q3_k_l.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q3_k_m.gguf

3.81 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q3_k_m.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q3_k_s.gguf

3.49 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q3_k_s.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q4_0.gguf

4.43 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q4_0.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q4_k_m.gguf

4.68 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q4_k_m.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q4_k_s.gguf

4.46 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q4_k_s.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q5_0.gguf

5.32 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q5_0.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q5_k_m.gguf

5.44 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q5_k_m.gguf with huggingface_hub 14 days ago
deepseek-r1-distill-qwen-7b-q5_k_s.gguf

5.32 GB
LFS

Upload deepseek-r1-distill-qwen-7b-q5_k_s.gguf with huggingface_hub 14 days ago