Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,37 @@
+---
+base_model: "deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B"
+language:
+  - en
+tags:
+  - transformers
+  - safetensors
+  - qwen2
+  - text-generation
+  - conversational
+  - autotrain_compatible
+  - text-generation-inference
+  - endpoints_compatible
+  - region:us
+license: "unknown"
+inference: false
+quantized_by: pbatra
+---
+
+# DeepSeek-R1-Distill-Qwen-1.5B
+
+This repository contains quantized versions of the model from the original repository: [deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B).
+
+| Name | Quantization Method | Size (GB) |
+|------|---------------------|-----------|
+| deepseek-r1-distill-qwen-1.5b.Q2_K.gguf | q2_k | 0.70 |
+| deepseek-r1-distill-qwen-1.5b.Q3_K_S.gguf | q3_k_s | 0.80 |
+| deepseek-r1-distill-qwen-1.5b.Q3_K_M.gguf | q3_k_m | 0.86 |
+| deepseek-r1-distill-qwen-1.5b.Q3_K_L.gguf | q3_k_l | 0.91 |
+| deepseek-r1-distill-qwen-1.5b.Q4_0.gguf | q4_0 | 0.99 |
+| deepseek-r1-distill-qwen-1.5b.Q4_K_S.gguf | q4_k_s | 1.00 |
+| deepseek-r1-distill-qwen-1.5b.Q4_K_M.gguf | q4_k_m | 1.04 |
+| deepseek-r1-distill-qwen-1.5b.Q5_0.gguf | q5_0 | 1.17 |
+| deepseek-r1-distill-qwen-1.5b.Q5_K_S.gguf | q5_k_s | 1.17 |
+| deepseek-r1-distill-qwen-1.5b.Q5_K_M.gguf | q5_k_m | 1.20 |
+| deepseek-r1-distill-qwen-1.5b.Q6_K.gguf | q6_k | 1.36 |
+| deepseek-r1-distill-qwen-1.5b.Q8_0.gguf | q8_0 | 1.76 |