Melvin56
/

DeepSeek-R1-Distill-Qwen-7B-abliterated-v2-GGUF

Text Generation

DeepSeek-R1-Distill-Qwen-7B

Inference Endpoints

Model card Files Files and versions Community

Melvin56 commited on 22 days ago

Commit

c3bd39d

·

1 Parent(s): 16e795d

Update README.md

Files changed (1) hide show

README.md +9 -9

README.md CHANGED Viewed

@@ -17,12 +17,12 @@ Original Model : [huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2](https://
 All quants are made using the imatrix option
-|           Model                                     |   Size   | Params  |
-|:---------------------------------------------------:|:--------:|:-------:|
-| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q3_K_M         |  3.54 GB | 7.62B  |
-| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_0                  |  4.13 GB | 7.62B  |
-| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_K_M         |  4.36 GB | 7.62B  |
-| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q5_K_M         |  5.07 GB | 7.62B  |
-| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q6_K                  |  5.82 GB | 7.62B  |
-| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q8_0                  |  7.54 GB | 7.62B  |
-| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 F16                   | 14.19 GB | 7.62B  |

 All quants are made using the imatrix option
+| Model                                            |   Size   | Params  |
+|:-------------------------------------------------|:--------:|:-------:|
+| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q3_K_M |  3.54 GB | 7.62B  |
+| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_0   |  4.13 GB | 7.62B  |
+| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q4_K_M |  4.36 GB | 7.62B  |
+| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q5_K_M |  5.07 GB | 7.62B  |
+| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q6_K   |  5.82 GB | 7.62B  |
+| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 Q8_0   |  7.54 GB | 7.62B  |
+| DeepSeek-R1-Distill-Qwen-7B-abliterated-v2 F16    | 14.19 GB | 7.62B  |