Melvin56 commited on
Commit
e768f06
·
verified ·
1 Parent(s): 26efb4a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -4
README.md CHANGED
@@ -5,7 +5,7 @@ license_link: https://huggingface.co/huihui-ai/Dria-Agent-a-3B-abliterated/blob/
5
  language:
6
  - en
7
  base_model:
8
- - driaforall/Dria-Agent-a-3B
9
  pipeline_tag: text-generation
10
  library_name: transformers
11
  tags:
@@ -17,9 +17,21 @@ tags:
17
  - abliterated
18
  - uncensored
19
  ---
20
- # huihui-ai/Dria-Agent-a-3B-abliterated
21
 
 
22
 
23
- This is an uncensored version of [driaforall/Dria-Agent-a-3B](https://huggingface.co/driaforall/Dria-Agent-a-3B) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
24
- This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.
25
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  language:
6
  - en
7
  base_model:
8
+ - huihui-ai/Dria-Agent-a-3B-abliterated
9
  pipeline_tag: text-generation
10
  library_name: transformers
11
  tags:
 
17
  - abliterated
18
  - uncensored
19
  ---
20
+ # Melvin56/Dria-Agent-a-3B-abliterated-GGUF
21
 
22
+ Original Model : [huihui-ai/Dria-Agent-a-3B-abliterated](https://huggingface.co/huihui-ai/Dria-Agent-a-3B-abliterated)
23
 
24
+ All quants are made using the imatrix option.
 
25
 
26
+ | Model | Size (GB) |
27
+ |:-------------------------------------------------|:-------------:|
28
+ | Q2_K_S | 1.19 |
29
+ | Q2_K | 1.27 |
30
+ | Q3_K_M | 1.60 |
31
+ | Q3_K_M | 1.60 |
32
+ | Q4_0 | 1.83 |
33
+ | Q4_K_M | 1.92 |
34
+ | Q5_K_M | 2.22 |
35
+ | Q6_K | 2.53 |
36
+ | Q8_0 | 3.28 |
37
+ | F16 | 6.17 |