Update README.md
Browse files
README.md
CHANGED
@@ -81,7 +81,11 @@ This is a **work in progress**, Phi 4 is smoll so I can toy with it.
|
|
81 |
- Install my fork
|
82 |
- Follow tutorial on github
|
83 |
|
84 |
-
Launch with enough VRAM : python abliterate.py -m /workspace/microsoft_phi-4 -o ./perfect --deccp --flash-attn --device auto --scan-all --resume
|
|
|
|
|
|
|
|
|
85 |
|
86 |
If you want to use the tensors available here, just put the `refusal_tensors/` folder at the root of the script
|
87 |
|
|
|
81 |
- Install my fork
|
82 |
- Follow tutorial on github
|
83 |
|
84 |
+
Launch with enough VRAM : `python abliterate.py -m /workspace/microsoft_phi-4 -o ./perfect --deccp --flash-attn --device auto --scan-all --resume --scale-factor 1`
|
85 |
+
|
86 |
+
OR
|
87 |
+
|
88 |
+
`python chat.py -m /workspace/microsoft_phi-4` then select layer range "1;39", and scale factor to 1.0
|
89 |
|
90 |
If you want to use the tensors available here, just put the `refusal_tensors/` folder at the root of the script
|
91 |
|