|
--- |
|
base_model: google/gemma-2-27b-it |
|
pipeline_tag: text-generation |
|
license: apache-2.0 |
|
language: |
|
- en |
|
tags: |
|
- gemma |
|
- gemma-2 |
|
- chat |
|
- it |
|
- abliterated |
|
library_name: transformers |
|
--- |
|
|
|
|
|
NOTE: This is a current WIP (work in progress). |
|
This abliteration was 1/2 performed with llama-cpp-python (obtain direction vector) and 1/2 performed with torch (modify .safetensors one at a time). |
|
It is a rather larger model so it may take me another day or two to figure out which layer I should be using for the direction vector. |
|
This is round 1, layer 20 was used for the direction vector. |
|
I have not tested it yet and cannot test it until I can make a GGUF of this repo. |
|
From there I will determine if I need to change the layer used, etc. |
|
|
|
# gemma-2-27b-it-abliterated |
|
Check out the <a href="https://huggingface.co/byroneverson/gemma-2-27b-it-abliterated/blob/main/abliterate-gemma-2-27b-it.ipynb">jupyter notebook</a> for details of how this model was abliterated from glm-4-9b-chat. |
|
|
|
 |
