---
library_name: transformers
license: gemma
---
[gguf is here](https://huggingface.co/backyardai/Gemmoy-9B-MK.I-GGUF) made available by [Backyard AI](https://huggingface.co/backyardai)

first try finetuning gemma 9b instruct. my data was a mess, i only noticed that after training, so this is just a test run

i formatted the dataset like below
```
<start_of_turn>user
{system}

{prompt}<end_of_turn>
<start_of_turn>model
{response}<end_of_turn>
<start_of_turn>user
{prompt}<end_of_turn>
<start_of_turn>model
{response}<end_of_turn>

and so on...
```
settings for st: [context](https://huggingface.co/Hastagaras/Gemmoy-9B-MK.I/blob/main/Gemma2%20C.json)/[instruct](https://huggingface.co/Hastagaras/Gemmoy-9B-MK.I/blob/main/Gemma2%20I.json)