|
--- |
|
license: llama2 |
|
datasets: |
|
- evilfreelancer/toxicator-ru |
|
language: |
|
- ru |
|
tags: |
|
- toxify |
|
- detoxify |
|
- seq2seq |
|
pipeline_tag: translation |
|
--- |
|
|
|
# LLaMA 2 7B - Toxicator RU |
|
|
|
This fine-tuned model based on [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf), it utilizes [evilfreelancer/toxicator-ru](https://huggingface.co/datasets/evilfreelancer/toxicator-ru) dataset created from samples in [s-nlp/russe_detox_2022](https://github.com/s-nlp/russe_detox_2022) project. |
|
|
|
Model was tuned **just for lulz** for experimenting with [TorchTune](https://github.com/pytorch/torchtune) tool. |
|
|
|
[100 examples](https://gist.github.com/EvilFreelancer/ac4215195b3c8b1e7dcd39ca51c47138) on GitHub Gist. |
|
|
|
## Links |
|
|
|
* https://github.com/EvilFreelancer/toxicator-ru - GitHub repository with train scripts and scripts for generating dataset |
|
* https://huggingface.co/datasets/evilfreelancer/toxicator-ru - dataset |
|
* https://api.wandb.ai/links/evilfreelancer/33t8pqze - wandb report about training |
