DaijobuAI's picture
Update README.md
d6d2d08 verified
|
raw
history blame
2.11 kB
metadata
license: apache-2.0
base_model: cross-encoder/nli-deberta-v3-base
model-index:
  - name: Komainu
    results: []

Komainu - Content Moderator

Model created by Daijobu.ai. Daijobu.ai drives your business AI transformation. Learn More.

This model is a fine-tuned version of cross-encoder/nli-deberta-v3-base on Daijobu.ai's content moderation dataset.

Model description

This model can identify 9 types of contents to be moderated.

Category Output Definition
sexual 0 Content meant to arouse sexual excitement, such as the description of sexual activity, or that promotes sexual services (excluding sex education and wellness).
hate 1 Content that expresses, incites, or promotes hate based on race, gender, ethnicity, religion, nationality, sexual orientation, disability status, or caste.
violence 2 Content that promotes or glorifies violence or celebrates the suffering or humiliation of others.
harassment 3 Content that may be used to torment or annoy individuals in real life, or make harassment more likely to occur.
self-harm 4 Content that promotes, encourages, or depicts acts of self-harm, such as suicide, cutting, and eating disorders.
sexual/minors 5 Sexual content that includes an individual who is under 18 years old.
hate/threatening 6 Hateful content that also includes violence or serious harm towards the targeted group.
violence/graphic 7 Violent content that depicts death, violence, or serious physical injury in extreme graphic detail.
fake news 8 Fake news
OK 9 OK

Intended uses & limitations

English language only. This model is a demonstrator, not intended for commercial or production use. Use with care.

Framework versions

  • Transformers 4.40.2
  • Pytorch 2.2.2+cu121
  • Datasets 2.19.1
  • Tokenizers 0.19.1