README.md

metadata

license: apache-2.0
language:
  - en
pipeline_tag: text-generation
tags:
  - pytorch
  - mixtral
  - fine-tuned
  - moe

Mixtral 8x7B - Holodeck

Model Description

Mistral 7B-Holodeck is a finetune created using Mixtral's 8x7B model.

Training data

The training data contains around 3000 ebooks in various genres. Most parts of the dataset have been prepended using the following text: [Genre: <genre1>, <genre2>]

---

Limitations and Biases

Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion).