|
--- |
|
license: mit |
|
base_model: teknium/OpenHermes-2.5-Mistral-7B |
|
datasets: |
|
- rxavier/economicus |
|
language: |
|
- en |
|
tags: |
|
- chatml |
|
- mistral |
|
- instruct |
|
- openhermes |
|
- economics |
|
--- |
|
|
|
# Taurus 7B 1.0 |
|
|
|
 |
|
|
|
## Description |
|
|
|
Taurus is an [OpenHermes 2.5](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) finetune using the [Economicus dataset](https://huggingface.co/datasets/rxavier/economicus), an instruct dataset synthetically generated from Economics PhD textbooks. |
|
|
|
The model was trained for 2 epochs (QLoRA) using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl). The exact config I used can be found [here](https://huggingface.co/rxavier/Taurus-1.0-Mistral-7B/tree/main/axolotl). |
|
|
|
## Prompt format |
|
|
|
Taurus uses **ChatML**. |
|
|
|
``` |
|
<|im_start|>system |
|
System message |
|
<|im_start|>user |
|
User message<|im_end|> |
|
<|im_start|>assistant |
|
``` |
|
|
|
## GGUF quants |
|
|
|
You can find GGUF quants for llama.cpp [here](https://huggingface.co/rxavier/Taurus-7B-1.0-GGUF). |
