| license: apache-2.0 | |
| datasets: | |
| - crumb/textbook-codex | |
| language: | |
| - en | |
| tags: | |
| - cramp | |
| - cramped | |
| distilled zephyr-7b over 44m-textbooks on textbook codex, 1 epoch, 0.3 dropout | |
| | avg | arc | hellaswag | mmlu | truthfulqa | | |
| | --- | --- | --- | --- | --- | | |
| | 30.16 | 22.4 | 25.54 | 23.11 | 49.59 | |