---
license: apache-2.0
datasets:
- crumb/textbook-codex
language:
- en
tags:
- cramp
- cramped
---

distilled zephyr-7b over 44m-textbooks on textbook codex, 1 epoch, 0.3 dropout

| avg | arc | hellaswag | mmlu | truthfulqa | 
| --- | --- | --- | --- | --- | 
| 30.16 | 22.4 | 25.54 | 23.11 | 49.59 |