distilled zephyr-7b over 44m-textbooks on textbook codex, 1 epoch, 0.3 dropout

avg arc hellaswag mmlu truthfulqa
30.16 22.4 25.54 23.11 49.59
Downloads last month
15
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API does not yet support model repos that contain custom code.

Dataset used to train crumb/44m-Z